Jul 15 13:06:28.629684 ip-10-0-129-104 systemd[1]: Starting Kubernetes Kubelet... Jul 15 13:06:30.132654 ip-10-0-129-104 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:06:30.132654 ip-10-0-129-104 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 13:06:30.132654 ip-10-0-129-104 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:06:30.132654 ip-10-0-129-104 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 13:06:30.132654 ip-10-0-129-104 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:06:30.134364 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.134273 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 13:06:30.138569 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138550 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:06:30.138569 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138568 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138572 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138575 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138578 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138581 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138584 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138587 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138590 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138593 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138598 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138602 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138606 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138609 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138612 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138616 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138619 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138622 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138626 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138628 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:06:30.138636 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138632 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138635 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138637 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138640 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138643 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138647 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138650 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138653 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138656 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138659 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138661 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138664 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138669 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138673 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138675 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138679 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138681 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138684 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138688 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138691 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:06:30.139115 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138694 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138696 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138700 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138703 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138706 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138709 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138711 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138714 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138717 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138721 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138724 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138726 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138729 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138732 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138735 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138738 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138741 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138744 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138747 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138750 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:06:30.139676 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138753 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138756 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138759 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138761 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138764 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138767 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138770 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138773 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138775 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138778 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138781 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138784 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138786 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138789 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138792 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138795 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138798 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138800 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138803 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:06:30.140231 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138807 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138810 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138813 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138817 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138820 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138822 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138825 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138830 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138833 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138836 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138839 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138841 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138844 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138847 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138850 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138852 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138855 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138858 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138862 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.138867 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:06:30.141016 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139649 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139658 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139661 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139664 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139667 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139672 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139677 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139680 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139684 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139688 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139691 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139694 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139697 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139700 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139703 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139707 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139710 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139713 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139716 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:06:30.141597 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139720 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139723 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139726 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139729 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139732 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139734 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139737 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139742 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139745 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139748 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139752 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139755 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139758 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139761 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139764 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139767 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139770 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139773 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139776 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:06:30.142126 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139779 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139782 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139785 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139788 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139792 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139795 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139798 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139801 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139804 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139807 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139811 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139814 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139817 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139820 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139824 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139827 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139830 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139832 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139835 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139838 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:06:30.142643 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139841 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139845 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139848 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139851 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139853 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139856 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139859 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139862 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139864 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139867 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139869 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139872 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139875 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139878 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139881 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139884 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139887 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139891 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139894 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139896 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:06:30.143185 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139899 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139906 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139910 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139913 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139916 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139919 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139921 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139925 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139927 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139930 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139933 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139938 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139941 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139944 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139947 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139950 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139952 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139956 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139959 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139962 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:06:30.143713 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.139964 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141732 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141745 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141750 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141753 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141757 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141760 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141763 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141766 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141769 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141772 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141775 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141778 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141780 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141784 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141787 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141790 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141792 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141795 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141799 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:06:30.144214 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141802 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141805 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141807 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141810 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141813 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141816 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141819 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141821 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141824 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141827 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141829 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141833 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141835 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141838 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141842 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141845 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141848 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141850 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141853 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141856 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:06:30.144737 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141858 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141861 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141864 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141867 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141869 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141872 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141876 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141878 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141881 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141884 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141887 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141890 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141893 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141896 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141898 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141901 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141904 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141907 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141910 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141912 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:06:30.145241 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141915 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141918 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141921 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141923 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141926 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141929 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141932 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141935 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141939 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141941 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141944 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141947 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141951 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141955 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141959 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141964 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141967 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141970 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141973 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:06:30.145773 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141976 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141979 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141982 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141985 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141991 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141994 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.141998 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142001 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142005 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142008 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142010 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142013 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142016 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142019 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142022 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142024 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142027 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142030 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142033 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142036 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:06:30.146260 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142039 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142110 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142117 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142124 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142132 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142137 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142141 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142145 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142149 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142153 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142156 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142160 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142163 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142166 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142170 2579 flags.go:64] FLAG: --cgroup-root="" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142173 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142176 2579 flags.go:64] FLAG: --client-ca-file="" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142180 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142184 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142189 2579 flags.go:64] FLAG: --cluster-domain="" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142192 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142195 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142198 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142202 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 13:06:30.146795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142206 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142209 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142212 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142216 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142219 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142222 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142226 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142230 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142233 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142237 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142240 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142243 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142247 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142250 2579 flags.go:64] FLAG: --enable-server="true" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142253 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142258 2579 flags.go:64] FLAG: --event-burst="100" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142262 2579 flags.go:64] FLAG: --event-qps="50" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142265 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142268 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142272 2579 flags.go:64] FLAG: --eviction-hard="" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142276 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142279 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142283 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142286 2579 flags.go:64] FLAG: --eviction-soft="" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142289 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 13:06:30.147400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142292 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142296 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142299 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142302 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142305 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142308 2579 flags.go:64] FLAG: --feature-gates="" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142312 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142316 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142319 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142323 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142326 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142330 2579 flags.go:64] FLAG: --help="false" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142333 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142336 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142339 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142342 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142345 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142349 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142352 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142355 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142358 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142361 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142364 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142367 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 13:06:30.148112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142371 2579 flags.go:64] FLAG: --kube-reserved="" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142374 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142377 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142381 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142384 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142387 2579 flags.go:64] FLAG: --lock-file="" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142389 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142392 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142395 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142407 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142410 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142414 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142417 2579 flags.go:64] FLAG: --logging-format="text" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142420 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142425 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142430 2579 flags.go:64] FLAG: --manifest-url="" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142434 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142442 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142446 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142450 2579 flags.go:64] FLAG: --max-pods="110" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142454 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142457 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142460 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142463 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142466 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 13:06:30.148728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142470 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142473 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142480 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142484 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142487 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142491 2579 flags.go:64] FLAG: --pod-cidr="" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142494 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142500 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142517 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142521 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142524 2579 flags.go:64] FLAG: --port="10250" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142527 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142530 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061709423113f7fdd" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142534 2579 flags.go:64] FLAG: --qos-reserved="" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142537 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142540 2579 flags.go:64] FLAG: --register-node="true" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142544 2579 flags.go:64] FLAG: --register-with-taints="" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142547 2579 flags.go:64] FLAG: --registry-burst="10" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142551 2579 flags.go:64] FLAG: --registry-qps="5" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142554 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142557 2579 flags.go:64] FLAG: --reserved-memory="" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142562 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142565 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142568 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142571 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 13:06:30.149377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142574 2579 flags.go:64] FLAG: --runonce="false" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142577 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142581 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142584 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142587 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142590 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142594 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142597 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142600 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142603 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142606 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142609 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142612 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142618 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142622 2579 flags.go:64] FLAG: --system-cgroups="" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142624 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142630 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142634 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142637 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142641 2579 flags.go:64] FLAG: --tls-min-version="" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142644 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142647 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142651 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142654 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142657 2579 flags.go:64] FLAG: --v="2" Jul 15 13:06:30.150107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142661 2579 flags.go:64] FLAG: --version="false" Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142666 2579 flags.go:64] FLAG: --vmodule="" Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142670 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.142673 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142793 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142797 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142800 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142803 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142806 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142810 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142814 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142817 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142820 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142823 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142826 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142828 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142831 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142834 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142837 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142840 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:06:30.150760 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142845 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142847 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142850 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142853 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142856 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142859 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142861 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142864 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142867 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142870 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142873 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142876 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142878 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142881 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142889 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142892 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142894 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142897 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142900 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:06:30.151269 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142903 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142906 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142909 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142912 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142915 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142918 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142921 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142924 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142927 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142929 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142932 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142935 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142938 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142942 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142945 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142948 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142951 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142953 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142956 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142959 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:06:30.151813 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142962 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142964 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142967 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142970 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142973 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142975 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142978 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142985 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142988 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142991 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142994 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142996 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.142999 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143002 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143007 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143011 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143014 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143017 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143020 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:06:30.152333 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143023 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143026 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143029 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143031 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143034 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143037 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143041 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143044 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143047 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143050 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143052 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143055 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143058 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143061 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143064 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143066 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143069 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143072 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143075 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143079 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:06:30.152888 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143084 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143087 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143091 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143094 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.143097 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.143710 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.150471 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.150490 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.150530 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.150537 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150608 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150614 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150618 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150621 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:06:30.153395 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150624 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150627 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150630 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150633 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150636 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150639 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150642 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150645 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150647 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150650 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150653 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150657 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150660 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150662 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150665 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150668 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150671 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150674 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150677 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150680 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:06:30.153784 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150683 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150686 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150689 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150692 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150695 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150698 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150701 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150704 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150707 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150710 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150713 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150716 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150718 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150721 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150724 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150727 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150730 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150733 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150735 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:06:30.154296 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150738 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150742 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150747 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150750 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150753 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150756 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150758 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150761 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150764 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150767 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150770 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150773 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150775 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150778 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150782 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150785 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150788 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150791 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150794 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:06:30.154812 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150799 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150803 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150806 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150809 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150813 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150815 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150818 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150821 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150824 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150827 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150830 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150833 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150836 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150839 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150841 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150844 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150847 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150850 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150853 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150855 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:06:30.155292 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150858 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150861 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150864 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150867 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150869 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150872 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150875 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150878 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150881 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150884 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150887 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150890 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150894 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150897 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150900 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150903 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:06:30.155839 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.150906 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.150912 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151049 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151054 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151057 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151061 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151064 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151066 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151069 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151072 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151074 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151077 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151080 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151083 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151085 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:06:30.156251 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151088 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151091 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151093 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151096 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151098 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151101 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151104 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151107 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151109 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151112 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151116 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151118 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151122 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151124 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151127 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151130 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151132 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151135 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151138 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151140 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:06:30.156672 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151143 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151145 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151148 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151151 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151154 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151156 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151159 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151162 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151164 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151167 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151171 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151175 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151178 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151181 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151184 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151187 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151189 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151192 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151195 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151198 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:06:30.157187 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151200 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151203 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151206 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151211 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151214 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151218 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151220 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151223 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151226 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151228 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151231 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151234 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151237 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151239 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151242 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151244 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151247 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151250 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151253 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151255 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:06:30.157712 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151258 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151261 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151264 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151267 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151269 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151272 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151275 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151278 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151281 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151284 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151286 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151289 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151292 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151295 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151299 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151303 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151308 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151311 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151315 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:06:30.158250 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151318 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151321 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151324 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151327 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151329 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151333 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:30.151336 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.151341 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.151440 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.154107 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.155363 2579 server.go:1019] "Starting client certificate rotation" Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.155470 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.156834 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:06:30.158793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.157845 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:06:30.160208 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.160188 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:06:30.169283 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.169266 2579 log.go:25] "Validated CRI v1 runtime API" Jul 15 13:06:30.172002 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.171984 2579 log.go:25] "Validated CRI v1 image API" Jul 15 13:06:30.174175 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.174152 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 13:06:30.176529 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.176507 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c5e1ff39-65f9-43ff-b781-417dbf61a5d0:/dev/nvme0n1p4 cfaf07a6-2b4c-48ec-b640-60c8c7bae95a:/dev/nvme0n1p3] Jul 15 13:06:30.176607 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.176528 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 13:06:30.182148 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.182025 2579 manager.go:216] Machine: {Timestamp:2026-07-15 13:06:30.180798359 +0000 UTC m=+1.451906853 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3083823 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f789401fa869bceef899470e8764 SystemUUID:ec24f789-401f-a869-bcee-f899470e8764 BootID:ce843e78-a5c8-424c-bbf4-ab7e564b413d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:f2:b7:c6:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:f2:b7:c6:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:a5:28:5f:f3:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 13:06:30.182148 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.182146 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 13:06:30.182265 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.182253 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 13:06:30.185882 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.185857 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 13:06:30.186021 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.185887 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 13:06:30.186957 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.186933 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:06:30.187111 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.187098 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 13:06:30.187151 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.187114 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 13:06:30.187151 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.187122 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:06:30.187760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.187747 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:06:30.188832 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.188821 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 13:06:30.192580 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.192567 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:06:30.192701 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.192691 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 13:06:30.192732 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.192722 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 15 13:06:30.192761 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.192733 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 13:06:30.192761 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.192752 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 13:06:30.192761 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.192761 2579 kubelet.go:398] "Adding apiserver pod source" Jul 15 13:06:30.192861 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.192771 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 13:06:30.193114 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.193101 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:06:30.193152 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.193119 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:06:30.196504 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.196486 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 13:06:30.198910 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.198895 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 13:06:30.198959 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.198927 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 13:06:30.199083 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199072 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 13:06:30.199120 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199087 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 13:06:30.199120 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199094 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 13:06:30.199120 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199100 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 13:06:30.199120 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199109 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 13:06:30.199120 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199115 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 13:06:30.199595 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199584 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 13:06:30.199595 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199594 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 13:06:30.199660 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199602 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 13:06:30.199660 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199608 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 13:06:30.199660 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199626 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 13:06:30.199660 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.199634 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 13:06:30.200329 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.200318 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 13:06:30.200329 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.200328 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 13:06:30.202442 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.202425 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 13:06:30.202487 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.202419 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 13:06:30.202543 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.202524 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 13:06:30.203617 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.203604 2579 server.go:1268] "Started kubelet" Jul 15 13:06:30.204219 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.203694 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 13:06:30.204219 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.203743 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 13:06:30.204219 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.203825 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 13:06:30.204548 ip-10-0-129-104 systemd[1]: Started Kubernetes Kubelet. Jul 15 13:06:30.205044 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.204894 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 13:06:30.205954 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.205941 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 15 13:06:30.209766 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.209742 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 13:06:30.211835 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.211817 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 13:06:30.211835 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.211829 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 13:06:30.211985 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.211884 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.212574 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.212555 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 13:06:30.212574 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.212555 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 13:06:30.212705 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.212585 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 13:06:30.212766 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.212705 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 15 13:06:30.212766 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.212716 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 15 13:06:30.212855 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.212773 2579 factory.go:55] Registering systemd factory Jul 15 13:06:30.212855 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.212791 2579 factory.go:223] Registration of the systemd container factory successfully Jul 15 13:06:30.213050 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.213034 2579 factory.go:153] Registering CRI-O factory Jul 15 13:06:30.213050 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.213050 2579 factory.go:223] Registration of the crio container factory successfully Jul 15 13:06:30.213172 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.213098 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 13:06:30.213172 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.213117 2579 factory.go:103] Registering Raw factory Jul 15 13:06:30.213172 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.213128 2579 manager.go:1196] Started watching for new ooms in manager Jul 15 13:06:30.213590 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.213569 2579 manager.go:349] Starting recovery of all containers Jul 15 13:06:30.215822 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.215796 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xs67w" Jul 15 13:06:30.218648 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.218615 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 13:06:30.219153 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.219116 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 13:06:30.220236 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.219165 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-104.ec2.internal.18c27867f079243a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-104.ec2.internal,UID:ip-10-0-129-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-104.ec2.internal,},FirstTimestamp:2026-07-15 13:06:30.203573306 +0000 UTC m=+1.474681798,LastTimestamp:2026-07-15 13:06:30.203573306 +0000 UTC m=+1.474681798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-104.ec2.internal,}" Jul 15 13:06:30.225064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.225043 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xs67w" Jul 15 13:06:30.226259 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.226243 2579 manager.go:354] Recovery completed Jul 15 13:06:30.231174 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.231161 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:06:30.233738 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.233722 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:06:30.233799 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.233751 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:06:30.233799 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.233762 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:06:30.234338 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.234320 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 13:06:30.234338 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.234335 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 13:06:30.234514 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.234344 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:06:30.234514 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.234354 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:06:30.235136 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.235119 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:06:30.235217 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.235149 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:06:30.235217 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.235163 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:06:30.235827 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.235704 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-104.ec2.internal.18c27867f24569e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-104.ec2.internal,UID:ip-10-0-129-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-104.ec2.internal,},FirstTimestamp:2026-07-15 13:06:30.233737705 +0000 UTC m=+1.504846202,LastTimestamp:2026-07-15 13:06:30.233737705 +0000 UTC m=+1.504846202,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-104.ec2.internal,}" Jul 15 13:06:30.236562 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.236547 2579 policy_none.go:49] "None policy: Start" Jul 15 13:06:30.236626 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.236567 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 13:06:30.236626 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.236579 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 13:06:30.238706 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.238695 2579 policy_none.go:47] "Start" Jul 15 13:06:30.282290 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.282131 2579 manager.go:337] "Starting Device Plugin manager" Jul 15 13:06:30.282375 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.282319 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 13:06:30.282375 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.282334 2579 server.go:87] "Starting device plugin registration server" Jul 15 13:06:30.282579 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.282566 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 13:06:30.282612 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.282581 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 13:06:30.282722 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.282698 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 13:06:30.282833 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.282807 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 13:06:30.282833 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.282819 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 13:06:30.283288 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.283264 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 13:06:30.283365 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.283318 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.345458 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.345425 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 13:06:30.347427 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.346716 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 13:06:30.347427 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.346765 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 13:06:30.347427 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.346790 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 13:06:30.347427 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.346834 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 13:06:30.349383 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.349352 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:06:30.382653 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.382632 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:06:30.383568 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.383527 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:06:30.383568 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.383565 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:06:30.383675 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.383577 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:06:30.383675 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.383601 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.390332 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.390319 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.390381 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.390339 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-104.ec2.internal\": node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.408173 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.408148 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.447112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.447082 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal"] Jul 15 13:06:30.447214 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.447157 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:06:30.448013 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.447997 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:06:30.448112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.448028 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:06:30.448112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.448042 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:06:30.450209 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.450195 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:06:30.450356 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.450341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.450419 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.450379 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:06:30.450905 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.450889 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:06:30.450974 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.450916 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:06:30.450974 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.450928 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:06:30.451867 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.451850 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:06:30.451933 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.451886 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:06:30.451933 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.451900 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:06:30.453017 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.453000 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.453113 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.453031 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:06:30.453754 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.453736 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:06:30.453822 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.453772 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:06:30.453822 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.453788 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:06:30.472098 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.472075 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-104.ec2.internal\" not found" node="ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.475586 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.475571 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-104.ec2.internal\" not found" node="ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.509055 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.509031 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.609183 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.609153 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.614784 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.614765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b45715339abdc1786b75be6237943e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal\" (UID: \"62b45715339abdc1786b75be6237943e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.614865 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.614792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a577634d414d36381327713dceaa9a2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-104.ec2.internal\" (UID: \"9a577634d414d36381327713dceaa9a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.614865 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.614812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62b45715339abdc1786b75be6237943e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal\" (UID: \"62b45715339abdc1786b75be6237943e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.709882 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.709848 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.715678 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.715657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62b45715339abdc1786b75be6237943e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal\" (UID: \"62b45715339abdc1786b75be6237943e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.715759 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.715692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b45715339abdc1786b75be6237943e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal\" (UID: \"62b45715339abdc1786b75be6237943e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.715759 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.715739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a577634d414d36381327713dceaa9a2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-104.ec2.internal\" (UID: \"9a577634d414d36381327713dceaa9a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.715828 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.715771 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62b45715339abdc1786b75be6237943e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal\" (UID: \"62b45715339abdc1786b75be6237943e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.715828 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.715780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a577634d414d36381327713dceaa9a2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-104.ec2.internal\" (UID: \"9a577634d414d36381327713dceaa9a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.715828 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.715793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62b45715339abdc1786b75be6237943e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal\" (UID: \"62b45715339abdc1786b75be6237943e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.773713 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.773671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.778722 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:30.778515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" Jul 15 13:06:30.810597 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.810561 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:30.917095 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:30.917049 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:31.018097 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:31.018036 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:31.118504 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:31.118471 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:31.154641 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.154610 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 13:06:31.155087 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.154768 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 13:06:31.218990 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:31.218962 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:31.229751 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.229721 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 13:01:31 +0000 UTC" deadline="2028-02-10 16:10:37.419482786 +0000 UTC" Jul 15 13:06:31.229751 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.229748 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13803h4m6.189738404s" Jul 15 13:06:31.319123 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:31.319062 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-104.ec2.internal\" not found" Jul 15 13:06:31.379033 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.379001 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:06:31.412025 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.411994 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" Jul 15 13:06:31.426530 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.426512 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:06:31.428434 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.428413 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" Jul 15 13:06:31.440786 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.440764 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:06:31.468879 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:31.468845 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a577634d414d36381327713dceaa9a2.slice/crio-9243166cff6d3a1a9bf42dfb42cd9a4e77e499044b061f1348661bcdc972f4ce WatchSource:0}: Error finding container 9243166cff6d3a1a9bf42dfb42cd9a4e77e499044b061f1348661bcdc972f4ce: Status 404 returned error can't find the container with id 9243166cff6d3a1a9bf42dfb42cd9a4e77e499044b061f1348661bcdc972f4ce Jul 15 13:06:31.473029 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.473015 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:06:31.536369 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.536347 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:06:31.765837 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:31.765813 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:06:32.194156 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.194125 2579 apiserver.go:52] "Watching apiserver" Jul 15 13:06:32.201450 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.201106 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 13:06:32.203665 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.203634 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal","openshift-multus/network-metrics-daemon-hrwxj","openshift-network-diagnostics/network-check-target-2l2rq","openshift-network-operator/iptables-alerter-7nznt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx","openshift-cluster-node-tuning-operator/tuned-j5vd9","openshift-image-registry/node-ca-44ffz","openshift-multus/multus-additional-cni-plugins-8vjml","openshift-multus/multus-wwc4d","openshift-ovn-kubernetes/ovnkube-node-ms7vj","kube-system/global-pull-secret-syncer-ndlzv","kube-system/konnectivity-agent-7rj6v","kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal","openshift-dns/node-resolver-49ctm"] Jul 15 13:06:32.206379 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.206355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.208694 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.208668 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.208837 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.208759 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:32.209036 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.209017 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 13:06:32.209148 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.209050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 13:06:32.209148 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.209137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2vgnk\"" Jul 15 13:06:32.209265 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.209250 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 13:06:32.210996 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.210969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:32.211113 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.211049 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:32.212500 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.212475 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 13:06:32.214057 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.214033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.216637 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.216318 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 13:06:32.216637 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.216333 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:06:32.216637 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.216377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 13:06:32.216637 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.216320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l9llb\"" Jul 15 13:06:32.216637 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.216515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.218772 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.218734 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4t9b6\"" Jul 15 13:06:32.218875 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.218817 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.218963 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.218947 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 13:06:32.219000 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.218967 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 13:06:32.219328 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.219310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 13:06:32.220719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.220701 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:06:32.221133 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.221113 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 13:06:32.221235 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.221142 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wp6th\"" Jul 15 13:06:32.221324 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.221301 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.223591 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.223716 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223574 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 13:06:32.223716 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223581 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 13:06:32.223716 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42cd2274-5832-41a5-a6ba-b63009e462d0-iptables-alerter-script\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.223716 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cd2274-5832-41a5-a6ba-b63009e462d0-host-slash\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.223940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mqsk\" (UniqueName: \"kubernetes.io/projected/42cd2274-5832-41a5-a6ba-b63009e462d0-kube-api-access-5mqsk\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.223940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a915b40-77d6-45db-bbf5-533616e8b4a9-serviceca\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.223940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfn5j\" (UniqueName: \"kubernetes.io/projected/6a915b40-77d6-45db-bbf5-533616e8b4a9-kube-api-access-pfn5j\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.223940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:32.223940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a915b40-77d6-45db-bbf5-533616e8b4a9-host\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.223940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94533b2e-1971-41a5-85b9-c87137ae7b59-kubelet-config\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.223940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94533b2e-1971-41a5-85b9-c87137ae7b59-dbus\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.224283 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223950 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-74jj6\"" Jul 15 13:06:32.224283 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 13:06:32.224283 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.223975 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 13:06:32.226405 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.226378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.226405 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.226397 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:06:32.228660 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.228630 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-58522\"" Jul 15 13:06:32.228660 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.228652 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 13:06:32.228820 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.228810 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 13:06:32.229329 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.229145 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:32.229329 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.229214 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:32.230049 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.230033 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:06:32.231936 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.231913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.234170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.234150 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 13:06:32.234463 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.234441 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 13:06:32.234592 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.234474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.234592 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.234522 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zsbsk\"" Jul 15 13:06:32.234746 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.234664 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 13:06:32.235113 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.234954 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 13:06:32.235211 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.235116 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 13:06:32.235272 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.235208 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 13:06:32.236764 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.236740 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 13:06:32.236892 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.236700 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 13:06:32.236892 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.236802 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cb5v5\"" Jul 15 13:06:32.237035 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.237016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.239322 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.239301 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hwwjn\"" Jul 15 13:06:32.239420 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.239354 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 13:06:32.239420 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.239380 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 13:06:32.252986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.252963 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g46f4" Jul 15 13:06:32.266877 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.266855 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g46f4" Jul 15 13:06:32.313596 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.313573 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 13:06:32.324899 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.324877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-kubelet\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.325007 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.324904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-log-socket\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.325007 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.324922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-sys-fs\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.325007 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.324937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysctl-d\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.325007 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.324952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-host\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.325197 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-ovn\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.325197 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-ovnkube-config\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.325197 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8d62da5-3820-4d31-9bff-afa87c2a005e-agent-certs\") pod \"konnectivity-agent-7rj6v\" (UID: \"e8d62da5-3820-4d31-9bff-afa87c2a005e\") " pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.325197 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-system-cni-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.325197 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c20a2da-dc20-485c-be40-54f12372dc80-cni-binary-copy\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.325197 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-conf-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-env-overrides\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysconfig\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42cd2274-5832-41a5-a6ba-b63009e462d0-iptables-alerter-script\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-kubelet\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-etc-kubernetes\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebd5f567-c371-4463-894b-4f3a952cc95c-ovn-node-metrics-cert\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-cni-bin\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-hostroot\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-etc-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.325466 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8d62da5-3820-4d31-9bff-afa87c2a005e-konnectivity-ca\") pod \"konnectivity-agent-7rj6v\" (UID: \"e8d62da5-3820-4d31-9bff-afa87c2a005e\") " pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-registration-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-systemd\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-socket-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-device-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-modprobe-d\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysctl-conf\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-var-lib-kubelet\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b1988a4-14cf-4b5e-9568-e50e910cee1d-tmp\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a915b40-77d6-45db-bbf5-533616e8b4a9-host\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8n88\" (UniqueName: \"kubernetes.io/projected/ebd5f567-c371-4463-894b-4f3a952cc95c-kube-api-access-s8n88\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mqsk\" (UniqueName: \"kubernetes.io/projected/42cd2274-5832-41a5-a6ba-b63009e462d0-kube-api-access-5mqsk\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a915b40-77d6-45db-bbf5-533616e8b4a9-host\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.325864 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325861 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42cd2274-5832-41a5-a6ba-b63009e462d0-iptables-alerter-script\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.326064 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.325919 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret podName:94533b2e-1971-41a5-85b9-c87137ae7b59 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:32.825903567 +0000 UTC m=+4.097012062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret") pod "global-pull-secret-syncer-ndlzv" (UID: "94533b2e-1971-41a5-85b9-c87137ae7b59") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a915b40-77d6-45db-bbf5-533616e8b4a9-serviceca\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-cni-multus\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-systemd-units\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.325982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-sys\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-tuned\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfw58\" (UniqueName: \"kubernetes.io/projected/0c896098-424f-4310-8978-d4ffb2db603d-kube-api-access-nfw58\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94533b2e-1971-41a5-85b9-c87137ae7b59-kubelet-config\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-k8s-cni-cncf-io\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cd2274-5832-41a5-a6ba-b63009e462d0-host-slash\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94533b2e-1971-41a5-85b9-c87137ae7b59-kubelet-config\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfn5j\" (UniqueName: \"kubernetes.io/projected/6a915b40-77d6-45db-bbf5-533616e8b4a9-kube-api-access-pfn5j\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326221 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cd2274-5832-41a5-a6ba-b63009e462d0-host-slash\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-run-netns\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326280 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a915b40-77d6-45db-bbf5-533616e8b4a9-serviceca\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-cni-bin\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.326712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-cnibin\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-kubernetes\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfg8v\" (UniqueName: \"kubernetes.io/projected/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-kube-api-access-wfg8v\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-slash\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd5th\" (UniqueName: \"kubernetes.io/projected/8b1988a4-14cf-4b5e-9568-e50e910cee1d-kube-api-access-wd5th\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c896098-424f-4310-8978-d4ffb2db603d-hosts-file\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326700 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-system-cni-dir\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c896098-424f-4310-8978-d4ffb2db603d-tmp-dir\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c20a2da-dc20-485c-be40-54f12372dc80-multus-daemon-config\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vswr\" (UniqueName: \"kubernetes.io/projected/0e9d97a3-f4f8-4963-b189-363102af76b0-kube-api-access-2vswr\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-systemd\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw7vs\" (UniqueName: \"kubernetes.io/projected/7c20a2da-dc20-485c-be40-54f12372dc80-kube-api-access-pw7vs\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.327430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.326983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-node-log\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-ovnkube-script-lib\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-os-release\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-etc-selinux\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfjs\" (UniqueName: \"kubernetes.io/projected/49be934c-82da-4d58-93b0-406194787c45-kube-api-access-lrfjs\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-lib-modules\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-socket-dir-parent\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-multus-certs\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-cni-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-netns\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-var-lib-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-cni-netd\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-run\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.327998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94533b2e-1971-41a5-85b9-c87137ae7b59-dbus\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.328457 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-cnibin\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.328457 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-os-release\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.328457 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.327645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94533b2e-1971-41a5-85b9-c87137ae7b59-dbus\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.335191 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.335167 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 13:06:32.335583 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.335565 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:06:32.335665 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.335585 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:06:32.335665 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.335595 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4b2hd for pod openshift-network-diagnostics/network-check-target-2l2rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:32.335665 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.335650 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd podName:b516107a-a85f-4e09-8f11-f354e274ef27 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:32.835636689 +0000 UTC m=+4.106745169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4b2hd" (UniqueName: "kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd") pod "network-check-target-2l2rq" (UID: "b516107a-a85f-4e09-8f11-f354e274ef27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:32.338690 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.338658 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mqsk\" (UniqueName: \"kubernetes.io/projected/42cd2274-5832-41a5-a6ba-b63009e462d0-kube-api-access-5mqsk\") pod \"iptables-alerter-7nznt\" (UID: \"42cd2274-5832-41a5-a6ba-b63009e462d0\") " pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.338690 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.338656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfn5j\" (UniqueName: \"kubernetes.io/projected/6a915b40-77d6-45db-bbf5-533616e8b4a9-kube-api-access-pfn5j\") pod \"node-ca-44ffz\" (UID: \"6a915b40-77d6-45db-bbf5-533616e8b4a9\") " pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.352646 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.352606 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" event={"ID":"9a577634d414d36381327713dceaa9a2","Type":"ContainerStarted","Data":"9243166cff6d3a1a9bf42dfb42cd9a4e77e499044b061f1348661bcdc972f4ce"} Jul 15 13:06:32.427940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.427907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-cni-multus\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.428115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.427971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-systemd-units\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.427995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-sys\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.428115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428014 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-cni-multus\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.428115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-tuned\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.428115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfw58\" (UniqueName: \"kubernetes.io/projected/0c896098-424f-4310-8978-d4ffb2db603d-kube-api-access-nfw58\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.428115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428086 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-k8s-cni-cncf-io\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428141 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-systemd-units\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-run-netns\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-cni-bin\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428193 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-sys\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-cnibin\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-run-netns\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-kubernetes\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-k8s-cni-cncf-io\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfg8v\" (UniqueName: \"kubernetes.io/projected/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-kube-api-access-wfg8v\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-cni-bin\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-slash\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-cnibin\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd5th\" (UniqueName: \"kubernetes.io/projected/8b1988a4-14cf-4b5e-9568-e50e910cee1d-kube-api-access-wd5th\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c896098-424f-4310-8978-d4ffb2db603d-hosts-file\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.428711 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.429603 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428503 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-slash\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.429603 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428593 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-kubernetes\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.429603 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.428736 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.429603 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429080 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.429603 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429579 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c896098-424f-4310-8978-d4ffb2db603d-hosts-file\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.429840 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-system-cni-dir\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.429840 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-system-cni-dir\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.429840 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c896098-424f-4310-8978-d4ffb2db603d-tmp-dir\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.429986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c20a2da-dc20-485c-be40-54f12372dc80-multus-daemon-config\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.429986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.429986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.429986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vswr\" (UniqueName: \"kubernetes.io/projected/0e9d97a3-f4f8-4963-b189-363102af76b0-kube-api-access-2vswr\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.429986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-systemd\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.430212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.429991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw7vs\" (UniqueName: \"kubernetes.io/projected/7c20a2da-dc20-485c-be40-54f12372dc80-kube-api-access-pw7vs\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.430212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-node-log\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.430212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-ovnkube-script-lib\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.430212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-os-release\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.430212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-etc-selinux\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.430212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfjs\" (UniqueName: \"kubernetes.io/projected/49be934c-82da-4d58-93b0-406194787c45-kube-api-access-lrfjs\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.430212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-lib-modules\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-socket-dir-parent\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-multus-certs\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-cni-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-netns\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-var-lib-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-cni-netd\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-run\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-cnibin\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-os-release\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-kubelet\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.430571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-log-socket\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-sys-fs\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysctl-d\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-host\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-ovn\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-ovnkube-config\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8d62da5-3820-4d31-9bff-afa87c2a005e-agent-certs\") pod \"konnectivity-agent-7rj6v\" (UID: \"e8d62da5-3820-4d31-9bff-afa87c2a005e\") " pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-system-cni-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c20a2da-dc20-485c-be40-54f12372dc80-cni-binary-copy\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-multus-certs\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430860 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-os-release\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.430955 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-cni-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-run-netns\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431064 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-var-lib-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431084 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c896098-424f-4310-8978-d4ffb2db603d-tmp-dir\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.431181 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431124 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-cni-netd\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c20a2da-dc20-485c-be40-54f12372dc80-multus-daemon-config\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431659 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c20a2da-dc20-485c-be40-54f12372dc80-cni-binary-copy\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-conf-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-env-overrides\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysconfig\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-kubelet\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431830 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431859 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-etc-kubernetes\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-run\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.431932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebd5f567-c371-4463-894b-4f3a952cc95c-ovn-node-metrics-cert\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431956 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-cnibin\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-system-cni-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-host-kubelet\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-cni-bin\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-hostroot\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-etc-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-conf-dir\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8d62da5-3820-4d31-9bff-afa87c2a005e-konnectivity-ca\") pod \"konnectivity-agent-7rj6v\" (UID: \"e8d62da5-3820-4d31-9bff-afa87c2a005e\") " pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-registration-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432453 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-systemd\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.432479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysctl-d\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-socket-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-host\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-device-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432634 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-device-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-modprobe-d\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysctl-conf\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-ovn\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.433085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432964 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-tuned\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433095 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-systemd\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433316 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-env-overrides\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.433454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-node-log\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.433454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433395 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysconfig\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-ovnkube-config\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.433719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433454 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-hostroot\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.433719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-modprobe-d\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.433719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e9d97a3-f4f8-4963-b189-363102af76b0-os-release\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.433719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433647 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-sys-fs\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.433719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.432211 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-log-socket\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.433719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-etc-openvswitch\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.433993 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.433729 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-etc-selinux\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.434242 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434215 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e9d97a3-f4f8-4963-b189-363102af76b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.434532 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434454 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8d62da5-3820-4d31-9bff-afa87c2a005e-konnectivity-ca\") pod \"konnectivity-agent-7rj6v\" (UID: \"e8d62da5-3820-4d31-9bff-afa87c2a005e\") " pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.434655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebd5f567-c371-4463-894b-4f3a952cc95c-ovnkube-script-lib\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.434655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434614 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-kubelet\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.434779 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434679 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-registration-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.434779 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebd5f567-c371-4463-894b-4f3a952cc95c-run-systemd\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.434779 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.431913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-etc-kubernetes\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.434945 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.435004 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.434980 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-host-var-lib-cni-bin\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.435163 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-lib-modules\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.435241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c20a2da-dc20-485c-be40-54f12372dc80-multus-socket-dir-parent\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.435358 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.435410 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49be934c-82da-4d58-93b0-406194787c45-socket-dir\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.435424 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:06:32.935404105 +0000 UTC m=+4.206512589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.435479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-var-lib-kubelet\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.435540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b1988a4-14cf-4b5e-9568-e50e910cee1d-tmp\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.435607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n88\" (UniqueName: \"kubernetes.io/projected/ebd5f567-c371-4463-894b-4f3a952cc95c-kube-api-access-s8n88\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.435826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.435769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-var-lib-kubelet\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.436563 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.436540 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b1988a4-14cf-4b5e-9568-e50e910cee1d-etc-sysctl-conf\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.437932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.437896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebd5f567-c371-4463-894b-4f3a952cc95c-ovn-node-metrics-cert\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.439115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.439068 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b1988a4-14cf-4b5e-9568-e50e910cee1d-tmp\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.439207 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.439176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8d62da5-3820-4d31-9bff-afa87c2a005e-agent-certs\") pod \"konnectivity-agent-7rj6v\" (UID: \"e8d62da5-3820-4d31-9bff-afa87c2a005e\") " pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.440697 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.440675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfg8v\" (UniqueName: \"kubernetes.io/projected/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-kube-api-access-wfg8v\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:32.440812 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.440707 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfw58\" (UniqueName: \"kubernetes.io/projected/0c896098-424f-4310-8978-d4ffb2db603d-kube-api-access-nfw58\") pod \"node-resolver-49ctm\" (UID: \"0c896098-424f-4310-8978-d4ffb2db603d\") " pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.440893 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.440866 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd5th\" (UniqueName: \"kubernetes.io/projected/8b1988a4-14cf-4b5e-9568-e50e910cee1d-kube-api-access-wd5th\") pod \"tuned-j5vd9\" (UID: \"8b1988a4-14cf-4b5e-9568-e50e910cee1d\") " pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.445638 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.445586 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vswr\" (UniqueName: \"kubernetes.io/projected/0e9d97a3-f4f8-4963-b189-363102af76b0-kube-api-access-2vswr\") pod \"multus-additional-cni-plugins-8vjml\" (UID: \"0e9d97a3-f4f8-4963-b189-363102af76b0\") " pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.445832 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.445809 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw7vs\" (UniqueName: \"kubernetes.io/projected/7c20a2da-dc20-485c-be40-54f12372dc80-kube-api-access-pw7vs\") pod \"multus-wwc4d\" (UID: \"7c20a2da-dc20-485c-be40-54f12372dc80\") " pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.446319 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.446300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfjs\" (UniqueName: \"kubernetes.io/projected/49be934c-82da-4d58-93b0-406194787c45-kube-api-access-lrfjs\") pod \"aws-ebs-csi-driver-node-j9nlx\" (UID: \"49be934c-82da-4d58-93b0-406194787c45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.446513 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.446492 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8n88\" (UniqueName: \"kubernetes.io/projected/ebd5f567-c371-4463-894b-4f3a952cc95c-kube-api-access-s8n88\") pod \"ovnkube-node-ms7vj\" (UID: \"ebd5f567-c371-4463-894b-4f3a952cc95c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.517548 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.517519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44ffz" Jul 15 13:06:32.530226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.530207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7nznt" Jul 15 13:06:32.538557 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.538535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" Jul 15 13:06:32.544524 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.544502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" Jul 15 13:06:32.551442 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.551418 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwc4d" Jul 15 13:06:32.559279 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.559257 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49ctm" Jul 15 13:06:32.567259 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.567240 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:32.574182 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.574161 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vjml" Jul 15 13:06:32.580083 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.580058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:32.838956 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.838855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:32.838956 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.838930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:32.839175 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.839054 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:32.839175 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.839120 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret podName:94533b2e-1971-41a5-85b9-c87137ae7b59 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:33.839100074 +0000 UTC m=+5.110208559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret") pod "global-pull-secret-syncer-ndlzv" (UID: "94533b2e-1971-41a5-85b9-c87137ae7b59") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:32.839175 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.839056 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:06:32.839175 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.839155 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:06:32.839175 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.839169 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4b2hd for pod openshift-network-diagnostics/network-check-target-2l2rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:32.839424 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.839212 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd podName:b516107a-a85f-4e09-8f11-f354e274ef27 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:33.839201083 +0000 UTC m=+5.110309566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b2hd" (UniqueName: "kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd") pod "network-check-target-2l2rq" (UID: "b516107a-a85f-4e09-8f11-f354e274ef27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:32.939799 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:32.939766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:32.939946 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.939929 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:32.940014 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:32.940001 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:06:33.939981934 +0000 UTC m=+5.211090421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:33.019594 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.019557 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c20a2da_dc20_485c_be40_54f12372dc80.slice/crio-4ab105cdfc821566db8a25601273874a3dbb1f7e1ca7fd2125d6cf771f48a686 WatchSource:0}: Error finding container 4ab105cdfc821566db8a25601273874a3dbb1f7e1ca7fd2125d6cf771f48a686: Status 404 returned error can't find the container with id 4ab105cdfc821566db8a25601273874a3dbb1f7e1ca7fd2125d6cf771f48a686 Jul 15 13:06:33.020491 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.020466 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1988a4_14cf_4b5e_9568_e50e910cee1d.slice/crio-d7548838244d82e1bddf657068f8d9f728aeb1e43db15f5be991e3efc7056c7e WatchSource:0}: Error finding container d7548838244d82e1bddf657068f8d9f728aeb1e43db15f5be991e3efc7056c7e: Status 404 returned error can't find the container with id d7548838244d82e1bddf657068f8d9f728aeb1e43db15f5be991e3efc7056c7e Jul 15 13:06:33.023921 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.023891 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd5f567_c371_4463_894b_4f3a952cc95c.slice/crio-9c9b60b495974de3c430c87b91fcc335c9750c96ad6482878da0329ea5f1fa0d WatchSource:0}: Error finding container 9c9b60b495974de3c430c87b91fcc335c9750c96ad6482878da0329ea5f1fa0d: Status 404 returned error can't find the container with id 9c9b60b495974de3c430c87b91fcc335c9750c96ad6482878da0329ea5f1fa0d Jul 15 13:06:33.024979 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.024925 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49be934c_82da_4d58_93b0_406194787c45.slice/crio-f1061bcc47960f37c848962f1080ad4c071cf1e9364b8f22d8e1cdae6444d896 WatchSource:0}: Error finding container f1061bcc47960f37c848962f1080ad4c071cf1e9364b8f22d8e1cdae6444d896: Status 404 returned error can't find the container with id f1061bcc47960f37c848962f1080ad4c071cf1e9364b8f22d8e1cdae6444d896 Jul 15 13:06:33.025780 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.025742 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d62da5_3820_4d31_9bff_afa87c2a005e.slice/crio-7af9f6dc73e925797f71649e211f95893c2d90eeb96b44f8190b8bacc33dd299 WatchSource:0}: Error finding container 7af9f6dc73e925797f71649e211f95893c2d90eeb96b44f8190b8bacc33dd299: Status 404 returned error can't find the container with id 7af9f6dc73e925797f71649e211f95893c2d90eeb96b44f8190b8bacc33dd299 Jul 15 13:06:33.026619 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.026554 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c896098_424f_4310_8978_d4ffb2db603d.slice/crio-cc8b3abd1981688bfef576e1a2a6cdec69e246fa901e91b47738181c35b216ba WatchSource:0}: Error finding container cc8b3abd1981688bfef576e1a2a6cdec69e246fa901e91b47738181c35b216ba: Status 404 returned error can't find the container with id cc8b3abd1981688bfef576e1a2a6cdec69e246fa901e91b47738181c35b216ba Jul 15 13:06:33.027753 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.027706 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cd2274_5832_41a5_a6ba_b63009e462d0.slice/crio-b1d96505e65e1ddcb7aef5335286e279a3f68970f08ee6fe6896f6829d57b096 WatchSource:0}: Error finding container b1d96505e65e1ddcb7aef5335286e279a3f68970f08ee6fe6896f6829d57b096: Status 404 returned error can't find the container with id b1d96505e65e1ddcb7aef5335286e279a3f68970f08ee6fe6896f6829d57b096 Jul 15 13:06:33.029936 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.029909 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9d97a3_f4f8_4963_b189_363102af76b0.slice/crio-3fb593e0bf6a491ef7f19856f556f36a57d069e3a66f07ba593d9a3143fe39a9 WatchSource:0}: Error finding container 3fb593e0bf6a491ef7f19856f556f36a57d069e3a66f07ba593d9a3143fe39a9: Status 404 returned error can't find the container with id 3fb593e0bf6a491ef7f19856f556f36a57d069e3a66f07ba593d9a3143fe39a9 Jul 15 13:06:33.030655 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:33.030638 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a915b40_77d6_45db_bbf5_533616e8b4a9.slice/crio-3f37e16660a639f089834d8cdf96ce8788469f83132cea62197b157486b6551c WatchSource:0}: Error finding container 3f37e16660a639f089834d8cdf96ce8788469f83132cea62197b157486b6551c: Status 404 returned error can't find the container with id 3f37e16660a639f089834d8cdf96ce8788469f83132cea62197b157486b6551c Jul 15 13:06:33.270545 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.270507 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:01:32 +0000 UTC" deadline="2028-04-28 04:47:41.372168106 +0000 UTC" Jul 15 13:06:33.270545 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.270536 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15663h41m8.1016351s" Jul 15 13:06:33.348174 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.348109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:33.348311 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.348216 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:33.356924 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.356895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" event={"ID":"9a577634d414d36381327713dceaa9a2","Type":"ContainerStarted","Data":"f010565a3564847e4cb163ae85c22057e07f249acf108e8c5614fd957d0f0c88"} Jul 15 13:06:33.358198 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.358173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44ffz" event={"ID":"6a915b40-77d6-45db-bbf5-533616e8b4a9","Type":"ContainerStarted","Data":"3f37e16660a639f089834d8cdf96ce8788469f83132cea62197b157486b6551c"} Jul 15 13:06:33.359369 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.359339 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49ctm" event={"ID":"0c896098-424f-4310-8978-d4ffb2db603d","Type":"ContainerStarted","Data":"cc8b3abd1981688bfef576e1a2a6cdec69e246fa901e91b47738181c35b216ba"} Jul 15 13:06:33.360730 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.360696 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"9c9b60b495974de3c430c87b91fcc335c9750c96ad6482878da0329ea5f1fa0d"} Jul 15 13:06:33.361941 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.361922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwc4d" event={"ID":"7c20a2da-dc20-485c-be40-54f12372dc80","Type":"ContainerStarted","Data":"4ab105cdfc821566db8a25601273874a3dbb1f7e1ca7fd2125d6cf771f48a686"} Jul 15 13:06:33.363182 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.363156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerStarted","Data":"3fb593e0bf6a491ef7f19856f556f36a57d069e3a66f07ba593d9a3143fe39a9"} Jul 15 13:06:33.364488 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.364461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7nznt" event={"ID":"42cd2274-5832-41a5-a6ba-b63009e462d0","Type":"ContainerStarted","Data":"b1d96505e65e1ddcb7aef5335286e279a3f68970f08ee6fe6896f6829d57b096"} Jul 15 13:06:33.365620 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.365592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rj6v" event={"ID":"e8d62da5-3820-4d31-9bff-afa87c2a005e","Type":"ContainerStarted","Data":"7af9f6dc73e925797f71649e211f95893c2d90eeb96b44f8190b8bacc33dd299"} Jul 15 13:06:33.366879 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.366858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" event={"ID":"49be934c-82da-4d58-93b0-406194787c45","Type":"ContainerStarted","Data":"f1061bcc47960f37c848962f1080ad4c071cf1e9364b8f22d8e1cdae6444d896"} Jul 15 13:06:33.367991 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.367971 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" event={"ID":"8b1988a4-14cf-4b5e-9568-e50e910cee1d","Type":"ContainerStarted","Data":"d7548838244d82e1bddf657068f8d9f728aeb1e43db15f5be991e3efc7056c7e"} Jul 15 13:06:33.376655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.376605 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-104.ec2.internal" podStartSLOduration=1.376592154 podStartE2EDuration="1.376592154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:33.376560524 +0000 UTC m=+4.647669030" watchObservedRunningTime="2026-07-15 13:06:33.376592154 +0000 UTC m=+4.647700657" Jul 15 13:06:33.847078 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.847038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:33.847289 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.847125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:33.847289 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.847284 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:06:33.847422 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.847309 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:06:33.847422 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.847323 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4b2hd for pod openshift-network-diagnostics/network-check-target-2l2rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:33.847422 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.847382 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd podName:b516107a-a85f-4e09-8f11-f354e274ef27 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:35.8473639 +0000 UTC m=+7.118472401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b2hd" (UniqueName: "kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd") pod "network-check-target-2l2rq" (UID: "b516107a-a85f-4e09-8f11-f354e274ef27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:33.847665 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.847474 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:33.847665 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.847511 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret podName:94533b2e-1971-41a5-85b9-c87137ae7b59 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:35.8474987 +0000 UTC m=+7.118607195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret") pod "global-pull-secret-syncer-ndlzv" (UID: "94533b2e-1971-41a5-85b9-c87137ae7b59") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:33.948519 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:33.948472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:33.948687 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.948669 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:33.948747 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:33.948739 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:06:35.948718623 +0000 UTC m=+7.219827119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:34.271700 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:34.271655 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:01:32 +0000 UTC" deadline="2028-01-15 14:32:57.042691575 +0000 UTC" Jul 15 13:06:34.271700 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:34.271700 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13177h26m22.770996807s" Jul 15 13:06:34.348658 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:34.348624 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:34.348838 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:34.348788 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:34.349221 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:34.349199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:34.349345 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:34.349320 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:34.695082 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:06:34.695043 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b45715339abdc1786b75be6237943e.slice/crio-73ebf3e553027729b45106fd4f43d4ab0dec2c90fad6086d1382b2c5a45dbea6 WatchSource:0}: Error finding container 73ebf3e553027729b45106fd4f43d4ab0dec2c90fad6086d1382b2c5a45dbea6: Status 404 returned error can't find the container with id 73ebf3e553027729b45106fd4f43d4ab0dec2c90fad6086d1382b2c5a45dbea6 Jul 15 13:06:35.347203 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:35.346977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:35.347203 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.347110 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:35.381283 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:35.381145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" event={"ID":"62b45715339abdc1786b75be6237943e","Type":"ContainerStarted","Data":"73ebf3e553027729b45106fd4f43d4ab0dec2c90fad6086d1382b2c5a45dbea6"} Jul 15 13:06:35.868148 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:35.868104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:35.868325 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:35.868181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:35.868325 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.868320 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:06:35.868485 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.868337 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:06:35.868485 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.868347 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4b2hd for pod openshift-network-diagnostics/network-check-target-2l2rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:35.868485 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.868402 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd podName:b516107a-a85f-4e09-8f11-f354e274ef27 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:39.868385152 +0000 UTC m=+11.139493630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b2hd" (UniqueName: "kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd") pod "network-check-target-2l2rq" (UID: "b516107a-a85f-4e09-8f11-f354e274ef27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:35.868653 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.868579 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:35.868710 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.868652 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret podName:94533b2e-1971-41a5-85b9-c87137ae7b59 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:39.868633675 +0000 UTC m=+11.139742155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret") pod "global-pull-secret-syncer-ndlzv" (UID: "94533b2e-1971-41a5-85b9-c87137ae7b59") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:35.969022 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:35.968975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:35.969223 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.969176 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:35.969300 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:35.969253 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:06:39.969230727 +0000 UTC m=+11.240339209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:36.347964 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:36.347918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:36.348485 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:36.348051 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:36.348485 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:36.348316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:36.348485 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:36.348451 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:37.348227 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:37.347912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:37.348720 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:37.348255 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:38.348413 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:38.348377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:38.348931 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:38.348557 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:38.349060 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:38.349039 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:38.349175 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:38.349152 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:39.347070 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:39.347035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:39.347268 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:39.347185 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:39.908662 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:39.908630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:39.909125 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:39.908699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:39.909125 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:39.908824 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:39.909125 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:39.908880 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret podName:94533b2e-1971-41a5-85b9-c87137ae7b59 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:47.908862757 +0000 UTC m=+19.179971240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret") pod "global-pull-secret-syncer-ndlzv" (UID: "94533b2e-1971-41a5-85b9-c87137ae7b59") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:39.909335 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:39.909319 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:06:39.909396 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:39.909342 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:06:39.909396 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:39.909355 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4b2hd for pod openshift-network-diagnostics/network-check-target-2l2rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:39.909521 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:39.909404 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd podName:b516107a-a85f-4e09-8f11-f354e274ef27 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:47.909388433 +0000 UTC m=+19.180496929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b2hd" (UniqueName: "kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd") pod "network-check-target-2l2rq" (UID: "b516107a-a85f-4e09-8f11-f354e274ef27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:40.009717 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:40.009681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:40.009916 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:40.009829 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:40.009916 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:40.009890 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:06:48.009870581 +0000 UTC m=+19.280979076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:40.347986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:40.347950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:40.348159 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:40.348070 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:40.348524 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:40.348488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:40.348651 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:40.348603 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:41.347719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:41.347691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:41.348186 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:41.347822 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:42.347286 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:42.347250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:42.347482 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:42.347260 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:42.347482 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:42.347388 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:42.347619 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:42.347499 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:43.347264 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:43.347223 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:43.347754 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:43.347351 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:44.347298 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:44.346975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:44.347298 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:44.347127 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:44.347298 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:44.347186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:44.347913 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:44.347311 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:45.347253 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:45.347211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:45.347453 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:45.347346 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:46.346991 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:46.346961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:46.347223 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:46.347098 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:46.347223 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:46.347144 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:46.347331 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:46.347251 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:47.347823 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:47.347790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:47.348362 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:47.347900 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:47.970197 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:47.970163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:47.970410 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:47.970219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:47.970410 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:47.970330 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:47.970410 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:47.970337 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:06:47.970410 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:47.970362 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:06:47.970410 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:47.970374 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4b2hd for pod openshift-network-diagnostics/network-check-target-2l2rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:47.970410 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:47.970393 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret podName:94533b2e-1971-41a5-85b9-c87137ae7b59 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:03.970374793 +0000 UTC m=+35.241483273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret") pod "global-pull-secret-syncer-ndlzv" (UID: "94533b2e-1971-41a5-85b9-c87137ae7b59") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:06:47.970777 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:47.970437 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd podName:b516107a-a85f-4e09-8f11-f354e274ef27 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:03.970406017 +0000 UTC m=+35.241514515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b2hd" (UniqueName: "kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd") pod "network-check-target-2l2rq" (UID: "b516107a-a85f-4e09-8f11-f354e274ef27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:06:48.071049 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:48.071015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:48.071199 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:48.071133 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:48.071239 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:48.071204 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:07:04.071181414 +0000 UTC m=+35.342289892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:06:48.347684 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:48.347649 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:48.347869 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:48.347656 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:48.347869 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:48.347797 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:48.348210 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:48.347894 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:49.347570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:49.347520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:49.347758 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:49.347671 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:50.348874 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:50.348833 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:50.349358 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:50.348956 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:50.349358 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:50.348994 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:50.349358 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:50.349107 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:51.347006 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:51.346974 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:51.347202 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:51.347091 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:52.347185 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:52.347151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:52.347625 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:52.347270 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:52.347625 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:52.347323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:52.347625 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:52.347440 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:53.347199 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.347052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:53.347724 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:53.347265 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:53.412904 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.412647 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44ffz" event={"ID":"6a915b40-77d6-45db-bbf5-533616e8b4a9","Type":"ContainerStarted","Data":"6a50eed0ebdbb0748a5dfe1ec3aa6f923cfe708a474a9ba6634ee75e9d45a0a0"} Jul 15 13:06:53.414208 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.414182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49ctm" event={"ID":"0c896098-424f-4310-8978-d4ffb2db603d","Type":"ContainerStarted","Data":"88c8f7ac8a1c0a61c1288418d728cc54a85e74d9c003a024b524925d371b88fd"} Jul 15 13:06:53.417215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.417189 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"260abe50a69bd3e9a899c037c6900b6965acfd26d211b0dc65fb4cf8c550527e"} Jul 15 13:06:53.417324 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.417259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"997e14a0a1815933f5e6bb176fc752a7c1ac2df0bcda061cd99235634eaef8cb"} Jul 15 13:06:53.417324 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.417311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"601b671a7716d4923615790020777276ace2a55beda254e513d3ea90a6d662cd"} Jul 15 13:06:53.417449 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.417360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"76d4ea7b275ab420d8b1300b9f8deebc8e01f106b7502c1ac75d894c80e13386"} Jul 15 13:06:53.421205 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.420613 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwc4d" event={"ID":"7c20a2da-dc20-485c-be40-54f12372dc80","Type":"ContainerStarted","Data":"0078c16c4208c80992fbfa7dfd03894e7a1e239a7a44f2bc323c41296079ea3e"} Jul 15 13:06:53.422904 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.422881 2579 generic.go:356] "Generic (PLEG): container finished" podID="0e9d97a3-f4f8-4963-b189-363102af76b0" containerID="2042a57af066969d5b9b196cdb0a170690160b9c4565241e89f50c7246f21970" exitCode=0 Jul 15 13:06:53.422998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.422966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerDied","Data":"2042a57af066969d5b9b196cdb0a170690160b9c4565241e89f50c7246f21970"} Jul 15 13:06:53.424478 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.424457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rj6v" event={"ID":"e8d62da5-3820-4d31-9bff-afa87c2a005e","Type":"ContainerStarted","Data":"440e4156418946c12e7d1dff1d1bd9ab7d6541cafdbd3f833810971d6f87b35e"} Jul 15 13:06:53.427604 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.427578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" event={"ID":"49be934c-82da-4d58-93b0-406194787c45","Type":"ContainerStarted","Data":"78bac07c828a331045a836617e0073957146cad6c0ec28dc0ba2071f39f997ab"} Jul 15 13:06:53.429508 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.429487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" event={"ID":"8b1988a4-14cf-4b5e-9568-e50e910cee1d","Type":"ContainerStarted","Data":"0a2d443b245bcb7f09e05b598d2c3cd1829d10ff3060690d2c1be8388656b7fb"} Jul 15 13:06:53.431064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.431038 2579 generic.go:356] "Generic (PLEG): container finished" podID="62b45715339abdc1786b75be6237943e" containerID="1647c8f4fdfb96042f3847adea0b1a6308cb9946944a54df301df55de663363a" exitCode=0 Jul 15 13:06:53.431142 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.431076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" event={"ID":"62b45715339abdc1786b75be6237943e","Type":"ContainerDied","Data":"1647c8f4fdfb96042f3847adea0b1a6308cb9946944a54df301df55de663363a"} Jul 15 13:06:53.433553 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.433507 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-44ffz" podStartSLOduration=12.875050608 podStartE2EDuration="22.433496085s" totalImagesPullingTime="9.558445477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:53.433220652 +0000 UTC m=+24.704329168" watchObservedRunningTime="2026-07-15 13:06:53.433496085 +0000 UTC m=+24.704604585" Jul 15 13:06:53.469012 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.468588 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j5vd9" podStartSLOduration=3.097726555 podStartE2EDuration="22.468569378s" totalImagesPullingTime="19.370842823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:53.453508456 +0000 UTC m=+24.724616958" watchObservedRunningTime="2026-07-15 13:06:53.468569378 +0000 UTC m=+24.739677878" Jul 15 13:06:53.484108 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.484015 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-49ctm" podStartSLOduration=3.12936415 podStartE2EDuration="22.483997428s" totalImagesPullingTime="19.354633278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:53.468271146 +0000 UTC m=+24.739379647" watchObservedRunningTime="2026-07-15 13:06:53.483997428 +0000 UTC m=+24.755105924" Jul 15 13:06:53.501868 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.501827 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wwc4d" podStartSLOduration=3.083219546 podStartE2EDuration="22.501811954s" totalImagesPullingTime="19.418592408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:53.501052901 +0000 UTC m=+24.772161405" watchObservedRunningTime="2026-07-15 13:06:53.501811954 +0000 UTC m=+24.772920454" Jul 15 13:06:53.538715 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.538630 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7rj6v" podStartSLOduration=3.172901914 podStartE2EDuration="22.538610366s" totalImagesPullingTime="19.365708452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:53.538219392 +0000 UTC m=+24.809327893" watchObservedRunningTime="2026-07-15 13:06:53.538610366 +0000 UTC m=+24.809718871" Jul 15 13:06:53.978991 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:53.978970 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 13:06:54.299168 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.299077 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T13:06:53.978988525Z","UUID":"19300815-0578-4e0d-bd8b-8b18779c5f8d","Handler":null,"Name":"","Endpoint":""} Jul 15 13:06:54.301105 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.301084 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 13:06:54.301209 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.301122 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 13:06:54.347691 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.347664 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:54.348095 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.347673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:54.348095 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:54.347783 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:54.348095 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:54.347850 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:54.436771 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.436733 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"4264b84304dd02d4f0689f2a42d7ea2f8379220c0e72ab6f1fcb05ebe843fa29"} Jul 15 13:06:54.436930 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.436809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"542d39330f634f2fb1f7a2c1d15fc4288e70f17cbd526c0d1926cdfc5d153966"} Jul 15 13:06:54.438291 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.438261 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7nznt" event={"ID":"42cd2274-5832-41a5-a6ba-b63009e462d0","Type":"ContainerStarted","Data":"62833be036e567b4fc97939fa873014e137b8cf49f1b2d2a5b2ac7ee75f1f4dd"} Jul 15 13:06:54.440375 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.440337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" event={"ID":"49be934c-82da-4d58-93b0-406194787c45","Type":"ContainerStarted","Data":"c336105ce59cff654950ac8b815e412e74edee444616f33b56e0e6aff768c59c"} Jul 15 13:06:54.442386 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.442358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" event={"ID":"62b45715339abdc1786b75be6237943e","Type":"ContainerStarted","Data":"e4b924076e6f0a8e8417e1bf994134491309f5dd0407d2f5854c2b104bc8030b"} Jul 15 13:06:54.460834 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.459955 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7nznt" podStartSLOduration=4.106216928 podStartE2EDuration="23.459930432s" totalImagesPullingTime="19.353713504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:54.457790797 +0000 UTC m=+25.728899297" watchObservedRunningTime="2026-07-15 13:06:54.459930432 +0000 UTC m=+25.731038933" Jul 15 13:06:54.490062 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.490029 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:54.490698 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.490670 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:54.512058 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:54.512016 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-104.ec2.internal" podStartSLOduration=22.511999765 podStartE2EDuration="22.511999765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:54.472880115 +0000 UTC m=+25.743988614" watchObservedRunningTime="2026-07-15 13:06:54.511999765 +0000 UTC m=+25.783108264" Jul 15 13:06:55.347216 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:55.347186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:55.347350 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:55.347298 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:55.447488 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:55.447447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" event={"ID":"49be934c-82da-4d58-93b0-406194787c45","Type":"ContainerStarted","Data":"bffccca7268a969a53d2b23894f2113e86d1a47ac13fae4d67f95955739de67c"} Jul 15 13:06:55.447957 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:55.447592 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:55.448174 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:55.448157 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7rj6v" Jul 15 13:06:55.465148 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:55.465076 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9nlx" podStartSLOduration=3.078283171 podStartE2EDuration="24.465063941s" totalImagesPullingTime="21.38678077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:55.464849348 +0000 UTC m=+26.735957848" watchObservedRunningTime="2026-07-15 13:06:55.465063941 +0000 UTC m=+26.736172440" Jul 15 13:06:56.347442 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:56.347398 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:56.347606 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:56.347461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:56.347606 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:56.347534 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:56.347734 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:56.347661 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:56.454249 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:56.454206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"64aed6fe51808dc8850110bae70d643ab402e2f88964c1975c3c6ff3605da725"} Jul 15 13:06:57.347051 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:57.346983 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:57.347199 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:57.347093 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:58.347661 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.347488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:58.348402 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.347529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:58.348402 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:58.347745 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:06:58.348402 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:58.347824 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:58.461049 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.461016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" event={"ID":"ebd5f567-c371-4463-894b-4f3a952cc95c","Type":"ContainerStarted","Data":"533b571dc84bee7f5bb838ee32bfc29dcf7b7bed760dac02faeef2b1c03cb43b"} Jul 15 13:06:58.461266 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.461245 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:58.462949 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.462926 2579 generic.go:356] "Generic (PLEG): container finished" podID="0e9d97a3-f4f8-4963-b189-363102af76b0" containerID="ae539a7a4d3b25e0e8bb3965f03928153a4af1871cf42b2c3780670448d79179" exitCode=0 Jul 15 13:06:58.463056 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.462957 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerDied","Data":"ae539a7a4d3b25e0e8bb3965f03928153a4af1871cf42b2c3780670448d79179"} Jul 15 13:06:58.476567 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.476548 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:58.489701 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.489660 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" podStartSLOduration=7.58060474 podStartE2EDuration="27.489648983s" totalImagesPullingTime="19.909044243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:58.488223673 +0000 UTC m=+29.759332172" watchObservedRunningTime="2026-07-15 13:06:58.489648983 +0000 UTC m=+29.760757482" Jul 15 13:06:58.902577 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:58.902535 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:59.347859 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.347835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:59.348230 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:59.347930 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:59.467215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.467185 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:59.483356 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.483181 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:06:59.769897 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.769869 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hrwxj"] Jul 15 13:06:59.770063 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.769985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:06:59.770105 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:59.770076 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:06:59.772206 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.772184 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2l2rq"] Jul 15 13:06:59.772339 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.772279 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:06:59.772408 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:59.772368 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:06:59.781664 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.781644 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ndlzv"] Jul 15 13:06:59.781772 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:06:59.781721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:06:59.781827 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:06:59.781789 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:07:01.347280 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:01.347245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:01.347280 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:01.347278 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:07:01.347793 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:01.347354 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:07:01.347793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:01.347385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:01.347793 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:01.347465 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:07:01.347793 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:01.347540 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:07:01.407888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:01.407853 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:01.501488 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:01.501457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:01.575932 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:01.575901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:02.472604 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:02.472570 2579 generic.go:356] "Generic (PLEG): container finished" podID="0e9d97a3-f4f8-4963-b189-363102af76b0" containerID="f5b199865a5642fb4371c6762e484f871e12fb1620ffbc674cc4d5cb06eb5f28" exitCode=0 Jul 15 13:07:02.473064 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:02.472625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerDied","Data":"f5b199865a5642fb4371c6762e484f871e12fb1620ffbc674cc4d5cb06eb5f28"} Jul 15 13:07:03.347524 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:03.347493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:03.347524 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:03.347522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:07:03.347712 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:03.347492 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:03.347712 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.347604 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:07:03.347712 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.347664 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:07:03.347827 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.347753 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:07:03.989156 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:03.989078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:03.989156 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:03.989135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:03.989555 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.989234 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:07:03.989555 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.989264 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:07:03.989555 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.989277 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:07:03.989555 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.989290 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4b2hd for pod openshift-network-diagnostics/network-check-target-2l2rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:07:03.989555 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.989300 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret podName:94533b2e-1971-41a5-85b9-c87137ae7b59 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:35.989281288 +0000 UTC m=+67.260389774 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret") pod "global-pull-secret-syncer-ndlzv" (UID: "94533b2e-1971-41a5-85b9-c87137ae7b59") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:07:03.989555 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:03.989325 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd podName:b516107a-a85f-4e09-8f11-f354e274ef27 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:35.989315552 +0000 UTC m=+67.260424047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b2hd" (UniqueName: "kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd") pod "network-check-target-2l2rq" (UID: "b516107a-a85f-4e09-8f11-f354e274ef27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:07:04.090156 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:04.090125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:07:04.090317 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:04.090280 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:07:04.090355 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:04.090330 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:07:36.090316522 +0000 UTC m=+67.361425003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:07:04.479184 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:04.479001 2579 generic.go:356] "Generic (PLEG): container finished" podID="0e9d97a3-f4f8-4963-b189-363102af76b0" containerID="718eac417696eac521f0f7ae17089dfae0c73d618cca43bc6071ddec3370bb39" exitCode=0 Jul 15 13:07:04.479184 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:04.479082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerDied","Data":"718eac417696eac521f0f7ae17089dfae0c73d618cca43bc6071ddec3370bb39"} Jul 15 13:07:05.348076 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:05.348041 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:05.348656 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:05.348110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:05.348656 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:05.348216 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:07:05.348656 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:05.348232 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l2rq" podUID="b516107a-a85f-4e09-8f11-f354e274ef27" Jul 15 13:07:05.348656 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:05.348330 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:07:05.348656 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:05.348409 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ndlzv" podUID="94533b2e-1971-41a5-85b9-c87137ae7b59" Jul 15 13:07:05.988664 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:05.988613 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:06.066055 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.065999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:06.523609 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.523536 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-104.ec2.internal" event="NodeReady" Jul 15 13:07:06.524019 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.523677 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 13:07:06.568892 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.568771 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mkbqn"] Jul 15 13:07:06.596506 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.596478 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-np2ct"] Jul 15 13:07:06.596642 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.596610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.598954 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.598930 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 13:07:06.599092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.598936 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 13:07:06.599092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.598994 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jn5bp\"" Jul 15 13:07:06.608958 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.608937 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mkbqn"] Jul 15 13:07:06.609075 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.608972 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-np2ct"] Jul 15 13:07:06.609075 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.609042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:06.611401 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.611255 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 13:07:06.611401 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.611269 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 13:07:06.611570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.611457 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m29z7\"" Jul 15 13:07:06.611570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.611486 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 13:07:06.710531 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.710498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.710688 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.710538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4aee88a8-f4be-4b83-8026-6ed5811b04be-config-volume\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.710688 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.710579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aee88a8-f4be-4b83-8026-6ed5811b04be-tmp-dir\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.710774 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.710713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc4218d-8405-4947-ad4d-e75fca122c4b-cert\") pod \"ingress-canary-np2ct\" (UID: \"acc4218d-8405-4947-ad4d-e75fca122c4b\") " pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:06.710774 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.710765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ctc\" (UniqueName: \"kubernetes.io/projected/acc4218d-8405-4947-ad4d-e75fca122c4b-kube-api-access-g4ctc\") pod \"ingress-canary-np2ct\" (UID: \"acc4218d-8405-4947-ad4d-e75fca122c4b\") " pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:06.710878 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.710792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4hk8\" (UniqueName: \"kubernetes.io/projected/4aee88a8-f4be-4b83-8026-6ed5811b04be-kube-api-access-x4hk8\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.811368 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.811295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.811368 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.811344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4aee88a8-f4be-4b83-8026-6ed5811b04be-config-volume\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.811597 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.811393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aee88a8-f4be-4b83-8026-6ed5811b04be-tmp-dir\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.811597 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:06.811482 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:07:06.811597 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.811529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc4218d-8405-4947-ad4d-e75fca122c4b-cert\") pod \"ingress-canary-np2ct\" (UID: \"acc4218d-8405-4947-ad4d-e75fca122c4b\") " pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:06.811597 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:06.811556 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:07:07.311536689 +0000 UTC m=+38.582645173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:07:06.811597 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.811593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ctc\" (UniqueName: \"kubernetes.io/projected/acc4218d-8405-4947-ad4d-e75fca122c4b-kube-api-access-g4ctc\") pod \"ingress-canary-np2ct\" (UID: \"acc4218d-8405-4947-ad4d-e75fca122c4b\") " pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:06.811867 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.811618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4hk8\" (UniqueName: \"kubernetes.io/projected/4aee88a8-f4be-4b83-8026-6ed5811b04be-kube-api-access-x4hk8\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.811930 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.811907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aee88a8-f4be-4b83-8026-6ed5811b04be-tmp-dir\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.812178 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.812148 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4aee88a8-f4be-4b83-8026-6ed5811b04be-config-volume\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.816436 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.816409 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc4218d-8405-4947-ad4d-e75fca122c4b-cert\") pod \"ingress-canary-np2ct\" (UID: \"acc4218d-8405-4947-ad4d-e75fca122c4b\") " pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:06.820672 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.820637 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4hk8\" (UniqueName: \"kubernetes.io/projected/4aee88a8-f4be-4b83-8026-6ed5811b04be-kube-api-access-x4hk8\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:06.820972 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.820950 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ctc\" (UniqueName: \"kubernetes.io/projected/acc4218d-8405-4947-ad4d-e75fca122c4b-kube-api-access-g4ctc\") pod \"ingress-canary-np2ct\" (UID: \"acc4218d-8405-4947-ad4d-e75fca122c4b\") " pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:06.918557 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:06.918512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-np2ct" Jul 15 13:07:07.113086 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.113050 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-np2ct"] Jul 15 13:07:07.315469 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.315361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:07.315629 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:07.315577 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:07:07.315676 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:07.315653 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:07:08.315635484 +0000 UTC m=+39.586743965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:07:07.347152 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.347127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:07.347152 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.347151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:07.347380 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.347340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:07:07.350171 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.350147 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 13:07:07.350356 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.350340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:07:07.351012 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.350992 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:07:07.351140 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.351054 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 13:07:07.351470 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.351453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfdxg\"" Jul 15 13:07:07.351567 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:07.351454 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv2f2\"" Jul 15 13:07:08.323275 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:08.323242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:08.324022 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:08.323438 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:07:08.324022 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:08.323515 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:07:10.323492447 +0000 UTC m=+41.594600928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:07:08.546075 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:07:08.546042 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc4218d_8405_4947_ad4d_e75fca122c4b.slice/crio-0726f29b9a88e29215d646b702ba683d5f0873ed7dba9808e97bcd9c159db705 WatchSource:0}: Error finding container 0726f29b9a88e29215d646b702ba683d5f0873ed7dba9808e97bcd9c159db705: Status 404 returned error can't find the container with id 0726f29b9a88e29215d646b702ba683d5f0873ed7dba9808e97bcd9c159db705 Jul 15 13:07:09.493148 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:09.493116 2579 generic.go:356] "Generic (PLEG): container finished" podID="0e9d97a3-f4f8-4963-b189-363102af76b0" containerID="f94a1184ee320acd9d492a25a2f615d8dbd8b222d2539af5622b8cda5cd63515" exitCode=0 Jul 15 13:07:09.493609 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:09.493199 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerDied","Data":"f94a1184ee320acd9d492a25a2f615d8dbd8b222d2539af5622b8cda5cd63515"} Jul 15 13:07:09.494383 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:09.494361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-np2ct" event={"ID":"acc4218d-8405-4947-ad4d-e75fca122c4b","Type":"ContainerStarted","Data":"0726f29b9a88e29215d646b702ba683d5f0873ed7dba9808e97bcd9c159db705"} Jul 15 13:07:09.989019 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:09.988983 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:10.089867 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:10.089834 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:10.338145 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:10.338061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:10.338312 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:10.338185 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:07:10.338312 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:10.338244 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:07:14.338228361 +0000 UTC m=+45.609336840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:07:10.500155 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:10.500116 2579 generic.go:356] "Generic (PLEG): container finished" podID="0e9d97a3-f4f8-4963-b189-363102af76b0" containerID="149520790a1e177b6088235fa87dc27243481a610ebb3cc608b95da214e2d4bd" exitCode=0 Jul 15 13:07:10.500588 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:10.500206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerDied","Data":"149520790a1e177b6088235fa87dc27243481a610ebb3cc608b95da214e2d4bd"} Jul 15 13:07:10.668253 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:10.668220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:10.758575 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:10.758546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:11.503564 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:11.503522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-np2ct" event={"ID":"acc4218d-8405-4947-ad4d-e75fca122c4b","Type":"ContainerStarted","Data":"ae39678bf2b50f3b21acbf8ed2b784bda68fb428193d54083225be84b13735c5"} Jul 15 13:07:11.506839 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:11.506814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vjml" event={"ID":"0e9d97a3-f4f8-4963-b189-363102af76b0","Type":"ContainerStarted","Data":"c4aa04910f4e4aa23e2948cdadcd164fc6a48ade5cb7f11e7ff935ea24a04e7c"} Jul 15 13:07:11.523644 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:11.523604 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-np2ct" podStartSLOduration=3.040050601 podStartE2EDuration="5.523591413s" totalImagesPullingTime="2.483540812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:11.522803254 +0000 UTC m=+42.793911756" watchObservedRunningTime="2026-07-15 13:07:11.523591413 +0000 UTC m=+42.794699912" Jul 15 13:07:11.548965 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:11.548917 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8vjml" podStartSLOduration=7.7903565839999995 podStartE2EDuration="40.548896211s" totalImagesPullingTime="32.758539627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:11.54861627 +0000 UTC m=+42.819724770" watchObservedRunningTime="2026-07-15 13:07:11.548896211 +0000 UTC m=+42.820004712" Jul 15 13:07:11.693829 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:11.693782 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:11.819484 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:11.819378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:12.892072 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:12.892040 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:12.994700 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:12.994670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:14.367273 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:14.367239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:14.367634 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:14.367378 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:07:14.367634 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:14.367459 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:07:22.367443829 +0000 UTC m=+53.638552310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:07:22.420480 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:22.420402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:22.421007 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:22.420548 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:07:22.421007 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:22.420606 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:07:38.420591194 +0000 UTC m=+69.691699672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:07:30.110229 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:30.110189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:30.869653 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:30.869613 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:30.937874 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:30.937838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:31.479736 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:31.479707 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ms7vj" Jul 15 13:07:31.608483 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:31.608453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:31.709942 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:31.709913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:36.003543 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.003494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:36.003992 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.003570 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:36.006515 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.006492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:07:36.006643 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.006522 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 13:07:36.016680 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.016663 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 13:07:36.017814 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.017798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94533b2e-1971-41a5-85b9-c87137ae7b59-original-pull-secret\") pod \"global-pull-secret-syncer-ndlzv\" (UID: \"94533b2e-1971-41a5-85b9-c87137ae7b59\") " pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:36.026616 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.026599 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b2hd\" (UniqueName: \"kubernetes.io/projected/b516107a-a85f-4e09-8f11-f354e274ef27-kube-api-access-4b2hd\") pod \"network-check-target-2l2rq\" (UID: \"b516107a-a85f-4e09-8f11-f354e274ef27\") " pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:36.104815 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.104775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:07:36.107467 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.107448 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:07:36.115223 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:36.115203 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 13:07:36.115306 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:36.115269 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:08:40.115248078 +0000 UTC m=+131.386356578 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : secret "metrics-daemon-secret" not found Jul 15 13:07:36.161635 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.161611 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfdxg\"" Jul 15 13:07:36.166336 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.166321 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ndlzv" Jul 15 13:07:36.169366 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.169348 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:36.313350 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.313324 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2l2rq"] Jul 15 13:07:36.316407 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:07:36.316385 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb516107a_a85f_4e09_8f11_f354e274ef27.slice/crio-5884d9bc20361d69c2ceae7b499bb8218273811a277ace500461b2020bd1a255 WatchSource:0}: Error finding container 5884d9bc20361d69c2ceae7b499bb8218273811a277ace500461b2020bd1a255: Status 404 returned error can't find the container with id 5884d9bc20361d69c2ceae7b499bb8218273811a277ace500461b2020bd1a255 Jul 15 13:07:36.327942 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.327919 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ndlzv"] Jul 15 13:07:36.331486 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:07:36.331461 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94533b2e_1971_41a5_85b9_c87137ae7b59.slice/crio-a28de17a750d1cd58c51eb0040521a85b087a221d7d1658c2bbb75fa3dd5b6f9 WatchSource:0}: Error finding container a28de17a750d1cd58c51eb0040521a85b087a221d7d1658c2bbb75fa3dd5b6f9: Status 404 returned error can't find the container with id a28de17a750d1cd58c51eb0040521a85b087a221d7d1658c2bbb75fa3dd5b6f9 Jul 15 13:07:36.562521 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.562412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ndlzv" event={"ID":"94533b2e-1971-41a5-85b9-c87137ae7b59","Type":"ContainerStarted","Data":"a28de17a750d1cd58c51eb0040521a85b087a221d7d1658c2bbb75fa3dd5b6f9"} Jul 15 13:07:36.563400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:36.563368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2l2rq" event={"ID":"b516107a-a85f-4e09-8f11-f354e274ef27","Type":"ContainerStarted","Data":"5884d9bc20361d69c2ceae7b499bb8218273811a277ace500461b2020bd1a255"} Jul 15 13:07:38.518692 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:38.518659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:07:38.519147 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:38.518825 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:07:38.519147 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:07:38.518882 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:08:10.518865546 +0000 UTC m=+101.789974042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:07:39.693002 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:39.692955 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:39.753738 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:39.753695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:07:41.577254 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:41.577214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ndlzv" event={"ID":"94533b2e-1971-41a5-85b9-c87137ae7b59","Type":"ContainerStarted","Data":"dbfc522e4acfd99c292384d924192e84c1e2825af63178793cd9081856f1c021"} Jul 15 13:07:41.578841 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:41.578820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2l2rq" event={"ID":"b516107a-a85f-4e09-8f11-f354e274ef27","Type":"ContainerStarted","Data":"93dd2f99d6369331e8e6bdc8cbab1529f2abe139a6fbe2883121e9442798e1cc"} Jul 15 13:07:41.578960 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:41.578937 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:07:41.604926 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:41.604884 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ndlzv" podStartSLOduration=66.372860987 podStartE2EDuration="1m10.604868723s" totalImagesPullingTime="4.232007736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:41.591746363 +0000 UTC m=+72.862854857" watchObservedRunningTime="2026-07-15 13:07:41.604868723 +0000 UTC m=+72.875977223" Jul 15 13:07:41.605076 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:07:41.605026 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2l2rq" podStartSLOduration=66.362910474 podStartE2EDuration="1m10.605018394s" totalImagesPullingTime="4.24210792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:41.604483854 +0000 UTC m=+72.875592355" watchObservedRunningTime="2026-07-15 13:07:41.605018394 +0000 UTC m=+72.876126895" Jul 15 13:08:10.531596 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:08:10.531564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:08:10.531974 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:08:10.531710 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:08:10.531974 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:08:10.531774 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:09:14.531754249 +0000 UTC m=+165.802862733 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:08:12.583807 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:08:12.583782 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2l2rq" Jul 15 13:08:40.122956 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:08:40.122910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:08:40.123455 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:08:40.123058 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 13:08:40.123455 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:08:40.123135 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs podName:c4a4cd0e-42ef-4e1f-9595-f047ff8512ff nodeName:}" failed. No retries permitted until 2026-07-15 13:10:42.123118363 +0000 UTC m=+253.394226841 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs") pod "network-metrics-daemon-hrwxj" (UID: "c4a4cd0e-42ef-4e1f-9595-f047ff8512ff") : secret "metrics-daemon-secret" not found Jul 15 13:08:53.474230 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:08:53.474195 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:08:55.654437 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:08:55.654401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:09.607202 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:09.607101 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mkbqn" podUID="4aee88a8-f4be-4b83-8026-6ed5811b04be" Jul 15 13:09:09.777698 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:09.777673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mkbqn" Jul 15 13:09:10.371955 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:10.371921 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hrwxj" podUID="c4a4cd0e-42ef-4e1f-9595-f047ff8512ff" Jul 15 13:09:14.543266 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:14.543231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:09:14.543773 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:14.543378 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:09:14.543773 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:14.543506 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls podName:4aee88a8-f4be-4b83-8026-6ed5811b04be nodeName:}" failed. No retries permitted until 2026-07-15 13:11:16.543484087 +0000 UTC m=+287.814592569 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls") pod "dns-default-mkbqn" (UID: "4aee88a8-f4be-4b83-8026-6ed5811b04be") : secret "dns-default-metrics-tls" not found Jul 15 13:09:23.348080 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:23.348047 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:09:39.019100 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.019057 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd"] Jul 15 13:09:39.021690 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.021668 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bb7b4d6f6-nnrsb"] Jul 15 13:09:39.021798 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.021749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" Jul 15 13:09:39.024149 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.024132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.024629 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.024612 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 13:09:39.024722 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.024649 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:09:39.024769 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.024730 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nqtmw\"" Jul 15 13:09:39.026776 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.026760 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 13:09:39.027069 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.027053 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 13:09:39.027069 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.027066 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 13:09:39.027274 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.027261 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 13:09:39.027627 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.027597 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5qfhv\"" Jul 15 13:09:39.027738 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.027712 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 13:09:39.027836 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.027822 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 13:09:39.033601 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.033581 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd"] Jul 15 13:09:39.041787 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.041764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bb7b4d6f6-nnrsb"] Jul 15 13:09:39.097551 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.097523 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl"] Jul 15 13:09:39.098991 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.098970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s2pj\" (UniqueName: \"kubernetes.io/projected/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-kube-api-access-8s2pj\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.099122 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.099002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-default-certificate\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.099122 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.099040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjsz\" (UniqueName: \"kubernetes.io/projected/2db8e1d3-b7b6-4018-a152-b735b844d456-kube-api-access-tpjsz\") pod \"volume-data-source-validator-78495597f6-h5smd\" (UID: \"2db8e1d3-b7b6-4018-a152-b735b844d456\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" Jul 15 13:09:39.099122 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.099063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-stats-auth\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.099122 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.099084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.099122 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.099117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.100259 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.100244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.102981 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.102952 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp"] Jul 15 13:09:39.105537 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.105520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:39.106909 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.106875 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 13:09:39.107010 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.106918 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 13:09:39.107010 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.106919 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 13:09:39.107900 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.107885 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jnf2r\"" Jul 15 13:09:39.108004 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.107988 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 13:09:39.108092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.108074 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:09:39.108092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.108085 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h2zdg\"" Jul 15 13:09:39.108192 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.108178 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 13:09:39.108256 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.108239 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 13:09:39.115320 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.115302 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl"] Jul 15 13:09:39.119285 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.119265 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp"] Jul 15 13:09:39.200289 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s2pj\" (UniqueName: \"kubernetes.io/projected/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-kube-api-access-8s2pj\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.200477 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-default-certificate\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.200477 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjsz\" (UniqueName: \"kubernetes.io/projected/2db8e1d3-b7b6-4018-a152-b735b844d456-kube-api-access-tpjsz\") pod \"volume-data-source-validator-78495597f6-h5smd\" (UID: \"2db8e1d3-b7b6-4018-a152-b735b844d456\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" Jul 15 13:09:39.200477 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-stats-auth\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.200477 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.200477 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.200731 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7rrb\" (UniqueName: \"kubernetes.io/projected/fa5f9520-c485-45dd-b348-3deeb37eb2b8-kube-api-access-d7rrb\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.200731 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:39.200731 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.200731 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9h58\" (UniqueName: \"kubernetes.io/projected/129c307c-3493-4d7f-b3b7-4b4c380ea6da-kube-api-access-v9h58\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:39.200731 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.200617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa5f9520-c485-45dd-b348-3deeb37eb2b8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.200731 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.200636 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:09:39.200731 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.200709 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:39.700687504 +0000 UTC m=+190.971795996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : secret "router-metrics-certs-default" not found Jul 15 13:09:39.201060 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.200911 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:39.700893804 +0000 UTC m=+190.972002305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : configmap references non-existent config key: service-ca.crt Jul 15 13:09:39.201469 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.201446 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8"] Jul 15 13:09:39.202839 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.202815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-default-certificate\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.203048 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.203032 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-stats-auth\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.204677 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.204664 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bc5678bcb-55fpm"] Jul 15 13:09:39.204795 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.204781 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.207247 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.207226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.207457 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.207437 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bss2g\"" Jul 15 13:09:39.207667 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.207470 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:09:39.207745 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.207527 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 13:09:39.207953 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.207939 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 13:09:39.208132 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.208119 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 13:09:39.209199 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.209186 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 13:09:39.209599 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.209583 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 13:09:39.209681 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.209628 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 13:09:39.209753 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.209735 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fzn5r\"" Jul 15 13:09:39.215070 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.215046 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8"] Jul 15 13:09:39.215278 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.215259 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjsz\" (UniqueName: \"kubernetes.io/projected/2db8e1d3-b7b6-4018-a152-b735b844d456-kube-api-access-tpjsz\") pod \"volume-data-source-validator-78495597f6-h5smd\" (UID: \"2db8e1d3-b7b6-4018-a152-b735b844d456\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" Jul 15 13:09:39.215858 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.215837 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 13:09:39.218174 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.218152 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s2pj\" (UniqueName: \"kubernetes.io/projected/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-kube-api-access-8s2pj\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.218509 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.218489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc5678bcb-55fpm"] Jul 15 13:09:39.301544 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa5f9520-c485-45dd-b348-3deeb37eb2b8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.301544 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.301728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-trusted-ca\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.301728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10a0588d-4085-4911-9d47-57eef99f42c6-config\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.301728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:39.301728 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-installation-pull-secrets\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.301871 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.301781 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:09:39.301871 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.301837 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls podName:129c307c-3493-4d7f-b3b7-4b4c380ea6da nodeName:}" failed. No retries permitted until 2026-07-15 13:09:39.801817606 +0000 UTC m=+191.072926085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls") pod "cluster-samples-operator-65db858894-nkcmp" (UID: "129c307c-3493-4d7f-b3b7-4b4c380ea6da") : secret "samples-operator-tls" not found Jul 15 13:09:39.301871 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6zc\" (UniqueName: \"kubernetes.io/projected/10a0588d-4085-4911-9d47-57eef99f42c6-kube-api-access-sh6zc\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.302010 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7rrb\" (UniqueName: \"kubernetes.io/projected/fa5f9520-c485-45dd-b348-3deeb37eb2b8-kube-api-access-d7rrb\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.302010 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-image-registry-private-configuration\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.302010 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4hgs\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-kube-api-access-g4hgs\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.302010 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9h58\" (UniqueName: \"kubernetes.io/projected/129c307c-3493-4d7f-b3b7-4b4c380ea6da-kube-api-access-v9h58\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:39.302010 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.301998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-certificates\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.302224 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.302054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10a0588d-4085-4911-9d47-57eef99f42c6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.302224 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.302082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-bound-sa-token\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.302224 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.302104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/639ba0cd-d5be-4185-a379-2c1bba011a8d-ca-trust-extracted\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.302224 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.302167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.302344 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.302238 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:39.302344 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.302239 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa5f9520-c485-45dd-b348-3deeb37eb2b8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.302344 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.302300 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls podName:fa5f9520-c485-45dd-b348-3deeb37eb2b8 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:39.80228657 +0000 UTC m=+191.073395049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dlvkl" (UID: "fa5f9520-c485-45dd-b348-3deeb37eb2b8") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:39.308750 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.308724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:39.310852 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.310827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7rrb\" (UniqueName: \"kubernetes.io/projected/fa5f9520-c485-45dd-b348-3deeb37eb2b8-kube-api-access-d7rrb\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.310940 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.310875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9h58\" (UniqueName: \"kubernetes.io/projected/129c307c-3493-4d7f-b3b7-4b4c380ea6da-kube-api-access-v9h58\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:39.331650 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.331633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" Jul 15 13:09:39.403585 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-certificates\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.403710 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10a0588d-4085-4911-9d47-57eef99f42c6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.403710 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-bound-sa-token\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.403710 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/639ba0cd-d5be-4185-a379-2c1bba011a8d-ca-trust-extracted\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.403809 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.403809 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-trusted-ca\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.403809 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10a0588d-4085-4911-9d47-57eef99f42c6-config\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.403809 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-installation-pull-secrets\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.403925 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6zc\" (UniqueName: \"kubernetes.io/projected/10a0588d-4085-4911-9d47-57eef99f42c6-kube-api-access-sh6zc\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.403925 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-image-registry-private-configuration\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.403925 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.403874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4hgs\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-kube-api-access-g4hgs\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.404105 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.404072 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:09:39.404105 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.404100 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc5678bcb-55fpm: secret "image-registry-tls" not found Jul 15 13:09:39.404240 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.404162 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls podName:639ba0cd-d5be-4185-a379-2c1bba011a8d nodeName:}" failed. No retries permitted until 2026-07-15 13:09:39.904141644 +0000 UTC m=+191.175250140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls") pod "image-registry-6bc5678bcb-55fpm" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d") : secret "image-registry-tls" not found Jul 15 13:09:39.404240 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.404230 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-certificates\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.404570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.404545 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10a0588d-4085-4911-9d47-57eef99f42c6-config\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.404682 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.404585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/639ba0cd-d5be-4185-a379-2c1bba011a8d-ca-trust-extracted\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.405066 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.405043 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-trusted-ca\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.406195 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.406162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10a0588d-4085-4911-9d47-57eef99f42c6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.406989 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.406968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-installation-pull-secrets\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.407383 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.407337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-image-registry-private-configuration\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.412609 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.412580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:39.414901 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.414874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6zc\" (UniqueName: \"kubernetes.io/projected/10a0588d-4085-4911-9d47-57eef99f42c6-kube-api-access-sh6zc\") pod \"service-ca-operator-7695fc6c8c-48sw8\" (UID: \"10a0588d-4085-4911-9d47-57eef99f42c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.415635 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.415619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-bound-sa-token\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.415838 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.415820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4hgs\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-kube-api-access-g4hgs\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.452363 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.452338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd"] Jul 15 13:09:39.454741 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:09:39.454716 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db8e1d3_b7b6_4018_a152_b735b844d456.slice/crio-d4a6fca06430bd29b9a37622a9bf74d5a5b206bfc2de40603e7500f86e7f7341 WatchSource:0}: Error finding container d4a6fca06430bd29b9a37622a9bf74d5a5b206bfc2de40603e7500f86e7f7341: Status 404 returned error can't find the container with id d4a6fca06430bd29b9a37622a9bf74d5a5b206bfc2de40603e7500f86e7f7341 Jul 15 13:09:39.529521 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.529497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" Jul 15 13:09:39.647169 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.646741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8"] Jul 15 13:09:39.650717 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:09:39.650695 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a0588d_4085_4911_9d47_57eef99f42c6.slice/crio-af368ed57450ca7238d4bafe886e2f24e7ffa54f8bd58a4cc2e936e62f5f4a45 WatchSource:0}: Error finding container af368ed57450ca7238d4bafe886e2f24e7ffa54f8bd58a4cc2e936e62f5f4a45: Status 404 returned error can't find the container with id af368ed57450ca7238d4bafe886e2f24e7ffa54f8bd58a4cc2e936e62f5f4a45 Jul 15 13:09:39.706417 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.706387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.706417 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.706457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:39.706620 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.706550 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:09:39.706620 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.706588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:40.706569857 +0000 UTC m=+191.977678358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : configmap references non-existent config key: service-ca.crt Jul 15 13:09:39.706620 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.706610 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:40.706600462 +0000 UTC m=+191.977708946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : secret "router-metrics-certs-default" not found Jul 15 13:09:39.807513 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.807479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:39.807671 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.807539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:39.807671 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.807651 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:39.807781 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.807721 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls podName:fa5f9520-c485-45dd-b348-3deeb37eb2b8 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:40.807699799 +0000 UTC m=+192.078808296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dlvkl" (UID: "fa5f9520-c485-45dd-b348-3deeb37eb2b8") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:39.807781 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.807754 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:09:39.807889 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.807793 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls podName:129c307c-3493-4d7f-b3b7-4b4c380ea6da nodeName:}" failed. No retries permitted until 2026-07-15 13:09:40.807782459 +0000 UTC m=+192.078890937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls") pod "cluster-samples-operator-65db858894-nkcmp" (UID: "129c307c-3493-4d7f-b3b7-4b4c380ea6da") : secret "samples-operator-tls" not found Jul 15 13:09:39.848374 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.848300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" event={"ID":"10a0588d-4085-4911-9d47-57eef99f42c6","Type":"ContainerStarted","Data":"af368ed57450ca7238d4bafe886e2f24e7ffa54f8bd58a4cc2e936e62f5f4a45"} Jul 15 13:09:39.849373 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.849352 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" event={"ID":"2db8e1d3-b7b6-4018-a152-b735b844d456","Type":"ContainerStarted","Data":"d4a6fca06430bd29b9a37622a9bf74d5a5b206bfc2de40603e7500f86e7f7341"} Jul 15 13:09:39.908259 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:39.908224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:39.908506 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.908400 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:09:39.908506 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.908435 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc5678bcb-55fpm: secret "image-registry-tls" not found Jul 15 13:09:39.908506 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:39.908501 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls podName:639ba0cd-d5be-4185-a379-2c1bba011a8d nodeName:}" failed. No retries permitted until 2026-07-15 13:09:40.908480944 +0000 UTC m=+192.179589437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls") pod "image-registry-6bc5678bcb-55fpm" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d") : secret "image-registry-tls" not found Jul 15 13:09:40.714314 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.714276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:40.714759 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.714337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:40.714759 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.714441 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:09:40.714759 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.714517 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:42.714495854 +0000 UTC m=+193.985604333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : secret "router-metrics-certs-default" not found Jul 15 13:09:40.714759 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.714535 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:42.714528615 +0000 UTC m=+193.985637120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : configmap references non-existent config key: service-ca.crt Jul 15 13:09:40.814869 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.814841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:40.815025 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.814906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:40.815025 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.814987 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:40.815025 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.815000 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:09:40.815154 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.815050 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls podName:fa5f9520-c485-45dd-b348-3deeb37eb2b8 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:42.815035778 +0000 UTC m=+194.086144255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dlvkl" (UID: "fa5f9520-c485-45dd-b348-3deeb37eb2b8") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:40.815154 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.815065 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls podName:129c307c-3493-4d7f-b3b7-4b4c380ea6da nodeName:}" failed. No retries permitted until 2026-07-15 13:09:42.815059125 +0000 UTC m=+194.086167602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls") pod "cluster-samples-operator-65db858894-nkcmp" (UID: "129c307c-3493-4d7f-b3b7-4b4c380ea6da") : secret "samples-operator-tls" not found Jul 15 13:09:40.852882 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.852818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" event={"ID":"2db8e1d3-b7b6-4018-a152-b735b844d456","Type":"ContainerStarted","Data":"dc3b565c91096eb4446baad30339b76013a8e47d5517b7fd42ab3f845798e328"} Jul 15 13:09:40.867825 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.867773 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h5smd" podStartSLOduration=1.7498745900000001 podStartE2EDuration="2.867759545s" totalImagesPullingTime="1.117884955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:09:40.86711582 +0000 UTC m=+192.138224323" watchObservedRunningTime="2026-07-15 13:09:40.867759545 +0000 UTC m=+192.138868044" Jul 15 13:09:40.915816 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.915784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:40.915968 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.915952 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:09:40.916021 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.915973 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc5678bcb-55fpm: secret "image-registry-tls" not found Jul 15 13:09:40.916072 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:40.916031 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls podName:639ba0cd-d5be-4185-a379-2c1bba011a8d nodeName:}" failed. No retries permitted until 2026-07-15 13:09:42.91601233 +0000 UTC m=+194.187120810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls") pod "image-registry-6bc5678bcb-55fpm" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d") : secret "image-registry-tls" not found Jul 15 13:09:40.962910 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:40.962889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:41.038053 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:41.038022 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:42.731035 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:42.731000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:42.731390 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:42.731045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:42.731390 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.731150 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:09:42.731390 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.731198 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:46.731183724 +0000 UTC m=+198.002292203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : secret "router-metrics-certs-default" not found Jul 15 13:09:42.731390 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.731230 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:46.731216234 +0000 UTC m=+198.002324711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : configmap references non-existent config key: service-ca.crt Jul 15 13:09:42.831843 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:42.831815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:42.831963 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:42.831894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:42.832002 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.831967 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:09:42.832034 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.832017 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls podName:129c307c-3493-4d7f-b3b7-4b4c380ea6da nodeName:}" failed. No retries permitted until 2026-07-15 13:09:46.832003848 +0000 UTC m=+198.103112329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls") pod "cluster-samples-operator-65db858894-nkcmp" (UID: "129c307c-3493-4d7f-b3b7-4b4c380ea6da") : secret "samples-operator-tls" not found Jul 15 13:09:42.832079 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.831967 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:42.832110 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.832099 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls podName:fa5f9520-c485-45dd-b348-3deeb37eb2b8 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:46.832086448 +0000 UTC m=+198.103194928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dlvkl" (UID: "fa5f9520-c485-45dd-b348-3deeb37eb2b8") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:42.859752 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:42.859725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" event={"ID":"10a0588d-4085-4911-9d47-57eef99f42c6","Type":"ContainerStarted","Data":"9217558d5433f0230fb580eab3340c6c17d758f606c266dbec595a1b95898ac9"} Jul 15 13:09:42.877265 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:42.877226 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" podStartSLOduration=1.444757783 podStartE2EDuration="3.877210852s" totalImagesPullingTime="2.432453069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:09:42.876552124 +0000 UTC m=+194.147660626" watchObservedRunningTime="2026-07-15 13:09:42.877210852 +0000 UTC m=+194.148319351" Jul 15 13:09:42.932826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:42.932799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:42.932975 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.932956 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:09:42.933016 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.932979 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc5678bcb-55fpm: secret "image-registry-tls" not found Jul 15 13:09:42.933049 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:42.933038 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls podName:639ba0cd-d5be-4185-a379-2c1bba011a8d nodeName:}" failed. No retries permitted until 2026-07-15 13:09:46.933021363 +0000 UTC m=+198.204129856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls") pod "image-registry-6bc5678bcb-55fpm" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d") : secret "image-registry-tls" not found Jul 15 13:09:43.296080 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:43.296047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:43.391482 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:43.391448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:43.891914 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:43.891885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:44.012376 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.012339 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:44.062866 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.062835 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8jc26"] Jul 15 13:09:44.067100 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.067075 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.069542 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.069519 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 13:09:44.069738 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.069718 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 13:09:44.070469 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.070441 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 13:09:44.070570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.070511 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cpxgg\"" Jul 15 13:09:44.070570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.070513 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 13:09:44.076934 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.076914 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8jc26"] Jul 15 13:09:44.106196 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.106173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:44.143846 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.143797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-crio-socket\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.143846 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.143824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wqh\" (UniqueName: \"kubernetes.io/projected/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-api-access-g2wqh\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.143953 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.143892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.143995 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.143962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-data-volume\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.143995 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.143980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.245004 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.244967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-data-volume\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.245004 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.245006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.245123 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.245042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-crio-socket\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.245123 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.245069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wqh\" (UniqueName: \"kubernetes.io/projected/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-api-access-g2wqh\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.245123 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.245097 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:09:44.245257 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.245135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.245257 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.245157 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:44.745142125 +0000 UTC m=+196.016250602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : configmap "kube-rbac-proxy" not found Jul 15 13:09:44.245257 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.245173 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-crio-socket\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.245257 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.245235 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:09:44.245409 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.245294 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:44.74527737 +0000 UTC m=+196.016385865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : secret "insights-runtime-extractor-tls" not found Jul 15 13:09:44.245409 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.245323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-data-volume\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.255549 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.255530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wqh\" (UniqueName: \"kubernetes.io/projected/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-api-access-g2wqh\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.748580 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.748541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.748774 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:44.748638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:44.748774 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.748700 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:09:44.748774 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.748753 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:09:44.748774 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.748766 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:45.748751419 +0000 UTC m=+197.019859897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : secret "insights-runtime-extractor-tls" not found Jul 15 13:09:44.748977 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:44.748803 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:45.748791094 +0000 UTC m=+197.019899585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : configmap "kube-rbac-proxy" not found Jul 15 13:09:45.612106 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:45.612067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:45.712119 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:45.712087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:45.757203 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:45.757180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:45.757304 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:45.757247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:45.757363 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:45.757315 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:09:45.757363 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:45.757352 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:09:45.757484 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:45.757399 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:47.757377079 +0000 UTC m=+199.028485574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : configmap "kube-rbac-proxy" not found Jul 15 13:09:45.757484 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:45.757419 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:47.757408657 +0000 UTC m=+199.028517142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : secret "insights-runtime-extractor-tls" not found Jul 15 13:09:46.481913 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:46.481880 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:46.625393 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:46.625332 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49ctm_0c896098-424f-4310-8978-d4ffb2db603d/dns-node-resolver/0.log" Jul 15 13:09:46.766120 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:46.766051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:46.766120 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:46.766095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:46.766317 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.766199 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:54.766184761 +0000 UTC m=+206.037293251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : configmap references non-existent config key: service-ca.crt Jul 15 13:09:46.766317 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.766214 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:09:46.766317 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.766271 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:54.766254561 +0000 UTC m=+206.037363052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : secret "router-metrics-certs-default" not found Jul 15 13:09:46.866765 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:46.866739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:46.866892 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:46.866801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:46.866955 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.866888 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:09:46.866955 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.866936 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls podName:129c307c-3493-4d7f-b3b7-4b4c380ea6da nodeName:}" failed. No retries permitted until 2026-07-15 13:09:54.866923336 +0000 UTC m=+206.138031817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls") pod "cluster-samples-operator-65db858894-nkcmp" (UID: "129c307c-3493-4d7f-b3b7-4b4c380ea6da") : secret "samples-operator-tls" not found Jul 15 13:09:46.867045 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.866888 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:46.867045 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.867000 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls podName:fa5f9520-c485-45dd-b348-3deeb37eb2b8 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:54.866988186 +0000 UTC m=+206.138096670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dlvkl" (UID: "fa5f9520-c485-45dd-b348-3deeb37eb2b8") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:46.967837 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:46.967809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:46.967961 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.967938 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:09:46.967961 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.967954 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc5678bcb-55fpm: secret "image-registry-tls" not found Jul 15 13:09:46.968041 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:46.967997 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls podName:639ba0cd-d5be-4185-a379-2c1bba011a8d nodeName:}" failed. No retries permitted until 2026-07-15 13:09:54.967982539 +0000 UTC m=+206.239091017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls") pod "image-registry-6bc5678bcb-55fpm" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d") : secret "image-registry-tls" not found Jul 15 13:09:47.625099 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:47.625072 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44ffz_6a915b40-77d6-45db-bbf5-533616e8b4a9/node-ca/0.log" Jul 15 13:09:47.775475 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:47.775410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:47.775837 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:47.775566 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:09:47.775837 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:47.775599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:47.775837 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:47.775617 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:51.775602732 +0000 UTC m=+203.046711238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : secret "insights-runtime-extractor-tls" not found Jul 15 13:09:47.775837 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:47.775649 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:09:47.775837 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:47.775699 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:51.775688115 +0000 UTC m=+203.046796605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : configmap "kube-rbac-proxy" not found Jul 15 13:09:48.625898 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:48.625851 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-np2ct_acc4218d-8405-4947-ad4d-e75fca122c4b/serve-healthcheck-canary/0.log" Jul 15 13:09:49.522417 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:49.522375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:49.688553 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:49.688526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:49.833436 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:49.833335 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:49.936245 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:49.936213 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:50.055760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:50.055729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:50.216098 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:50.216068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:50.891674 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:50.891634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:51.005294 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:51.005267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:51.411117 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:51.411081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:51.603439 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:51.603397 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:51.805214 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:51.805182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:51.805374 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:51.805293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:51.805374 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:51.805346 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:09:51.805496 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:51.805410 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:09:51.805496 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:51.805453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:59.805406312 +0000 UTC m=+211.076514790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : secret "insights-runtime-extractor-tls" not found Jul 15 13:09:51.805496 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:51.805476 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm podName:23f70fb0-38a1-42a2-b090-9e2dfe0518c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:59.805461714 +0000 UTC m=+211.076570197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jc26" (UID: "23f70fb0-38a1-42a2-b090-9e2dfe0518c7") : configmap "kube-rbac-proxy" not found Jul 15 13:09:52.001476 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:52.001446 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:52.896979 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:52.896948 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:53.225162 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:53.225129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:53.333430 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:53.333402 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:53.426007 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:53.425980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:53.597938 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:53.597865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:54.148692 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:54.148658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:54.829995 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:54.829952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:54.829995 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:54.830005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:54.830404 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:54.830105 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle podName:0581b85f-3730-4cd7-8ce8-fb17ebaf3b51 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:10.830089592 +0000 UTC m=+222.101198091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle") pod "router-default-bb7b4d6f6-nnrsb" (UID: "0581b85f-3730-4cd7-8ce8-fb17ebaf3b51") : configmap references non-existent config key: service-ca.crt Jul 15 13:09:54.832274 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:54.832256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-metrics-certs\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:09:54.930311 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:54.930274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:09:54.930471 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:54.930415 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:54.930471 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:54.930437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:54.930539 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:09:54.930479 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls podName:fa5f9520-c485-45dd-b348-3deeb37eb2b8 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:10.930464847 +0000 UTC m=+222.201573328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dlvkl" (UID: "fa5f9520-c485-45dd-b348-3deeb37eb2b8") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:09:54.932812 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:54.932790 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/129c307c-3493-4d7f-b3b7-4b4c380ea6da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nkcmp\" (UID: \"129c307c-3493-4d7f-b3b7-4b4c380ea6da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:55.015486 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.015462 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" Jul 15 13:09:55.031479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.031446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:55.033659 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.033643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"image-registry-6bc5678bcb-55fpm\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:55.133820 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.133790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:55.133969 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.133901 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp"] Jul 15 13:09:55.258283 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.258257 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc5678bcb-55fpm"] Jul 15 13:09:55.261069 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:09:55.261038 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639ba0cd_d5be_4185_a379_2c1bba011a8d.slice/crio-038a46b0d169262f7c4f1160b4dca1217f13a28365ce83cf7a45b5b71a9c1e24 WatchSource:0}: Error finding container 038a46b0d169262f7c4f1160b4dca1217f13a28365ce83cf7a45b5b71a9c1e24: Status 404 returned error can't find the container with id 038a46b0d169262f7c4f1160b4dca1217f13a28365ce83cf7a45b5b71a9c1e24 Jul 15 13:09:55.897066 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.897029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" event={"ID":"639ba0cd-d5be-4185-a379-2c1bba011a8d","Type":"ContainerStarted","Data":"f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13"} Jul 15 13:09:55.897514 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.897090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" event={"ID":"639ba0cd-d5be-4185-a379-2c1bba011a8d","Type":"ContainerStarted","Data":"038a46b0d169262f7c4f1160b4dca1217f13a28365ce83cf7a45b5b71a9c1e24"} Jul 15 13:09:55.897514 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.897116 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:09:55.898633 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.898606 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" event={"ID":"129c307c-3493-4d7f-b3b7-4b4c380ea6da","Type":"ContainerStarted","Data":"13acfc69e1fe095d860f07095b18b9fd31456c7ccb3ede12889f1c0a995744ee"} Jul 15 13:09:55.915873 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:55.915761 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" podStartSLOduration=16.915742949 podStartE2EDuration="16.915742949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:09:55.915379505 +0000 UTC m=+207.186488009" watchObservedRunningTime="2026-07-15 13:09:55.915742949 +0000 UTC m=+207.186851450" Jul 15 13:09:56.904276 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:56.904245 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" event={"ID":"129c307c-3493-4d7f-b3b7-4b4c380ea6da","Type":"ContainerStarted","Data":"f88a6d64f270c23c14f3e633d63d87c916e4f025c5eb5d0ba47412e9ad26c333"} Jul 15 13:09:56.904656 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:56.904298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" event={"ID":"129c307c-3493-4d7f-b3b7-4b4c380ea6da","Type":"ContainerStarted","Data":"e5cd32088138e821b8eed6dc0267af782c3e48568346901c704165105d24e6bf"} Jul 15 13:09:56.921614 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:56.921568 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nkcmp" podStartSLOduration=16.393373789 podStartE2EDuration="17.921553725s" totalImagesPullingTime="1.528179936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:09:56.920652877 +0000 UTC m=+208.191761378" watchObservedRunningTime="2026-07-15 13:09:56.921553725 +0000 UTC m=+208.192662225" Jul 15 13:09:57.011521 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:57.011443 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:57.111580 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:57.111555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:57.212979 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:57.212953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:57.403453 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:57.403355 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:57.803958 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:57.803932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:58.006174 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:58.006142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:58.120036 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:58.119954 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:58.224067 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:58.224037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:59.007721 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:59.007687 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:09:59.867666 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:59.867632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:59.867843 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:59.867711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:59.868246 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:59.868230 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:59.869939 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:59.869918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23f70fb0-38a1-42a2-b090-9e2dfe0518c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jc26\" (UID: \"23f70fb0-38a1-42a2-b090-9e2dfe0518c7\") " pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:09:59.976813 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:09:59.976783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8jc26" Jul 15 13:10:00.101778 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:00.101741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8jc26"] Jul 15 13:10:00.105419 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:00.105396 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f70fb0_38a1_42a2_b090_9e2dfe0518c7.slice/crio-f6e1db69d99dcf23b5ec2dcf04569395b018a6f6a12db2b43ab9b9b1070533f6 WatchSource:0}: Error finding container f6e1db69d99dcf23b5ec2dcf04569395b018a6f6a12db2b43ab9b9b1070533f6: Status 404 returned error can't find the container with id f6e1db69d99dcf23b5ec2dcf04569395b018a6f6a12db2b43ab9b9b1070533f6 Jul 15 13:10:00.918841 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:00.918803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jc26" event={"ID":"23f70fb0-38a1-42a2-b090-9e2dfe0518c7","Type":"ContainerStarted","Data":"f6e1db69d99dcf23b5ec2dcf04569395b018a6f6a12db2b43ab9b9b1070533f6"} Jul 15 13:10:01.963414 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:01.963379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:02.068292 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:02.068252 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:04.786195 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:04.786143 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:05.936255 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:05.936218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jc26" event={"ID":"23f70fb0-38a1-42a2-b090-9e2dfe0518c7","Type":"ContainerStarted","Data":"1fd798a6a19881fc66be2f408322e97524696c9d7a87f4357aba40bdc16bbc31"} Jul 15 13:10:08.830796 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:08.830757 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:08.932360 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:08.932326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:08.947043 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:08.947016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jc26" event={"ID":"23f70fb0-38a1-42a2-b090-9e2dfe0518c7","Type":"ContainerStarted","Data":"32107564efb0f24e5f89d524c8494492c0494af50cfbff4f4bd29d207bc41306"} Jul 15 13:10:09.944094 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:09.944056 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bc5678bcb-55fpm"] Jul 15 13:10:10.029445 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.029396 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b68bb6f5-z7tjc"] Jul 15 13:10:10.033483 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.033461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.042095 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.042068 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b68bb6f5-z7tjc"] Jul 15 13:10:10.050017 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.049995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-registry-tls\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.050118 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.050030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-registry-certificates\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.050118 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.050083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-installation-pull-secrets\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.050217 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.050122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-trusted-ca\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.050217 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.050136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-bound-sa-token\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.050217 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.050195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-image-registry-private-configuration\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.050320 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.050241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-ca-trust-extracted\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.050320 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.050265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plmmg\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-kube-api-access-plmmg\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151156 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-registry-certificates\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151311 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-installation-pull-secrets\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151311 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-trusted-ca\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151311 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-bound-sa-token\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151311 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-image-registry-private-configuration\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151311 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-ca-trust-extracted\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151593 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plmmg\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-kube-api-access-plmmg\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151593 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-registry-tls\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.151817 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.151790 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-ca-trust-extracted\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.152132 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.152095 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-registry-certificates\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.152362 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.152340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-trusted-ca\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.153768 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.153738 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-installation-pull-secrets\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.153849 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.153817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-image-registry-private-configuration\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.153928 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.153911 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-registry-tls\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.158886 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.158863 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plmmg\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-kube-api-access-plmmg\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.159032 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.159011 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6-bound-sa-token\") pod \"image-registry-86b68bb6f5-z7tjc\" (UID: \"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6\") " pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.342089 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.342021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.466408 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.466377 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b68bb6f5-z7tjc"] Jul 15 13:10:10.470697 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:10.470671 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34e780e_ef1a_4cd4_ab05_52a3c8c82ad6.slice/crio-7690e60c36c0d6bac5d3981e64839b2f9c24c1cb633e2442a78802b4f8c6dff8 WatchSource:0}: Error finding container 7690e60c36c0d6bac5d3981e64839b2f9c24c1cb633e2442a78802b4f8c6dff8: Status 404 returned error can't find the container with id 7690e60c36c0d6bac5d3981e64839b2f9c24c1cb633e2442a78802b4f8c6dff8 Jul 15 13:10:10.856575 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.856540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:10:10.857128 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.857109 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0581b85f-3730-4cd7-8ce8-fb17ebaf3b51-service-ca-bundle\") pod \"router-default-bb7b4d6f6-nnrsb\" (UID: \"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51\") " pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:10:10.953780 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.953749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" event={"ID":"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6","Type":"ContainerStarted","Data":"3dd58e2ade2fb96691249aaeac901cb0dcc534df07e3303a38902c257fa013f9"} Jul 15 13:10:10.954108 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.953795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" event={"ID":"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6","Type":"ContainerStarted","Data":"7690e60c36c0d6bac5d3981e64839b2f9c24c1cb633e2442a78802b4f8c6dff8"} Jul 15 13:10:10.954108 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.953862 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:10.956846 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.956829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:10:10.959102 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.959081 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5f9520-c485-45dd-b348-3deeb37eb2b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dlvkl\" (UID: \"fa5f9520-c485-45dd-b348-3deeb37eb2b8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:10:10.973384 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:10.973345 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podStartSLOduration=0.973334095 podStartE2EDuration="973.334095ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:10.972811968 +0000 UTC m=+222.243920467" watchObservedRunningTime="2026-07-15 13:10:10.973334095 +0000 UTC m=+222.244442594" Jul 15 13:10:11.137657 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.137591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:10:11.209518 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.209411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" Jul 15 13:10:11.268644 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.268612 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bb7b4d6f6-nnrsb"] Jul 15 13:10:11.272599 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:11.272558 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0581b85f_3730_4cd7_8ce8_fb17ebaf3b51.slice/crio-80c5c833be37677be73ced4523ad4ac788bb63984aaf742c9335592066d7a160 WatchSource:0}: Error finding container 80c5c833be37677be73ced4523ad4ac788bb63984aaf742c9335592066d7a160: Status 404 returned error can't find the container with id 80c5c833be37677be73ced4523ad4ac788bb63984aaf742c9335592066d7a160 Jul 15 13:10:11.341347 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.341306 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl"] Jul 15 13:10:11.343969 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:11.343944 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5f9520_c485_45dd_b348_3deeb37eb2b8.slice/crio-0beaeb439496a471b63c164f8bec9c40e29b1aa3b7ff58eb6a852ed4bb2f6c85 WatchSource:0}: Error finding container 0beaeb439496a471b63c164f8bec9c40e29b1aa3b7ff58eb6a852ed4bb2f6c85: Status 404 returned error can't find the container with id 0beaeb439496a471b63c164f8bec9c40e29b1aa3b7ff58eb6a852ed4bb2f6c85 Jul 15 13:10:11.959920 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.959881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" event={"ID":"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51","Type":"ContainerStarted","Data":"c286e4c252a4d38f0e1a3e643d179d1624bea40693339b8c71acfb18c02b4868"} Jul 15 13:10:11.960496 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.959949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" event={"ID":"0581b85f-3730-4cd7-8ce8-fb17ebaf3b51","Type":"ContainerStarted","Data":"80c5c833be37677be73ced4523ad4ac788bb63984aaf742c9335592066d7a160"} Jul 15 13:10:11.961688 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.961598 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" event={"ID":"fa5f9520-c485-45dd-b348-3deeb37eb2b8","Type":"ContainerStarted","Data":"0beaeb439496a471b63c164f8bec9c40e29b1aa3b7ff58eb6a852ed4bb2f6c85"} Jul 15 13:10:11.981129 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:11.981052 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" podStartSLOduration=33.98103851 podStartE2EDuration="33.98103851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:11.980586815 +0000 UTC m=+223.251695318" watchObservedRunningTime="2026-07-15 13:10:11.98103851 +0000 UTC m=+223.252147009" Jul 15 13:10:12.138486 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:12.138446 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:10:12.141388 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:12.141362 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:10:12.780798 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:12.780744 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:12.873171 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:12.873127 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:12.970318 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:12.970279 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:10:12.971898 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:12.971871 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bb7b4d6f6-nnrsb" Jul 15 13:10:13.889336 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:13.889296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:13.990211 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:13.990177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:14.327019 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:14.326977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:14.435250 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:14.435170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:15.255460 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:15.255413 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:15.489230 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:15.489198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:15.574989 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:15.574923 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:15.883465 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:15.883369 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:15.981058 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:15.981025 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" event={"ID":"fa5f9520-c485-45dd-b348-3deeb37eb2b8","Type":"ContainerStarted","Data":"fc535dae2c68b669fba00768226e41d40f6d3b0af8fef28473c919d62777d4dd"} Jul 15 13:10:15.983035 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:15.983013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jc26" event={"ID":"23f70fb0-38a1-42a2-b090-9e2dfe0518c7","Type":"ContainerStarted","Data":"cfab7635ef2626c331af2a876a39cafce8546e0b89ebee762699b32fce3e23b3"} Jul 15 13:10:16.001833 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:16.001796 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dlvkl" podStartSLOduration=33.443935608 podStartE2EDuration="37.001782085s" totalImagesPullingTime="3.557846477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:16.001756012 +0000 UTC m=+227.272864514" watchObservedRunningTime="2026-07-15 13:10:16.001782085 +0000 UTC m=+227.272890584" Jul 15 13:10:16.021368 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:16.021330 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8jc26" podStartSLOduration=17.337603455 podStartE2EDuration="32.021317361s" totalImagesPullingTime="14.683713906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:09:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:16.020656752 +0000 UTC m=+227.291765253" watchObservedRunningTime="2026-07-15 13:10:16.021317361 +0000 UTC m=+227.292425861" Jul 15 13:10:18.286791 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:18.286714 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:18.353855 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:18.353827 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:19.434462 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.434412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:19.516798 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.516773 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-6t6gk"] Jul 15 13:10:19.521743 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.521723 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.526574 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.526553 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rq6xf\"" Jul 15 13:10:19.526820 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.526805 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 13:10:19.527553 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.527535 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 13:10:19.527918 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.527794 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 13:10:19.539518 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.539493 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-6t6gk"] Jul 15 13:10:19.589659 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.589636 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:19.624804 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.624779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405a4cde-2f38-4c27-82a4-c4066f41c769-metrics-client-ca\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.624902 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.624808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.624902 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.624833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vdjw\" (UniqueName: \"kubernetes.io/projected/405a4cde-2f38-4c27-82a4-c4066f41c769-kube-api-access-8vdjw\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.624902 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.624852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.725582 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.725514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405a4cde-2f38-4c27-82a4-c4066f41c769-metrics-client-ca\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.725582 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.725548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.725750 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.725587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vdjw\" (UniqueName: \"kubernetes.io/projected/405a4cde-2f38-4c27-82a4-c4066f41c769-kube-api-access-8vdjw\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.725750 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.725618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.725750 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:10:19.725735 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 15 13:10:19.725896 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:10:19.725802 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-tls podName:405a4cde-2f38-4c27-82a4-c4066f41c769 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:20.225782781 +0000 UTC m=+231.496891261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-tls") pod "prometheus-operator-64785b6675-6t6gk" (UID: "405a4cde-2f38-4c27-82a4-c4066f41c769") : secret "prometheus-operator-tls" not found Jul 15 13:10:19.726229 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.726209 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405a4cde-2f38-4c27-82a4-c4066f41c769-metrics-client-ca\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.727850 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.727829 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.733749 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.733721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vdjw\" (UniqueName: \"kubernetes.io/projected/405a4cde-2f38-4c27-82a4-c4066f41c769-kube-api-access-8vdjw\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:19.900303 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.900271 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:19.950305 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.950277 2579 patch_prober.go:28] interesting pod/image-registry-6bc5678bcb-55fpm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:19.950402 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:19.950321 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" podUID="639ba0cd-d5be-4185-a379-2c1bba011a8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:20.229099 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:20.229070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:20.231350 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:20.231326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/405a4cde-2f38-4c27-82a4-c4066f41c769-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-6t6gk\" (UID: \"405a4cde-2f38-4c27-82a4-c4066f41c769\") " pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:20.430213 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:20.430172 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" Jul 15 13:10:20.570306 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:20.570129 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-6t6gk"] Jul 15 13:10:20.572617 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:20.572590 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405a4cde_2f38_4c27_82a4_c4066f41c769.slice/crio-2ba4bdeebb54713dd43e7acf58be491bb8415a143b8c877a624ada2f8ec54bae WatchSource:0}: Error finding container 2ba4bdeebb54713dd43e7acf58be491bb8415a143b8c877a624ada2f8ec54bae: Status 404 returned error can't find the container with id 2ba4bdeebb54713dd43e7acf58be491bb8415a143b8c877a624ada2f8ec54bae Jul 15 13:10:20.999332 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:20.999302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" event={"ID":"405a4cde-2f38-4c27-82a4-c4066f41c769","Type":"ContainerStarted","Data":"2ba4bdeebb54713dd43e7acf58be491bb8415a143b8c877a624ada2f8ec54bae"} Jul 15 13:10:21.887669 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:21.887621 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:22.004326 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:22.004298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" event={"ID":"405a4cde-2f38-4c27-82a4-c4066f41c769","Type":"ContainerStarted","Data":"5f34d10dc0593c5c9407ff804c840f84b94debaefeecac13868c83db43d0dd57"} Jul 15 13:10:22.004512 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:22.004348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" event={"ID":"405a4cde-2f38-4c27-82a4-c4066f41c769","Type":"ContainerStarted","Data":"f82daf88726df0bae07ea3914c1063e4c1ce4bb5807b2595f1f70353ff656dcd"} Jul 15 13:10:22.022733 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:22.022686 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-6t6gk" podStartSLOduration=1.9320499089999998 podStartE2EDuration="3.022670746s" totalImagesPullingTime="1.090620837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:22.022500886 +0000 UTC m=+233.293609384" watchObservedRunningTime="2026-07-15 13:10:22.022670746 +0000 UTC m=+233.293779246" Jul 15 13:10:22.043203 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:22.043171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:23.706404 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.706368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:23.813949 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.813916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:23.852860 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.852835 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jxtsj"] Jul 15 13:10:23.856090 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.856073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.859382 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.859353 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 13:10:23.859510 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.859368 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 13:10:23.859510 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.859397 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 13:10:23.859510 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.859494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6t2z7\"" Jul 15 13:10:23.922248 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.922221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:23.959061 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.958997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-wtmp\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959061 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-root\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959061 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-sys\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959179 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a246094-62c7-442f-a731-8cb1c21a6d8f-metrics-client-ca\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959362 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85pnd\" (UniqueName: \"kubernetes.io/projected/5a246094-62c7-442f-a731-8cb1c21a6d8f-kube-api-access-85pnd\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:23.959362 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:23.959254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-textfile\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.060664 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.060634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-root\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.060873 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.060850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-sys\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.060873 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.060861 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-root\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061050 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.060932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-sys\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061050 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.060961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061050 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.060989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a246094-62c7-442f-a731-8cb1c21a6d8f-metrics-client-ca\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061050 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061050 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061289 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85pnd\" (UniqueName: \"kubernetes.io/projected/5a246094-62c7-442f-a731-8cb1c21a6d8f-kube-api-access-85pnd\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061289 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-textfile\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061289 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:10:24.061126 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 13:10:24.061289 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:10:24.061185 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls podName:5a246094-62c7-442f-a731-8cb1c21a6d8f nodeName:}" failed. No retries permitted until 2026-07-15 13:10:24.561165466 +0000 UTC m=+235.832273961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls") pod "node-exporter-jxtsj" (UID: "5a246094-62c7-442f-a731-8cb1c21a6d8f") : secret "node-exporter-tls" not found Jul 15 13:10:24.061527 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-wtmp\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061527 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-wtmp\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061706 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a246094-62c7-442f-a731-8cb1c21a6d8f-metrics-client-ca\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061763 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061745 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-textfile\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.061901 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.061885 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.063807 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.063785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.069226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.069200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85pnd\" (UniqueName: \"kubernetes.io/projected/5a246094-62c7-442f-a731-8cb1c21a6d8f-kube-api-access-85pnd\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.131610 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.131578 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:24.243512 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.243452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:24.564247 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.564165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:24.564389 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:10:24.564302 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 13:10:24.564389 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:10:24.564360 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls podName:5a246094-62c7-442f-a731-8cb1c21a6d8f nodeName:}" failed. No retries permitted until 2026-07-15 13:10:25.564345022 +0000 UTC m=+236.835453516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls") pod "node-exporter-jxtsj" (UID: "5a246094-62c7-442f-a731-8cb1c21a6d8f") : secret "node-exporter-tls" not found Jul 15 13:10:24.582536 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.582510 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:24.824859 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.824787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:24.926168 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:24.926132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:25.163637 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.163558 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:25.572607 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.572578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:25.574820 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.574797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a246094-62c7-442f-a731-8cb1c21a6d8f-node-exporter-tls\") pod \"node-exporter-jxtsj\" (UID: \"5a246094-62c7-442f-a731-8cb1c21a6d8f\") " pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:25.665043 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.665018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxtsj" Jul 15 13:10:25.676851 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:25.676829 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a246094_62c7_442f_a731_8cb1c21a6d8f.slice/crio-aef0a224361b38088a7ddcee396a09374dad5b04540a193a77569bba0d18a1f8 WatchSource:0}: Error finding container aef0a224361b38088a7ddcee396a09374dad5b04540a193a77569bba0d18a1f8: Status 404 returned error can't find the container with id aef0a224361b38088a7ddcee396a09374dad5b04540a193a77569bba0d18a1f8 Jul 15 13:10:25.830594 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.830526 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6874f5f684-r6lvn"] Jul 15 13:10:25.835109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.835091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.837889 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.837833 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f3jllfg04ih8p\"" Jul 15 13:10:25.837889 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.837858 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 15 13:10:25.838055 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.837896 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 15 13:10:25.838055 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.837847 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sw894\"" Jul 15 13:10:25.838055 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.837946 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 15 13:10:25.838226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.838174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 15 13:10:25.838226 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.838176 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 15 13:10:25.847321 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.847298 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6874f5f684-r6lvn"] Jul 15 13:10:25.874216 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgz5d\" (UniqueName: \"kubernetes.io/projected/e857f580-7b45-4f8d-ac3e-d01704846730-kube-api-access-rgz5d\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.874305 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-tls\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.874305 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e857f580-7b45-4f8d-ac3e-d01704846730-metrics-client-ca\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.874305 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.874404 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-grpc-tls\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.874404 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.874404 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.874532 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.874410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975378 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975485 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgz5d\" (UniqueName: \"kubernetes.io/projected/e857f580-7b45-4f8d-ac3e-d01704846730-kube-api-access-rgz5d\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975485 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-tls\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975556 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e857f580-7b45-4f8d-ac3e-d01704846730-metrics-client-ca\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975556 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975556 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-grpc-tls\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975665 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.975665 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.975590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.976305 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.976265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e857f580-7b45-4f8d-ac3e-d01704846730-metrics-client-ca\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.978855 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.978825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.978967 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.978862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-tls\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.978967 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.978938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.979092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.978945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.979092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.979013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.979196 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.979152 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e857f580-7b45-4f8d-ac3e-d01704846730-secret-grpc-tls\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:25.983570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:25.983544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgz5d\" (UniqueName: \"kubernetes.io/projected/e857f580-7b45-4f8d-ac3e-d01704846730-kube-api-access-rgz5d\") pod \"thanos-querier-6874f5f684-r6lvn\" (UID: \"e857f580-7b45-4f8d-ac3e-d01704846730\") " pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:26.019090 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.019061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxtsj" event={"ID":"5a246094-62c7-442f-a731-8cb1c21a6d8f","Type":"ContainerStarted","Data":"aef0a224361b38088a7ddcee396a09374dad5b04540a193a77569bba0d18a1f8"} Jul 15 13:10:26.075014 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.074988 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbd7478fc-nclhp"] Jul 15 13:10:26.079189 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.079174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.081866 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.081804 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 13:10:26.081866 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.081835 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 13:10:26.082019 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.081907 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-knn9q\"" Jul 15 13:10:26.082019 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.081960 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 13:10:26.082142 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.082130 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 13:10:26.082223 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.082206 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 13:10:26.082270 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.082220 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 13:10:26.082810 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.082739 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 13:10:26.088638 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.088610 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 13:10:26.136778 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.136751 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbd7478fc-nclhp"] Jul 15 13:10:26.145540 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.145523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:26.176655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.176620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-trusted-ca-bundle\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.176655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.176655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jbqd\" (UniqueName: \"kubernetes.io/projected/5d7ded70-2359-4dd9-aea6-c1412186c3a1-kube-api-access-7jbqd\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.176812 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.176674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-oauth-config\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.176812 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.176707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-oauth-serving-cert\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.176812 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.176753 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-config\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.176904 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.176846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-service-ca\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.176904 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.176868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-serving-cert\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.274020 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.273988 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6874f5f684-r6lvn"] Jul 15 13:10:26.277268 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:26.277233 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode857f580_7b45_4f8d_ac3e_d01704846730.slice/crio-2bccbc384300bf10976437393fdfcb87286c78728b7b1716911eb45a4b09a2dc WatchSource:0}: Error finding container 2bccbc384300bf10976437393fdfcb87286c78728b7b1716911eb45a4b09a2dc: Status 404 returned error can't find the container with id 2bccbc384300bf10976437393fdfcb87286c78728b7b1716911eb45a4b09a2dc Jul 15 13:10:26.277384 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.277269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-config\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.277384 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.277363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-service-ca\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.277384 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.277381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-serving-cert\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.277556 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.277404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-trusted-ca-bundle\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.277556 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.277443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jbqd\" (UniqueName: \"kubernetes.io/projected/5d7ded70-2359-4dd9-aea6-c1412186c3a1-kube-api-access-7jbqd\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.277556 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.277474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-oauth-config\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.277730 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.277646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-oauth-serving-cert\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.278113 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.278087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-config\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.278213 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.278131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-service-ca\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.278603 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.278546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-trusted-ca-bundle\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.278976 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.278951 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-oauth-serving-cert\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.280415 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.280393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-oauth-config\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.281198 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.281178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-serving-cert\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.285656 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.285632 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jbqd\" (UniqueName: \"kubernetes.io/projected/5d7ded70-2359-4dd9-aea6-c1412186c3a1-kube-api-access-7jbqd\") pod \"console-5cbd7478fc-nclhp\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.392345 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.392272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:26.533851 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.533819 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbd7478fc-nclhp"] Jul 15 13:10:26.688016 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.687982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:26.722335 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:26.722305 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7ded70_2359_4dd9_aea6_c1412186c3a1.slice/crio-f69fe07b5f9b7f452935177d3be9da9d5fb208bc5d10f5e48213f269bd8df3b4 WatchSource:0}: Error finding container f69fe07b5f9b7f452935177d3be9da9d5fb208bc5d10f5e48213f269bd8df3b4: Status 404 returned error can't find the container with id f69fe07b5f9b7f452935177d3be9da9d5fb208bc5d10f5e48213f269bd8df3b4 Jul 15 13:10:26.841305 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.841269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:26.942056 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:26.941994 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:27.025701 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:27.025645 2579 generic.go:356] "Generic (PLEG): container finished" podID="5a246094-62c7-442f-a731-8cb1c21a6d8f" containerID="aaeea86aab64d73501636901403f7b7fbfd99d842532b0f12971555f4e8044f9" exitCode=0 Jul 15 13:10:27.025866 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:27.025755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxtsj" event={"ID":"5a246094-62c7-442f-a731-8cb1c21a6d8f","Type":"ContainerDied","Data":"aaeea86aab64d73501636901403f7b7fbfd99d842532b0f12971555f4e8044f9"} Jul 15 13:10:27.027368 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:27.027327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd7478fc-nclhp" event={"ID":"5d7ded70-2359-4dd9-aea6-c1412186c3a1","Type":"ContainerStarted","Data":"f69fe07b5f9b7f452935177d3be9da9d5fb208bc5d10f5e48213f269bd8df3b4"} Jul 15 13:10:27.028624 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:27.028602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" event={"ID":"e857f580-7b45-4f8d-ac3e-d01704846730","Type":"ContainerStarted","Data":"2bccbc384300bf10976437393fdfcb87286c78728b7b1716911eb45a4b09a2dc"} Jul 15 13:10:27.070140 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:27.070114 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:27.232809 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:27.232721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:28.035667 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.035609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxtsj" event={"ID":"5a246094-62c7-442f-a731-8cb1c21a6d8f","Type":"ContainerStarted","Data":"e8d209defa71b3c39b01b19e955fa1451a08526a9b803f9cc7759701539922c6"} Jul 15 13:10:28.036187 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.035675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxtsj" event={"ID":"5a246094-62c7-442f-a731-8cb1c21a6d8f","Type":"ContainerStarted","Data":"2d7bd4d29cba2a0912de0625c0788cbca7191ffb37059266bd68143baf89cf66"} Jul 15 13:10:28.058689 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.058638 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jxtsj" podStartSLOduration=3.901219699 podStartE2EDuration="5.058618823s" totalImagesPullingTime="1.087885703s" totalInitContainerRuntime="69.513421ms" isStatefulPod=true podCreationTimestamp="2026-07-15 13:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:28.056635633 +0000 UTC m=+239.327744148" watchObservedRunningTime="2026-07-15 13:10:28.058618823 +0000 UTC m=+239.329727337" Jul 15 13:10:28.149565 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.149535 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58d647f4c4-xghkh"] Jul 15 13:10:28.154414 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.154387 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.157450 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.157013 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 15 13:10:28.157450 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.157015 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 15 13:10:28.157450 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.157097 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 13:10:28.157450 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.157108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 15 13:10:28.157450 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.157200 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jq5gp\"" Jul 15 13:10:28.157450 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.157291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1sdlfjjsno457\"" Jul 15 13:10:28.164512 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.164484 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58d647f4c4-xghkh"] Jul 15 13:10:28.192265 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.192239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fa3574-0564-4ce0-b6f0-b943e531c720-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.192403 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.192275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1fa3574-0564-4ce0-b6f0-b943e531c720-audit-log\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.192403 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.192302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-client-ca-bundle\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.192403 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.192368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-secret-metrics-server-tls\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.192552 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.192406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-secret-metrics-server-client-certs\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.192552 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.192514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb7w4\" (UniqueName: \"kubernetes.io/projected/b1fa3574-0564-4ce0-b6f0-b943e531c720-kube-api-access-lb7w4\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.192629 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.192575 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1fa3574-0564-4ce0-b6f0-b943e531c720-metrics-server-audit-profiles\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.293982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.293527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fa3574-0564-4ce0-b6f0-b943e531c720-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.293982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.293568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1fa3574-0564-4ce0-b6f0-b943e531c720-audit-log\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.293982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.293586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-client-ca-bundle\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.293982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.293622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-secret-metrics-server-tls\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.293982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.293701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-secret-metrics-server-client-certs\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.293982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.293766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb7w4\" (UniqueName: \"kubernetes.io/projected/b1fa3574-0564-4ce0-b6f0-b943e531c720-kube-api-access-lb7w4\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.293982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.293843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1fa3574-0564-4ce0-b6f0-b943e531c720-metrics-server-audit-profiles\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.294406 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.294056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1fa3574-0564-4ce0-b6f0-b943e531c720-audit-log\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.294508 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.294417 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fa3574-0564-4ce0-b6f0-b943e531c720-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.295323 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.295300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1fa3574-0564-4ce0-b6f0-b943e531c720-metrics-server-audit-profiles\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.296888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.296863 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-secret-metrics-server-client-certs\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.296990 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.296973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-client-ca-bundle\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.297500 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.297476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1fa3574-0564-4ce0-b6f0-b943e531c720-secret-metrics-server-tls\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.301786 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.301747 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb7w4\" (UniqueName: \"kubernetes.io/projected/b1fa3574-0564-4ce0-b6f0-b943e531c720-kube-api-access-lb7w4\") pod \"metrics-server-58d647f4c4-xghkh\" (UID: \"b1fa3574-0564-4ce0-b6f0-b943e531c720\") " pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.467770 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.467743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:28.638071 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.637976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:28.738491 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.738442 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:28.834838 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:28.834795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:29.042966 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:29.042939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" event={"ID":"e857f580-7b45-4f8d-ac3e-d01704846730","Type":"ContainerStarted","Data":"69ec4b2c19d6140775e6bc17128d19770d594ca6884549d98aee3ee258e4891d"} Jul 15 13:10:29.043454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:29.043040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" event={"ID":"e857f580-7b45-4f8d-ac3e-d01704846730","Type":"ContainerStarted","Data":"977221de1e69cf6f5ab53520e0ce9d8d3cc87ca11c3adfd1b31e065656712e0c"} Jul 15 13:10:29.043454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:29.043070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" event={"ID":"e857f580-7b45-4f8d-ac3e-d01704846730","Type":"ContainerStarted","Data":"ef88330e21e432d0c5566e8dd4eb3a18948e849af65f49e64e9f76becb026f38"} Jul 15 13:10:29.636876 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:29.636803 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58d647f4c4-xghkh"] Jul 15 13:10:29.639863 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:29.639837 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fa3574_0564_4ce0_b6f0_b943e531c720.slice/crio-75f45d70dd5e95e64b0ccb50be7f05304795491b949738ec3ccefada571aa8d0 WatchSource:0}: Error finding container 75f45d70dd5e95e64b0ccb50be7f05304795491b949738ec3ccefada571aa8d0: Status 404 returned error can't find the container with id 75f45d70dd5e95e64b0ccb50be7f05304795491b949738ec3ccefada571aa8d0 Jul 15 13:10:29.950435 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:29.950396 2579 patch_prober.go:28] interesting pod/image-registry-6bc5678bcb-55fpm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:29.950545 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:29.950457 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" podUID="639ba0cd-d5be-4185-a379-2c1bba011a8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:30.048860 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.048835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" event={"ID":"b1fa3574-0564-4ce0-b6f0-b943e531c720","Type":"ContainerStarted","Data":"75f45d70dd5e95e64b0ccb50be7f05304795491b949738ec3ccefada571aa8d0"} Jul 15 13:10:30.050802 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.050704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd7478fc-nclhp" event={"ID":"5d7ded70-2359-4dd9-aea6-c1412186c3a1","Type":"ContainerStarted","Data":"ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4"} Jul 15 13:10:30.053264 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.053232 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" event={"ID":"e857f580-7b45-4f8d-ac3e-d01704846730","Type":"ContainerStarted","Data":"e0c268617ed8857109c91e3095a7733d62b7e393534b66b719d7a2d79ce2a90a"} Jul 15 13:10:30.086547 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.086503 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbd7478fc-nclhp" podStartSLOduration=1.248080302 podStartE2EDuration="4.086488331s" totalImagesPullingTime="2.838408029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:30.081952096 +0000 UTC m=+241.353060595" watchObservedRunningTime="2026-07-15 13:10:30.086488331 +0000 UTC m=+241.357596832" Jul 15 13:10:30.142271 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.142238 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:30.349555 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.349468 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:30.349555 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.349527 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:30.541796 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.541758 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77b6f49f7b-k8846"] Jul 15 13:10:30.548059 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.548032 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.561085 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.561065 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b6f49f7b-k8846"] Jul 15 13:10:30.616174 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.616112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-serving-cert\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.616300 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.616209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-trusted-ca-bundle\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.616377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.616299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-oauth-serving-cert\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.616377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.616340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-console-config\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.616377 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.616364 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmwcj\" (UniqueName: \"kubernetes.io/projected/69898214-c76a-465f-a9cb-cc46573de30b-kube-api-access-wmwcj\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.616539 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.616470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-service-ca\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.616539 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.616504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-oauth-config\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.715964 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.715909 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:30.717929 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.717904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-trusted-ca-bundle\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718065 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.717959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-oauth-serving-cert\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718065 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.717989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-console-config\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718065 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmwcj\" (UniqueName: \"kubernetes.io/projected/69898214-c76a-465f-a9cb-cc46573de30b-kube-api-access-wmwcj\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-service-ca\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718464 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-oauth-config\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718464 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-serving-cert\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718903 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718856 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-oauth-serving-cert\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.718903 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718895 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-console-config\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.719063 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718895 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-trusted-ca-bundle\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.719063 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.718999 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-service-ca\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.721195 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.721175 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-serving-cert\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.721297 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.721276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-oauth-config\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.726634 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.726614 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmwcj\" (UniqueName: \"kubernetes.io/projected/69898214-c76a-465f-a9cb-cc46573de30b-kube-api-access-wmwcj\") pod \"console-77b6f49f7b-k8846\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:30.787969 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.787920 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:30.858470 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:30.858414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:31.061145 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.061111 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" event={"ID":"e857f580-7b45-4f8d-ac3e-d01704846730","Type":"ContainerStarted","Data":"34b1a1d37b1e409b3de6eb13360dc0fbd79037ae39ac12994a2d1d87572e1d04"} Jul 15 13:10:31.061459 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.061198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" event={"ID":"e857f580-7b45-4f8d-ac3e-d01704846730","Type":"ContainerStarted","Data":"fe1fac27155eef2e6b0764651b0d396ea5218f33ecbe257b5604ffe33691051c"} Jul 15 13:10:31.085841 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.085773 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b6f49f7b-k8846"] Jul 15 13:10:31.088334 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:31.088306 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69898214_c76a_465f_a9cb_cc46573de30b.slice/crio-c2769203aeb487a5fe9245c7ee2a6f791ba8493679d4f7acaac0df2dbdef0c05 WatchSource:0}: Error finding container c2769203aeb487a5fe9245c7ee2a6f791ba8493679d4f7acaac0df2dbdef0c05: Status 404 returned error can't find the container with id c2769203aeb487a5fe9245c7ee2a6f791ba8493679d4f7acaac0df2dbdef0c05 Jul 15 13:10:31.089037 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.088996 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" podStartSLOduration=2.652162438 podStartE2EDuration="6.088979391s" totalImagesPullingTime="3.436816953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:31.086920146 +0000 UTC m=+242.358028646" watchObservedRunningTime="2026-07-15 13:10:31.088979391 +0000 UTC m=+242.360087891" Jul 15 13:10:31.400070 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.399986 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:31.499956 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.499926 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:31.966334 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.966304 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:31.966519 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:31.966349 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:32.065755 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.065714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6f49f7b-k8846" event={"ID":"69898214-c76a-465f-a9cb-cc46573de30b","Type":"ContainerStarted","Data":"5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f"} Jul 15 13:10:32.066150 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.065773 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6f49f7b-k8846" event={"ID":"69898214-c76a-465f-a9cb-cc46573de30b","Type":"ContainerStarted","Data":"c2769203aeb487a5fe9245c7ee2a6f791ba8493679d4f7acaac0df2dbdef0c05"} Jul 15 13:10:32.067251 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.067230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" event={"ID":"b1fa3574-0564-4ce0-b6f0-b943e531c720","Type":"ContainerStarted","Data":"72cd120e9784bc808524b77a5954bf654d1e82fcbe89b277321ee764f60c8f88"} Jul 15 13:10:32.067492 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.067478 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:32.093416 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.093371 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77b6f49f7b-k8846" podStartSLOduration=2.093355975 podStartE2EDuration="2.093355975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:32.092206233 +0000 UTC m=+243.363314733" watchObservedRunningTime="2026-07-15 13:10:32.093355975 +0000 UTC m=+243.364464476" Jul 15 13:10:32.112836 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.112809 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:32.116866 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.116821 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" podStartSLOduration=2.747152798 podStartE2EDuration="4.116802976s" totalImagesPullingTime="1.369650178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:32.116248543 +0000 UTC m=+243.387357042" watchObservedRunningTime="2026-07-15 13:10:32.116802976 +0000 UTC m=+243.387911478" Jul 15 13:10:32.228760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:32.228674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:33.076570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:33.076542 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6874f5f684-r6lvn" Jul 15 13:10:34.965373 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:34.965314 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" podUID="639ba0cd-d5be-4185-a379-2c1bba011a8d" containerName="registry" containerID="cri-o://f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13" gracePeriod=30 Jul 15 13:10:35.200986 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.200964 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:10:35.262069 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262000 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-trusted-ca\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262069 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262032 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-installation-pull-secrets\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262229 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262070 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4hgs\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-kube-api-access-g4hgs\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262229 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262140 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262229 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262175 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-certificates\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262229 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262205 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-bound-sa-token\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262412 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262235 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-image-registry-private-configuration\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262412 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262292 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/639ba0cd-d5be-4185-a379-2c1bba011a8d-ca-trust-extracted\") pod \"639ba0cd-d5be-4185-a379-2c1bba011a8d\" (UID: \"639ba0cd-d5be-4185-a379-2c1bba011a8d\") " Jul 15 13:10:35.262610 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262562 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:10:35.262792 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.262670 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:10:35.264854 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.264808 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:10:35.264955 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.264869 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-kube-api-access-g4hgs" (OuterVolumeSpecName: "kube-api-access-g4hgs") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "kube-api-access-g4hgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:10:35.264955 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.264895 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:10:35.265030 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.264975 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:10:35.265063 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.264965 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:10:35.271316 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.271296 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639ba0cd-d5be-4185-a379-2c1bba011a8d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "639ba0cd-d5be-4185-a379-2c1bba011a8d" (UID: "639ba0cd-d5be-4185-a379-2c1bba011a8d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:10:35.363671 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363642 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-tls\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:35.363671 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363666 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-registry-certificates\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:35.363671 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363675 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-bound-sa-token\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:35.363864 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363684 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-image-registry-private-configuration\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:35.363864 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363694 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/639ba0cd-d5be-4185-a379-2c1bba011a8d-ca-trust-extracted\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:35.363864 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363701 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/639ba0cd-d5be-4185-a379-2c1bba011a8d-trusted-ca\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:35.363864 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363709 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/639ba0cd-d5be-4185-a379-2c1bba011a8d-installation-pull-secrets\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:35.363864 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:35.363718 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4hgs\" (UniqueName: \"kubernetes.io/projected/639ba0cd-d5be-4185-a379-2c1bba011a8d-kube-api-access-g4hgs\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:10:36.082970 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.082933 2579 generic.go:356] "Generic (PLEG): container finished" podID="639ba0cd-d5be-4185-a379-2c1bba011a8d" containerID="f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13" exitCode=0 Jul 15 13:10:36.083407 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.082982 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" Jul 15 13:10:36.083407 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.083022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" event={"ID":"639ba0cd-d5be-4185-a379-2c1bba011a8d","Type":"ContainerDied","Data":"f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13"} Jul 15 13:10:36.083407 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.083088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc5678bcb-55fpm" event={"ID":"639ba0cd-d5be-4185-a379-2c1bba011a8d","Type":"ContainerDied","Data":"038a46b0d169262f7c4f1160b4dca1217f13a28365ce83cf7a45b5b71a9c1e24"} Jul 15 13:10:36.083407 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.083120 2579 scope.go:117] "RemoveContainer" containerID="f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13" Jul 15 13:10:36.091505 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.091485 2579 scope.go:117] "RemoveContainer" containerID="f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13" Jul 15 13:10:36.091763 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:10:36.091744 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13\": container with ID starting with f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13 not found: ID does not exist" containerID="f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13" Jul 15 13:10:36.091831 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.091774 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13"} err="failed to get container status \"f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13\": rpc error: code = NotFound desc = could not find container \"f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13\": container with ID starting with f93fea63c97a7bbed765d48d293e298bb2f3f7fb7ab556dbc6504bd98d594e13 not found: ID does not exist" Jul 15 13:10:36.103879 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.103859 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bc5678bcb-55fpm"] Jul 15 13:10:36.108327 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.108306 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bc5678bcb-55fpm"] Jul 15 13:10:36.355924 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.353346 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="639ba0cd-d5be-4185-a379-2c1bba011a8d" path="/var/lib/kubelet/pods/639ba0cd-d5be-4185-a379-2c1bba011a8d/volumes" Jul 15 13:10:36.393367 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.393341 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:36.393465 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.393392 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:10:36.394703 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.394681 2579 patch_prober.go:28] interesting pod/console-5cbd7478fc-nclhp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jul 15 13:10:36.394793 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:36.394718 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cbd7478fc-nclhp" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jul 15 13:10:40.346917 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.346884 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:40.347503 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.346933 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:40.381107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.381078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:40.481580 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.481548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:40.858665 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.858637 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:40.858841 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.858690 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:10:40.860043 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.860021 2579 patch_prober.go:28] interesting pod/console-77b6f49f7b-k8846 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 15 13:10:40.860137 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:40.860067 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-77b6f49f7b-k8846" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 15 13:10:41.965671 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:41.965640 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:41.966089 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:41.965687 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:42.160557 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:42.160521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:42.214751 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:42.214725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:10:42.217053 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:42.217007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4a4cd0e-42ef-4e1f-9595-f047ff8512ff-metrics-certs\") pod \"network-metrics-daemon-hrwxj\" (UID: \"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff\") " pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:10:42.249996 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:42.249960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:42.251009 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:42.250994 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cv2f2\"" Jul 15 13:10:42.259214 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:42.259192 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hrwxj" Jul 15 13:10:42.420390 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:42.420368 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hrwxj"] Jul 15 13:10:42.422563 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:10:42.422538 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a4cd0e_42ef_4e1f_9595_f047ff8512ff.slice/crio-19a317159d91484d476aa0f4f70e0d482da19fc243f598841caf06b5c824d5af WatchSource:0}: Error finding container 19a317159d91484d476aa0f4f70e0d482da19fc243f598841caf06b5c824d5af: Status 404 returned error can't find the container with id 19a317159d91484d476aa0f4f70e0d482da19fc243f598841caf06b5c824d5af Jul 15 13:10:43.110044 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:43.110005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hrwxj" event={"ID":"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff","Type":"ContainerStarted","Data":"19a317159d91484d476aa0f4f70e0d482da19fc243f598841caf06b5c824d5af"} Jul 15 13:10:44.114760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:44.114728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hrwxj" event={"ID":"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff","Type":"ContainerStarted","Data":"6791f819adc55cedbcd527e3be6abf72989acb14c03e2fb8759426e92f8752fe"} Jul 15 13:10:44.115115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:44.114790 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hrwxj" event={"ID":"c4a4cd0e-42ef-4e1f-9595-f047ff8512ff","Type":"ContainerStarted","Data":"a684e2a03338c01f1890d0f34045377f416a569f1a2545759166ad567e8e933b"} Jul 15 13:10:44.131234 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:44.131184 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hrwxj" podStartSLOduration=252.187200401 podStartE2EDuration="4m13.131169343s" totalImagesPullingTime="943.968942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:44.130796165 +0000 UTC m=+255.401904665" watchObservedRunningTime="2026-07-15 13:10:44.131169343 +0000 UTC m=+255.402277842" Jul 15 13:10:44.226054 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:44.226026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:44.287953 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:44.287923 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:45.461456 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:45.461414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:45.541003 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:45.540976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:45.700963 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:45.700929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:46.003118 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:46.003092 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:46.103440 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:46.103401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:46.393572 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:46.393491 2579 patch_prober.go:28] interesting pod/console-5cbd7478fc-nclhp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jul 15 13:10:46.393572 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:46.393536 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cbd7478fc-nclhp" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jul 15 13:10:48.468752 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:48.468723 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:48.469080 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:48.468780 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:10:49.942625 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:49.942589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:50.020835 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.020806 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:50.346557 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.346486 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:50.346557 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.346529 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:50.346725 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.346571 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:10:50.347075 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.347045 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"3dd58e2ade2fb96691249aaeac901cb0dcc534df07e3303a38902c257fa013f9"} pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" containerMessage="Container registry failed liveness probe, will be restarted" Jul 15 13:10:50.350666 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.350639 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:10:50.350783 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.350688 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:10:50.859730 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.859698 2579 patch_prober.go:28] interesting pod/console-77b6f49f7b-k8846 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 15 13:10:50.859895 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:50.859750 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-77b6f49f7b-k8846" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 15 13:10:56.393265 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:56.393234 2579 patch_prober.go:28] interesting pod/console-5cbd7478fc-nclhp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jul 15 13:10:56.393663 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:56.393279 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cbd7478fc-nclhp" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jul 15 13:10:59.316781 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:59.316750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:10:59.500585 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:10:59.500549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:00.352097 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:00.352054 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:11:00.352542 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:00.352114 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:11:00.859677 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:00.859645 2579 patch_prober.go:28] interesting pod/console-77b6f49f7b-k8846 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 15 13:11:00.859839 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:00.859689 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-77b6f49f7b-k8846" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 15 13:11:01.368163 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:01.368124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:01.661233 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:01.661117 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:06.393644 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:06.393602 2579 patch_prober.go:28] interesting pod/console-5cbd7478fc-nclhp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jul 15 13:11:06.394106 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:06.393680 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cbd7478fc-nclhp" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jul 15 13:11:08.474195 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:08.474164 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:11:08.478200 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:08.478168 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58d647f4c4-xghkh" Jul 15 13:11:08.906775 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:08.906693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:08.975838 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:08.975808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:10.002720 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:10.002683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:10.350756 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:10.350684 2579 patch_prober.go:28] interesting pod/image-registry-86b68bb6f5-z7tjc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:11:10.350756 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:10.350738 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:11:10.859737 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:10.859704 2579 patch_prober.go:28] interesting pod/console-77b6f49f7b-k8846 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 15 13:11:10.859964 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:10.859752 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-77b6f49f7b-k8846" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 15 13:11:12.778302 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:11:12.778265 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mkbqn" podUID="4aee88a8-f4be-4b83-8026-6ed5811b04be" Jul 15 13:11:13.177977 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:13.177951 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-dlvkl_fa5f9520-c485-45dd-b348-3deeb37eb2b8/cluster-monitoring-operator/0.log" Jul 15 13:11:13.224400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:13.224373 2579 generic.go:356] "Generic (PLEG): container finished" podID="10a0588d-4085-4911-9d47-57eef99f42c6" containerID="9217558d5433f0230fb580eab3340c6c17d758f606c266dbec595a1b95898ac9" exitCode=0 Jul 15 13:11:13.224547 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:13.224453 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" event={"ID":"10a0588d-4085-4911-9d47-57eef99f42c6","Type":"ContainerDied","Data":"9217558d5433f0230fb580eab3340c6c17d758f606c266dbec595a1b95898ac9"} Jul 15 13:11:13.224587 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:13.224469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mkbqn" Jul 15 13:11:13.224783 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:13.224770 2579 scope.go:117] "RemoveContainer" containerID="9217558d5433f0230fb580eab3340c6c17d758f606c266dbec595a1b95898ac9" Jul 15 13:11:13.974013 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:13.973983 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58d647f4c4-xghkh_b1fa3574-0564-4ce0-b6f0-b943e531c720/metrics-server/0.log" Jul 15 13:11:14.230076 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:14.229986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-48sw8" event={"ID":"10a0588d-4085-4911-9d47-57eef99f42c6","Type":"ContainerStarted","Data":"bec9d8662f567506bd8c255fbdf10b6aca7134f04028289819436d48872e00c5"} Jul 15 13:11:15.367048 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:15.367010 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" podUID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerName="registry" containerID="cri-o://3dd58e2ade2fb96691249aaeac901cb0dcc534df07e3303a38902c257fa013f9" gracePeriod=30 Jul 15 13:11:15.573694 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:15.573668 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxtsj_5a246094-62c7-442f-a731-8cb1c21a6d8f/init-textfile/0.log" Jul 15 13:11:15.775776 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:15.775745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxtsj_5a246094-62c7-442f-a731-8cb1c21a6d8f/node-exporter/0.log" Jul 15 13:11:15.974854 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:15.974828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxtsj_5a246094-62c7-442f-a731-8cb1c21a6d8f/kube-rbac-proxy/0.log" Jul 15 13:11:16.393570 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:16.393539 2579 patch_prober.go:28] interesting pod/console-5cbd7478fc-nclhp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jul 15 13:11:16.393942 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:16.393590 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cbd7478fc-nclhp" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jul 15 13:11:16.587784 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:16.587756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:11:16.589800 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:16.589775 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aee88a8-f4be-4b83-8026-6ed5811b04be-metrics-tls\") pod \"dns-default-mkbqn\" (UID: \"4aee88a8-f4be-4b83-8026-6ed5811b04be\") " pod="openshift-dns/dns-default-mkbqn" Jul 15 13:11:16.827221 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:16.827180 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jn5bp\"" Jul 15 13:11:16.835056 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:16.835022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mkbqn" Jul 15 13:11:16.979162 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:16.979133 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mkbqn"] Jul 15 13:11:16.982042 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:11:16.982016 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aee88a8_f4be_4b83_8026_6ed5811b04be.slice/crio-2681cc03ccc40d0bda30e6d6fd98b72bf039789a2bd0556d3d993630b3102638 WatchSource:0}: Error finding container 2681cc03ccc40d0bda30e6d6fd98b72bf039789a2bd0556d3d993630b3102638: Status 404 returned error can't find the container with id 2681cc03ccc40d0bda30e6d6fd98b72bf039789a2bd0556d3d993630b3102638 Jul 15 13:11:17.241764 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:17.241729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mkbqn" event={"ID":"4aee88a8-f4be-4b83-8026-6ed5811b04be","Type":"ContainerStarted","Data":"2681cc03ccc40d0bda30e6d6fd98b72bf039789a2bd0556d3d993630b3102638"} Jul 15 13:11:17.243434 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:17.243399 2579 generic.go:356] "Generic (PLEG): container finished" podID="e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6" containerID="3dd58e2ade2fb96691249aaeac901cb0dcc534df07e3303a38902c257fa013f9" exitCode=0 Jul 15 13:11:17.243545 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:17.243445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" event={"ID":"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6","Type":"ContainerDied","Data":"3dd58e2ade2fb96691249aaeac901cb0dcc534df07e3303a38902c257fa013f9"} Jul 15 13:11:17.243545 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:17.243475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" event={"ID":"e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6","Type":"ContainerStarted","Data":"af6cf00883b836f0918c2d68ddfaeb81ff12202fab9ca48d1e125b8eff2fb6bd"} Jul 15 13:11:17.243607 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:17.243573 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:11:18.177854 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:18.177820 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-6t6gk_405a4cde-2f38-4c27-82a4-c4066f41c769/prometheus-operator/0.log" Jul 15 13:11:18.374483 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:18.374457 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-6t6gk_405a4cde-2f38-4c27-82a4-c4066f41c769/kube-rbac-proxy/0.log" Jul 15 13:11:18.547990 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:18.547964 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:18.774880 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:18.774765 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/thanos-query/0.log" Jul 15 13:11:18.974351 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:18.974312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy-web/0.log" Jul 15 13:11:19.173958 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.173933 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy/0.log" Jul 15 13:11:19.253239 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.253212 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mkbqn" event={"ID":"4aee88a8-f4be-4b83-8026-6ed5811b04be","Type":"ContainerStarted","Data":"d3a42112de54b5aca212b306d715df444d0f2111702aeba8f15b9e55a1fa4f1c"} Jul 15 13:11:19.253586 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.253262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mkbqn" event={"ID":"4aee88a8-f4be-4b83-8026-6ed5811b04be","Type":"ContainerStarted","Data":"c70ae284a7de2b7b4f2121d8dd4f4c62238e96b3de81f80cd4253bbca9ec89e8"} Jul 15 13:11:19.253586 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.253348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mkbqn" Jul 15 13:11:19.272205 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.272162 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mkbqn" podStartSLOduration=251.910879474 podStartE2EDuration="4m13.272149209s" totalImagesPullingTime="1.361269735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:19.271001692 +0000 UTC m=+290.542110192" watchObservedRunningTime="2026-07-15 13:11:19.272149209 +0000 UTC m=+290.543257709" Jul 15 13:11:19.374397 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.374373 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/prom-label-proxy/0.log" Jul 15 13:11:19.575101 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.575034 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy-rules/0.log" Jul 15 13:11:19.774692 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:19.774663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy-metrics/0.log" Jul 15 13:11:20.574479 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:20.574454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cbd7478fc-nclhp_5d7ded70-2359-4dd9-aea6-c1412186c3a1/console/0.log" Jul 15 13:11:20.775325 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:20.775297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77b6f49f7b-k8846_69898214-c76a-465f-a9cb-cc46573de30b/console/0.log" Jul 15 13:11:20.859655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:20.859588 2579 patch_prober.go:28] interesting pod/console-77b6f49f7b-k8846 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 15 13:11:20.859655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:20.859637 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-77b6f49f7b-k8846" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 15 13:11:21.304371 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:21.304336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:22.174187 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:22.174158 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mkbqn_4aee88a8-f4be-4b83-8026-6ed5811b04be/dns/0.log" Jul 15 13:11:22.374273 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:22.374247 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mkbqn_4aee88a8-f4be-4b83-8026-6ed5811b04be/kube-rbac-proxy/0.log" Jul 15 13:11:22.573798 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:22.573709 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49ctm_0c896098-424f-4310-8978-d4ffb2db603d/dns-node-resolver/0.log" Jul 15 13:11:23.174357 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:23.174321 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86b68bb6f5-z7tjc_e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6/registry/1.log" Jul 15 13:11:23.530480 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:23.530385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:23.583411 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:23.583387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44ffz_6a915b40-77d6-45db-bbf5-533616e8b4a9/node-ca/0.log" Jul 15 13:11:23.630983 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:23.630957 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:23.732930 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:23.732899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:24.174586 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:24.174558 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bb7b4d6f6-nnrsb_0581b85f-3730-4cd7-8ce8-fb17ebaf3b51/router/0.log" Jul 15 13:11:24.574218 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:24.574138 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-np2ct_acc4218d-8405-4947-ad4d-e75fca122c4b/serve-healthcheck-canary/0.log" Jul 15 13:11:26.400950 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:26.400922 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:11:26.404702 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:26.404679 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:11:26.576607 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:26.576574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:26.652583 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:26.652464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:27.266328 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:27.266289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:27.405513 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:27.405476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:29.259446 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:29.259401 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mkbqn" Jul 15 13:11:30.237843 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:30.237824 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 13:11:30.862654 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:30.862621 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:11:30.866771 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:30.866750 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:11:30.948844 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:30.948817 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbd7478fc-nclhp"] Jul 15 13:11:31.055888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:31.055857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:31.157196 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:31.157120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:31.242509 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:31.242472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:31.883585 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:31.883553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:31.963404 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:31.963372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:38.252607 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:38.252577 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86b68bb6f5-z7tjc" Jul 15 13:11:38.402704 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:38.402669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:38.502930 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:38.502850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:38.603742 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:38.603705 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:40.114652 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:40.114615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:40.293028 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:40.292995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:40.880733 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:40.880702 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:43.637829 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:43.637786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:43.755104 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:43.755071 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:46.380158 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:46.380114 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:46.473800 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:46.473769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:48.219260 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.219217 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r"] Jul 15 13:11:48.219961 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.219938 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="639ba0cd-d5be-4185-a379-2c1bba011a8d" containerName="registry" Jul 15 13:11:48.220051 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.219963 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="639ba0cd-d5be-4185-a379-2c1bba011a8d" containerName="registry" Jul 15 13:11:48.220051 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.220037 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="639ba0cd-d5be-4185-a379-2c1bba011a8d" containerName="registry" Jul 15 13:11:48.223467 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.223447 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.226737 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.226720 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 13:11:48.227053 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.227029 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 13:11:48.227223 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.226796 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 13:11:48.227566 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.227546 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 13:11:48.227654 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.227561 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 13:11:48.227654 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.227590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bskfh\"" Jul 15 13:11:48.231814 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.231792 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 13:11:48.237781 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.237755 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r"] Jul 15 13:11:48.355131 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-serving-certs-ca-bundle\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.355336 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.355336 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-metrics-client-ca\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.355336 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-secret-telemeter-client\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.355336 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qpwg\" (UniqueName: \"kubernetes.io/projected/772ebf2f-7024-4704-86f7-7c98fe9406b7-kube-api-access-7qpwg\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.355336 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-federate-client-tls\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.355608 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-telemeter-client-tls\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.355608 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.355382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.455789 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.455789 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-metrics-client-ca\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-secret-telemeter-client\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qpwg\" (UniqueName: \"kubernetes.io/projected/772ebf2f-7024-4704-86f7-7c98fe9406b7-kube-api-access-7qpwg\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-federate-client-tls\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-telemeter-client-tls\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.455966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-serving-certs-ca-bundle\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456701 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.456664 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-metrics-client-ca\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.456701 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.456666 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-serving-certs-ca-bundle\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.457076 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.457050 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772ebf2f-7024-4704-86f7-7c98fe9406b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.458462 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.458418 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.458690 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.458668 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-secret-telemeter-client\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.459035 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.459015 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-federate-client-tls\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.459105 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.459021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/772ebf2f-7024-4704-86f7-7c98fe9406b7-telemeter-client-tls\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.467331 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.467312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qpwg\" (UniqueName: \"kubernetes.io/projected/772ebf2f-7024-4704-86f7-7c98fe9406b7-kube-api-access-7qpwg\") pod \"telemeter-client-7f9f959bb7-l6n2r\" (UID: \"772ebf2f-7024-4704-86f7-7c98fe9406b7\") " pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.537372 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.537286 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" Jul 15 13:11:48.688059 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.687956 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r"] Jul 15 13:11:48.689584 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:11:48.689555 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772ebf2f_7024_4704_86f7_7c98fe9406b7.slice/crio-5a1c74f31c391111f271dd5fd5d3e2c8b79cfc3bf004ce3b281b955b821026b6 WatchSource:0}: Error finding container 5a1c74f31c391111f271dd5fd5d3e2c8b79cfc3bf004ce3b281b955b821026b6: Status 404 returned error can't find the container with id 5a1c74f31c391111f271dd5fd5d3e2c8b79cfc3bf004ce3b281b955b821026b6 Jul 15 13:11:48.691777 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:48.691758 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:11:49.139842 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:49.139813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:49.249107 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:49.249071 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:49.369482 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:49.369452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" event={"ID":"772ebf2f-7024-4704-86f7-7c98fe9406b7","Type":"ContainerStarted","Data":"5a1c74f31c391111f271dd5fd5d3e2c8b79cfc3bf004ce3b281b955b821026b6"} Jul 15 13:11:51.387174 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:51.387142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" event={"ID":"772ebf2f-7024-4704-86f7-7c98fe9406b7","Type":"ContainerStarted","Data":"0b5b04c7d9f4a494821a38214fc57d4ed89bb55375d82f1b99da2efeb7a0abcf"} Jul 15 13:11:54.401092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:54.400997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" event={"ID":"772ebf2f-7024-4704-86f7-7c98fe9406b7","Type":"ContainerStarted","Data":"2cd461ce0c1f00dd101edb85fe5e3161c45dde70394251a5403b527c3bff2e90"} Jul 15 13:11:54.401092 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:54.401055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" event={"ID":"772ebf2f-7024-4704-86f7-7c98fe9406b7","Type":"ContainerStarted","Data":"381d06a8d7e987609d9ba003b464bfe193a2896caed6cbe8abe646682fbfcc54"} Jul 15 13:11:54.433800 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:54.433744 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f9f959bb7-l6n2r" podStartSLOduration=1.217705649 podStartE2EDuration="6.433729245s" totalImagesPullingTime="5.216023596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:54.432580598 +0000 UTC m=+325.703689098" watchObservedRunningTime="2026-07-15 13:11:54.433729245 +0000 UTC m=+325.704837744" Jul 15 13:11:55.305970 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.305935 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc5f7cd5b-jk95r"] Jul 15 13:11:55.309142 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.309117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.318079 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.318051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-config\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.318218 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.318107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-serving-cert\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.318218 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.318137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-service-ca\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.318218 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.318163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsjcl\" (UniqueName: \"kubernetes.io/projected/f3797b86-5cfc-4c67-87e9-78f1732f3d93-kube-api-access-gsjcl\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.318332 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.318252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-oauth-config\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.318332 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.318305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-oauth-serving-cert\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.318332 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.318325 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-trusted-ca-bundle\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.326518 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.326492 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc5f7cd5b-jk95r"] Jul 15 13:11:55.418716 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.418683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-oauth-config\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.418716 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.418722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-oauth-serving-cert\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419171 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.418832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-trusted-ca-bundle\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419171 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.418956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-config\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419171 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.419015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-serving-cert\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419171 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.419054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-service-ca\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419171 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.419079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsjcl\" (UniqueName: \"kubernetes.io/projected/f3797b86-5cfc-4c67-87e9-78f1732f3d93-kube-api-access-gsjcl\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419618 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.419591 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-oauth-serving-cert\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419829 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.419775 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-config\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.419954 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.419826 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-trusted-ca-bundle\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.420371 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.420347 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-service-ca\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.422623 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.422597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-oauth-config\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.422862 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.422845 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-serving-cert\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.427794 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.427770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsjcl\" (UniqueName: \"kubernetes.io/projected/f3797b86-5cfc-4c67-87e9-78f1732f3d93-kube-api-access-gsjcl\") pod \"console-5cc5f7cd5b-jk95r\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.507511 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.507473 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:55.620053 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.619951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:11:55.770053 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.770019 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc5f7cd5b-jk95r"] Jul 15 13:11:55.773465 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:11:55.773401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3797b86_5cfc_4c67_87e9_78f1732f3d93.slice/crio-853f4f00f7cf503e0ff76d37f5a5c09454cb6ac3197ded17113a0a653f448c92 WatchSource:0}: Error finding container 853f4f00f7cf503e0ff76d37f5a5c09454cb6ac3197ded17113a0a653f448c92: Status 404 returned error can't find the container with id 853f4f00f7cf503e0ff76d37f5a5c09454cb6ac3197ded17113a0a653f448c92 Jul 15 13:11:55.848255 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.848224 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:11:55.969203 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:55.969159 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cbd7478fc-nclhp" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" containerID="cri-o://ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4" gracePeriod=15 Jul 15 13:11:56.202879 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.202857 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:11:56.224393 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224329 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-oauth-serving-cert\") pod \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " Jul 15 13:11:56.224393 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224370 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-service-ca\") pod \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " Jul 15 13:11:56.224589 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224410 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-trusted-ca-bundle\") pod \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " Jul 15 13:11:56.224589 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224458 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-oauth-config\") pod \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " Jul 15 13:11:56.224589 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224483 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-serving-cert\") pod \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " Jul 15 13:11:56.224589 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224516 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jbqd\" (UniqueName: \"kubernetes.io/projected/5d7ded70-2359-4dd9-aea6-c1412186c3a1-kube-api-access-7jbqd\") pod \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " Jul 15 13:11:56.224589 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224567 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-config\") pod \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\" (UID: \"5d7ded70-2359-4dd9-aea6-c1412186c3a1\") " Jul 15 13:11:56.224826 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224746 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d7ded70-2359-4dd9-aea6-c1412186c3a1" (UID: "5d7ded70-2359-4dd9-aea6-c1412186c3a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:11:56.224892 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.224873 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-oauth-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:11:56.225097 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.225072 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-config" (OuterVolumeSpecName: "console-config") pod "5d7ded70-2359-4dd9-aea6-c1412186c3a1" (UID: "5d7ded70-2359-4dd9-aea6-c1412186c3a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:11:56.225186 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.225100 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d7ded70-2359-4dd9-aea6-c1412186c3a1" (UID: "5d7ded70-2359-4dd9-aea6-c1412186c3a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:11:56.225186 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.225142 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d7ded70-2359-4dd9-aea6-c1412186c3a1" (UID: "5d7ded70-2359-4dd9-aea6-c1412186c3a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:11:56.226763 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.226735 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d7ded70-2359-4dd9-aea6-c1412186c3a1" (UID: "5d7ded70-2359-4dd9-aea6-c1412186c3a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:11:56.226875 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.226802 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d7ded70-2359-4dd9-aea6-c1412186c3a1" (UID: "5d7ded70-2359-4dd9-aea6-c1412186c3a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:11:56.227037 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.227018 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7ded70-2359-4dd9-aea6-c1412186c3a1-kube-api-access-7jbqd" (OuterVolumeSpecName: "kube-api-access-7jbqd") pod "5d7ded70-2359-4dd9-aea6-c1412186c3a1" (UID: "5d7ded70-2359-4dd9-aea6-c1412186c3a1"). InnerVolumeSpecName "kube-api-access-7jbqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:11:56.325257 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.325224 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-trusted-ca-bundle\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:11:56.325257 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.325254 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-oauth-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:11:56.325257 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.325265 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:11:56.325522 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.325274 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jbqd\" (UniqueName: \"kubernetes.io/projected/5d7ded70-2359-4dd9-aea6-c1412186c3a1-kube-api-access-7jbqd\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:11:56.325522 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.325283 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-console-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:11:56.325522 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.325292 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7ded70-2359-4dd9-aea6-c1412186c3a1-service-ca\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:11:56.410879 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.410845 2579 generic.go:356] "Generic (PLEG): container finished" podID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerID="ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4" exitCode=0 Jul 15 13:11:56.411037 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.410903 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd7478fc-nclhp" Jul 15 13:11:56.411037 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.410920 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd7478fc-nclhp" event={"ID":"5d7ded70-2359-4dd9-aea6-c1412186c3a1","Type":"ContainerDied","Data":"ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4"} Jul 15 13:11:56.411037 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.410969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd7478fc-nclhp" event={"ID":"5d7ded70-2359-4dd9-aea6-c1412186c3a1","Type":"ContainerDied","Data":"f69fe07b5f9b7f452935177d3be9da9d5fb208bc5d10f5e48213f269bd8df3b4"} Jul 15 13:11:56.411037 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.410997 2579 scope.go:117] "RemoveContainer" containerID="ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4" Jul 15 13:11:56.412620 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.412592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc5f7cd5b-jk95r" event={"ID":"f3797b86-5cfc-4c67-87e9-78f1732f3d93","Type":"ContainerStarted","Data":"52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4"} Jul 15 13:11:56.412739 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.412643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc5f7cd5b-jk95r" event={"ID":"f3797b86-5cfc-4c67-87e9-78f1732f3d93","Type":"ContainerStarted","Data":"853f4f00f7cf503e0ff76d37f5a5c09454cb6ac3197ded17113a0a653f448c92"} Jul 15 13:11:56.419539 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.419511 2579 scope.go:117] "RemoveContainer" containerID="ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4" Jul 15 13:11:56.419843 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:11:56.419824 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4\": container with ID starting with ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4 not found: ID does not exist" containerID="ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4" Jul 15 13:11:56.419892 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.419853 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4"} err="failed to get container status \"ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4\": rpc error: code = NotFound desc = could not find container \"ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4\": container with ID starting with ab3b574aefb4e411ae5a272e6adabf9d1280d932ef7bee037f3d693918fb00b4 not found: ID does not exist" Jul 15 13:11:56.437636 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.437588 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cc5f7cd5b-jk95r" podStartSLOduration=1.437574147 podStartE2EDuration="1.437574147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:56.43662319 +0000 UTC m=+327.707731682" watchObservedRunningTime="2026-07-15 13:11:56.437574147 +0000 UTC m=+327.708682647" Jul 15 13:11:56.450249 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.450222 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbd7478fc-nclhp"] Jul 15 13:11:56.455852 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:56.455827 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbd7478fc-nclhp"] Jul 15 13:11:58.352415 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:11:58.352386 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" path="/var/lib/kubelet/pods/5d7ded70-2359-4dd9-aea6-c1412186c3a1/volumes" Jul 15 13:12:01.402489 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:01.402452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:01.588856 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:01.588818 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:05.621041 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:05.621003 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:12:05.621477 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:05.621116 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:12:05.626459 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:05.626435 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:12:06.456388 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:06.456360 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:12:06.512043 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:06.512008 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77b6f49f7b-k8846"] Jul 15 13:12:06.617341 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:06.617302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:06.718585 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:06.718506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:06.788841 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:06.788798 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:31.532649 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.532596 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77b6f49f7b-k8846" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" containerID="cri-o://5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f" gracePeriod=15 Jul 15 13:12:31.775328 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.775307 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:12:31.917333 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917306 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-serving-cert\") pod \"69898214-c76a-465f-a9cb-cc46573de30b\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " Jul 15 13:12:31.917493 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917388 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-oauth-serving-cert\") pod \"69898214-c76a-465f-a9cb-cc46573de30b\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " Jul 15 13:12:31.917493 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917463 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-console-config\") pod \"69898214-c76a-465f-a9cb-cc46573de30b\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " Jul 15 13:12:31.917493 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917489 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-service-ca\") pod \"69898214-c76a-465f-a9cb-cc46573de30b\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " Jul 15 13:12:31.917635 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917548 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmwcj\" (UniqueName: \"kubernetes.io/projected/69898214-c76a-465f-a9cb-cc46573de30b-kube-api-access-wmwcj\") pod \"69898214-c76a-465f-a9cb-cc46573de30b\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " Jul 15 13:12:31.917635 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917592 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-trusted-ca-bundle\") pod \"69898214-c76a-465f-a9cb-cc46573de30b\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " Jul 15 13:12:31.917635 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917623 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-oauth-config\") pod \"69898214-c76a-465f-a9cb-cc46573de30b\" (UID: \"69898214-c76a-465f-a9cb-cc46573de30b\") " Jul 15 13:12:31.917910 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917879 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-console-config" (OuterVolumeSpecName: "console-config") pod "69898214-c76a-465f-a9cb-cc46573de30b" (UID: "69898214-c76a-465f-a9cb-cc46573de30b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:12:31.918001 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917891 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69898214-c76a-465f-a9cb-cc46573de30b" (UID: "69898214-c76a-465f-a9cb-cc46573de30b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:12:31.918001 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.917940 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-service-ca" (OuterVolumeSpecName: "service-ca") pod "69898214-c76a-465f-a9cb-cc46573de30b" (UID: "69898214-c76a-465f-a9cb-cc46573de30b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:12:31.918283 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.918259 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "69898214-c76a-465f-a9cb-cc46573de30b" (UID: "69898214-c76a-465f-a9cb-cc46573de30b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:12:31.919440 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.919399 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69898214-c76a-465f-a9cb-cc46573de30b" (UID: "69898214-c76a-465f-a9cb-cc46573de30b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:12:31.919734 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.919710 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69898214-c76a-465f-a9cb-cc46573de30b-kube-api-access-wmwcj" (OuterVolumeSpecName: "kube-api-access-wmwcj") pod "69898214-c76a-465f-a9cb-cc46573de30b" (UID: "69898214-c76a-465f-a9cb-cc46573de30b"). InnerVolumeSpecName "kube-api-access-wmwcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:12:31.919789 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:31.919734 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69898214-c76a-465f-a9cb-cc46573de30b" (UID: "69898214-c76a-465f-a9cb-cc46573de30b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:12:32.018235 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.018207 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-oauth-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:12:32.018235 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.018232 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-console-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:12:32.018235 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.018241 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-service-ca\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:12:32.018413 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.018249 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmwcj\" (UniqueName: \"kubernetes.io/projected/69898214-c76a-465f-a9cb-cc46573de30b-kube-api-access-wmwcj\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:12:32.018413 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.018258 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69898214-c76a-465f-a9cb-cc46573de30b-trusted-ca-bundle\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:12:32.018413 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.018266 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-oauth-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:12:32.018413 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.018274 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69898214-c76a-465f-a9cb-cc46573de30b-console-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:12:32.547509 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.547468 2579 generic.go:356] "Generic (PLEG): container finished" podID="69898214-c76a-465f-a9cb-cc46573de30b" containerID="5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f" exitCode=0 Jul 15 13:12:32.547888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.547516 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b6f49f7b-k8846" Jul 15 13:12:32.547888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.547556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6f49f7b-k8846" event={"ID":"69898214-c76a-465f-a9cb-cc46573de30b","Type":"ContainerDied","Data":"5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f"} Jul 15 13:12:32.547888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.547610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b6f49f7b-k8846" event={"ID":"69898214-c76a-465f-a9cb-cc46573de30b","Type":"ContainerDied","Data":"c2769203aeb487a5fe9245c7ee2a6f791ba8493679d4f7acaac0df2dbdef0c05"} Jul 15 13:12:32.547888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.547630 2579 scope.go:117] "RemoveContainer" containerID="5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f" Jul 15 13:12:32.555763 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.555746 2579 scope.go:117] "RemoveContainer" containerID="5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f" Jul 15 13:12:32.556004 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:12:32.555986 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f\": container with ID starting with 5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f not found: ID does not exist" containerID="5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f" Jul 15 13:12:32.556048 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.556010 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f"} err="failed to get container status \"5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f\": rpc error: code = NotFound desc = could not find container \"5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f\": container with ID starting with 5e78d29fd2917736ce4680bd7790378f8b5fe9ac001d050ceb7070a54a00ee7f not found: ID does not exist" Jul 15 13:12:32.564047 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.564025 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77b6f49f7b-k8846"] Jul 15 13:12:32.565312 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:32.565292 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77b6f49f7b-k8846"] Jul 15 13:12:34.352228 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:34.352196 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69898214-c76a-465f-a9cb-cc46573de30b" path="/var/lib/kubelet/pods/69898214-c76a-465f-a9cb-cc46573de30b/volumes" Jul 15 13:12:39.817066 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:39.817032 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:39.919410 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:39.919375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:40.094762 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:40.094670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:58.432508 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.432468 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:58.525497 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.525469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:58.772062 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.771976 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9b76fb7b-r2jg8"] Jul 15 13:12:58.772405 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.772386 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" Jul 15 13:12:58.772405 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.772406 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" Jul 15 13:12:58.772579 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.772458 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" Jul 15 13:12:58.772579 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.772467 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" Jul 15 13:12:58.772579 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.772536 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7ded70-2359-4dd9-aea6-c1412186c3a1" containerName="console" Jul 15 13:12:58.772579 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.772548 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="69898214-c76a-465f-a9cb-cc46573de30b" containerName="console" Jul 15 13:12:58.775502 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.775481 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.792615 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.792593 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9b76fb7b-r2jg8"] Jul 15 13:12:58.806569 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.806535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-oauth-serving-cert\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.806666 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.806589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98q22\" (UniqueName: \"kubernetes.io/projected/29f6906c-1d45-4e10-b374-f0b40f992889-kube-api-access-98q22\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.806666 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.806624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-serving-cert\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.806666 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.806658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-oauth-config\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.806788 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.806678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-console-config\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.806788 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.806706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-service-ca\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.806788 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.806727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-trusted-ca-bundle\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.840848 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.840818 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:58.908048 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.908020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98q22\" (UniqueName: \"kubernetes.io/projected/29f6906c-1d45-4e10-b374-f0b40f992889-kube-api-access-98q22\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.908167 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.908064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-serving-cert\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.908227 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.908180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-oauth-config\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.908304 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.908283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-console-config\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.908359 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.908336 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-service-ca\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.908412 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.908360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-trusted-ca-bundle\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.908412 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.908392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-oauth-serving-cert\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.909099 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.909055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-service-ca\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.909231 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.909112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-console-config\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.909288 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.909226 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-oauth-serving-cert\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.909756 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.909734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-trusted-ca-bundle\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.910755 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.910734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-serving-cert\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.910853 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.910831 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-oauth-config\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.916015 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.915993 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98q22\" (UniqueName: \"kubernetes.io/projected/29f6906c-1d45-4e10-b374-f0b40f992889-kube-api-access-98q22\") pod \"console-7f9b76fb7b-r2jg8\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:58.944099 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:58.944068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:59.042772 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.042675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:59.085030 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.085002 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:12:59.230571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.230551 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9b76fb7b-r2jg8"] Jul 15 13:12:59.232656 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:12:59.232631 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f6906c_1d45_4e10_b374_f0b40f992889.slice/crio-45061d0a8da9843babf1a2d1d74b0f0c7817466551e360f6031d7e4692892dc5 WatchSource:0}: Error finding container 45061d0a8da9843babf1a2d1d74b0f0c7817466551e360f6031d7e4692892dc5: Status 404 returned error can't find the container with id 45061d0a8da9843babf1a2d1d74b0f0c7817466551e360f6031d7e4692892dc5 Jul 15 13:12:59.582272 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.582237 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:59.649409 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.649378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9b76fb7b-r2jg8" event={"ID":"29f6906c-1d45-4e10-b374-f0b40f992889","Type":"ContainerStarted","Data":"4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89"} Jul 15 13:12:59.649541 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.649442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9b76fb7b-r2jg8" event={"ID":"29f6906c-1d45-4e10-b374-f0b40f992889","Type":"ContainerStarted","Data":"45061d0a8da9843babf1a2d1d74b0f0c7817466551e360f6031d7e4692892dc5"} Jul 15 13:12:59.669292 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.669250 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f9b76fb7b-r2jg8" podStartSLOduration=1.669235706 podStartE2EDuration="1.669235706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:59.668303825 +0000 UTC m=+390.939412337" watchObservedRunningTime="2026-07-15 13:12:59.669235706 +0000 UTC m=+390.940344275" Jul 15 13:12:59.673337 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:12:59.673310 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:09.085169 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:09.085103 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:13:09.085627 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:09.085196 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:13:09.090414 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:09.090391 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:13:09.692168 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:09.692136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:13:09.737818 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:09.737784 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc5f7cd5b-jk95r"] Jul 15 13:13:09.864842 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:09.864808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:09.965639 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:09.965555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:10.042087 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:10.042054 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:10.351597 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:10.351498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:10.425888 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:10.425856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:16.377180 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:16.377144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:16.477920 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:16.477890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:16.559419 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:16.559389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:13:34.759217 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:34.759155 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cc5f7cd5b-jk95r" podUID="f3797b86-5cfc-4c67-87e9-78f1732f3d93" containerName="console" containerID="cri-o://52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4" gracePeriod=15 Jul 15 13:13:35.004058 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.004030 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:13:35.085323 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085259 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-oauth-serving-cert\") pod \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " Jul 15 13:13:35.085323 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085313 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-config\") pod \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " Jul 15 13:13:35.085519 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085345 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsjcl\" (UniqueName: \"kubernetes.io/projected/f3797b86-5cfc-4c67-87e9-78f1732f3d93-kube-api-access-gsjcl\") pod \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " Jul 15 13:13:35.085519 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085369 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-trusted-ca-bundle\") pod \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " Jul 15 13:13:35.085519 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085409 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-serving-cert\") pod \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " Jul 15 13:13:35.085519 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085469 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-oauth-config\") pod \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " Jul 15 13:13:35.085519 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085498 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-service-ca\") pod \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\" (UID: \"f3797b86-5cfc-4c67-87e9-78f1732f3d93\") " Jul 15 13:13:35.085777 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085653 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f3797b86-5cfc-4c67-87e9-78f1732f3d93" (UID: "f3797b86-5cfc-4c67-87e9-78f1732f3d93"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:13:35.085834 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085792 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-config" (OuterVolumeSpecName: "console-config") pod "f3797b86-5cfc-4c67-87e9-78f1732f3d93" (UID: "f3797b86-5cfc-4c67-87e9-78f1732f3d93"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:13:35.085834 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085810 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-oauth-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:13:35.085988 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.085953 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f3797b86-5cfc-4c67-87e9-78f1732f3d93" (UID: "f3797b86-5cfc-4c67-87e9-78f1732f3d93"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:13:35.086162 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.086046 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3797b86-5cfc-4c67-87e9-78f1732f3d93" (UID: "f3797b86-5cfc-4c67-87e9-78f1732f3d93"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:13:35.087502 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.087480 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f3797b86-5cfc-4c67-87e9-78f1732f3d93" (UID: "f3797b86-5cfc-4c67-87e9-78f1732f3d93"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:13:35.087619 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.087603 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f3797b86-5cfc-4c67-87e9-78f1732f3d93" (UID: "f3797b86-5cfc-4c67-87e9-78f1732f3d93"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:13:35.087661 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.087621 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3797b86-5cfc-4c67-87e9-78f1732f3d93-kube-api-access-gsjcl" (OuterVolumeSpecName: "kube-api-access-gsjcl") pod "f3797b86-5cfc-4c67-87e9-78f1732f3d93" (UID: "f3797b86-5cfc-4c67-87e9-78f1732f3d93"). InnerVolumeSpecName "kube-api-access-gsjcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:13:35.187087 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.187057 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-oauth-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:13:35.187087 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.187082 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-service-ca\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:13:35.187087 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.187091 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:13:35.187274 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.187100 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsjcl\" (UniqueName: \"kubernetes.io/projected/f3797b86-5cfc-4c67-87e9-78f1732f3d93-kube-api-access-gsjcl\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:13:35.187274 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.187110 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3797b86-5cfc-4c67-87e9-78f1732f3d93-trusted-ca-bundle\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:13:35.187274 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.187118 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3797b86-5cfc-4c67-87e9-78f1732f3d93-console-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:13:35.786789 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.786754 2579 generic.go:356] "Generic (PLEG): container finished" podID="f3797b86-5cfc-4c67-87e9-78f1732f3d93" containerID="52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4" exitCode=0 Jul 15 13:13:35.787194 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.786799 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc5f7cd5b-jk95r" Jul 15 13:13:35.787194 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.786845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc5f7cd5b-jk95r" event={"ID":"f3797b86-5cfc-4c67-87e9-78f1732f3d93","Type":"ContainerDied","Data":"52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4"} Jul 15 13:13:35.787194 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.786903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc5f7cd5b-jk95r" event={"ID":"f3797b86-5cfc-4c67-87e9-78f1732f3d93","Type":"ContainerDied","Data":"853f4f00f7cf503e0ff76d37f5a5c09454cb6ac3197ded17113a0a653f448c92"} Jul 15 13:13:35.787194 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.786924 2579 scope.go:117] "RemoveContainer" containerID="52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4" Jul 15 13:13:35.795701 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.795681 2579 scope.go:117] "RemoveContainer" containerID="52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4" Jul 15 13:13:35.795944 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:13:35.795925 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4\": container with ID starting with 52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4 not found: ID does not exist" containerID="52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4" Jul 15 13:13:35.795998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.795952 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4"} err="failed to get container status \"52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4\": rpc error: code = NotFound desc = could not find container \"52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4\": container with ID starting with 52ab61b20035796940da93c5a5fc84a3d3fff03a4d9eb8f9e3f3c1855ee773a4 not found: ID does not exist" Jul 15 13:13:35.806983 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.806961 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc5f7cd5b-jk95r"] Jul 15 13:13:35.810278 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:35.810256 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cc5f7cd5b-jk95r"] Jul 15 13:13:36.352731 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:36.352698 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3797b86-5cfc-4c67-87e9-78f1732f3d93" path="/var/lib/kubelet/pods/f3797b86-5cfc-4c67-87e9-78f1732f3d93/volumes" Jul 15 13:13:37.674787 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:13:37.674740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:10.393393 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:10.393357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:10.491523 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:10.491487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:11.533721 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.533680 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh"] Jul 15 13:14:11.534073 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.533995 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3797b86-5cfc-4c67-87e9-78f1732f3d93" containerName="console" Jul 15 13:14:11.534073 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.534007 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3797b86-5cfc-4c67-87e9-78f1732f3d93" containerName="console" Jul 15 13:14:11.534073 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.534050 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3797b86-5cfc-4c67-87e9-78f1732f3d93" containerName="console" Jul 15 13:14:11.536930 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.536909 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.539580 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.539558 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:14:11.539580 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.539574 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:14:11.540516 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.540484 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whlrm\"" Jul 15 13:14:11.549015 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.548995 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh"] Jul 15 13:14:11.558828 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.558803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jx7\" (UniqueName: \"kubernetes.io/projected/c86bc087-585d-44fc-b38d-c0966b3e3edd-kube-api-access-h9jx7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.558909 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.558848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.558947 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.558919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.660130 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.660091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jx7\" (UniqueName: \"kubernetes.io/projected/c86bc087-585d-44fc-b38d-c0966b3e3edd-kube-api-access-h9jx7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.660130 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.660132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.660353 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.660162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.660517 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.660498 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.660559 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.660522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.672944 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.672917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jx7\" (UniqueName: \"kubernetes.io/projected/c86bc087-585d-44fc-b38d-c0966b3e3edd-kube-api-access-h9jx7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.845691 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.845602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:11.973512 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:11.973485 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh"] Jul 15 13:14:11.976800 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:14:11.976770 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86bc087_585d_44fc_b38d_c0966b3e3edd.slice/crio-365876e79a94240112dc86111dec62f6150d9f6f44dc467c290b92957ed5fedd WatchSource:0}: Error finding container 365876e79a94240112dc86111dec62f6150d9f6f44dc467c290b92957ed5fedd: Status 404 returned error can't find the container with id 365876e79a94240112dc86111dec62f6150d9f6f44dc467c290b92957ed5fedd Jul 15 13:14:12.935440 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:12.935385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" event={"ID":"c86bc087-585d-44fc-b38d-c0966b3e3edd","Type":"ContainerStarted","Data":"365876e79a94240112dc86111dec62f6150d9f6f44dc467c290b92957ed5fedd"} Jul 15 13:14:17.958742 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:17.958707 2579 generic.go:356] "Generic (PLEG): container finished" podID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerID="d578752af1e9e3ec1d46077409e2ff54e14970752177455df078504c2cd628ff" exitCode=0 Jul 15 13:14:17.959223 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:17.958749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" event={"ID":"c86bc087-585d-44fc-b38d-c0966b3e3edd","Type":"ContainerDied","Data":"d578752af1e9e3ec1d46077409e2ff54e14970752177455df078504c2cd628ff"} Jul 15 13:14:20.973142 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:20.973107 2579 generic.go:356] "Generic (PLEG): container finished" podID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerID="ed3313927edefc367338b0fd426f48c69b4a1a1493a96ba750b5c90927cfd27e" exitCode=0 Jul 15 13:14:20.973538 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:20.973177 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" event={"ID":"c86bc087-585d-44fc-b38d-c0966b3e3edd","Type":"ContainerDied","Data":"ed3313927edefc367338b0fd426f48c69b4a1a1493a96ba750b5c90927cfd27e"} Jul 15 13:14:28.004269 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:28.004237 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" event={"ID":"c86bc087-585d-44fc-b38d-c0966b3e3edd","Type":"ContainerStarted","Data":"de1289663fdcccc72e4b6b5fb56a9e41191c7a1f83af41cf1fce61bf96190ccb"} Jul 15 13:14:28.024298 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:28.024251 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" podStartSLOduration=3.109990981 podStartE2EDuration="17.024237441s" totalImagesPullingTime="13.91424646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:28.022946116 +0000 UTC m=+479.294054637" watchObservedRunningTime="2026-07-15 13:14:28.024237441 +0000 UTC m=+479.295345940" Jul 15 13:14:29.010131 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:29.010096 2579 generic.go:356] "Generic (PLEG): container finished" podID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerID="de1289663fdcccc72e4b6b5fb56a9e41191c7a1f83af41cf1fce61bf96190ccb" exitCode=0 Jul 15 13:14:29.010511 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:29.010186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" event={"ID":"c86bc087-585d-44fc-b38d-c0966b3e3edd","Type":"ContainerDied","Data":"de1289663fdcccc72e4b6b5fb56a9e41191c7a1f83af41cf1fce61bf96190ccb"} Jul 15 13:14:30.136505 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.136482 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:30.213582 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.213557 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9jx7\" (UniqueName: \"kubernetes.io/projected/c86bc087-585d-44fc-b38d-c0966b3e3edd-kube-api-access-h9jx7\") pod \"c86bc087-585d-44fc-b38d-c0966b3e3edd\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " Jul 15 13:14:30.213744 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.213604 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-bundle\") pod \"c86bc087-585d-44fc-b38d-c0966b3e3edd\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " Jul 15 13:14:30.213744 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.213626 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-util\") pod \"c86bc087-585d-44fc-b38d-c0966b3e3edd\" (UID: \"c86bc087-585d-44fc-b38d-c0966b3e3edd\") " Jul 15 13:14:30.214241 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.214206 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-bundle" (OuterVolumeSpecName: "bundle") pod "c86bc087-585d-44fc-b38d-c0966b3e3edd" (UID: "c86bc087-585d-44fc-b38d-c0966b3e3edd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:14:30.215733 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.215713 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86bc087-585d-44fc-b38d-c0966b3e3edd-kube-api-access-h9jx7" (OuterVolumeSpecName: "kube-api-access-h9jx7") pod "c86bc087-585d-44fc-b38d-c0966b3e3edd" (UID: "c86bc087-585d-44fc-b38d-c0966b3e3edd"). InnerVolumeSpecName "kube-api-access-h9jx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:14:30.217920 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.217901 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-util" (OuterVolumeSpecName: "util") pod "c86bc087-585d-44fc-b38d-c0966b3e3edd" (UID: "c86bc087-585d-44fc-b38d-c0966b3e3edd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:14:30.314121 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.314097 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9jx7\" (UniqueName: \"kubernetes.io/projected/c86bc087-585d-44fc-b38d-c0966b3e3edd-kube-api-access-h9jx7\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:14:30.314121 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.314119 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-bundle\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:14:30.314303 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:30.314128 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86bc087-585d-44fc-b38d-c0966b3e3edd-util\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:14:31.019097 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:31.019063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" event={"ID":"c86bc087-585d-44fc-b38d-c0966b3e3edd","Type":"ContainerDied","Data":"365876e79a94240112dc86111dec62f6150d9f6f44dc467c290b92957ed5fedd"} Jul 15 13:14:31.019266 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:31.019104 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sdtgh" Jul 15 13:14:31.019266 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:31.019114 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="365876e79a94240112dc86111dec62f6150d9f6f44dc467c290b92957ed5fedd" Jul 15 13:14:32.775005 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:32.774972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:34.153893 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.153848 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:34.778846 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.778814 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls"] Jul 15 13:14:34.779096 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.779085 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerName="pull" Jul 15 13:14:34.779147 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.779097 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerName="pull" Jul 15 13:14:34.779147 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.779121 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerName="util" Jul 15 13:14:34.779147 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.779126 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerName="util" Jul 15 13:14:34.779147 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.779132 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerName="extract" Jul 15 13:14:34.779147 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.779137 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerName="extract" Jul 15 13:14:34.779308 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.779181 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86bc087-585d-44fc-b38d-c0966b3e3edd" containerName="extract" Jul 15 13:14:34.821393 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.821363 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls"] Jul 15 13:14:34.821548 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.821479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:34.823794 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.823772 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:14:34.823925 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.823812 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 13:14:34.823925 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.823874 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mqw9f\"" Jul 15 13:14:34.947112 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.947081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a17a743a-63b2-44f5-969a-2d6af5888522-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-flqls\" (UID: \"a17a743a-63b2-44f5-969a-2d6af5888522\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:34.947278 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:34.947126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gql5g\" (UniqueName: \"kubernetes.io/projected/a17a743a-63b2-44f5-969a-2d6af5888522-kube-api-access-gql5g\") pod \"cert-manager-operator-controller-manager-56b4598547-flqls\" (UID: \"a17a743a-63b2-44f5-969a-2d6af5888522\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:35.047845 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:35.047770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a17a743a-63b2-44f5-969a-2d6af5888522-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-flqls\" (UID: \"a17a743a-63b2-44f5-969a-2d6af5888522\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:35.047845 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:35.047808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gql5g\" (UniqueName: \"kubernetes.io/projected/a17a743a-63b2-44f5-969a-2d6af5888522-kube-api-access-gql5g\") pod \"cert-manager-operator-controller-manager-56b4598547-flqls\" (UID: \"a17a743a-63b2-44f5-969a-2d6af5888522\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:35.048186 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:35.048166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a17a743a-63b2-44f5-969a-2d6af5888522-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-flqls\" (UID: \"a17a743a-63b2-44f5-969a-2d6af5888522\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:35.055682 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:35.055665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gql5g\" (UniqueName: \"kubernetes.io/projected/a17a743a-63b2-44f5-969a-2d6af5888522-kube-api-access-gql5g\") pod \"cert-manager-operator-controller-manager-56b4598547-flqls\" (UID: \"a17a743a-63b2-44f5-969a-2d6af5888522\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:35.130630 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:35.130602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" Jul 15 13:14:35.277775 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:35.277748 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls"] Jul 15 13:14:35.280655 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:14:35.280629 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17a743a_63b2_44f5_969a_2d6af5888522.slice/crio-142432fa1cfb46ab4dbd25a766446622f345a094149aafd6e1dbb103eda24f93 WatchSource:0}: Error finding container 142432fa1cfb46ab4dbd25a766446622f345a094149aafd6e1dbb103eda24f93: Status 404 returned error can't find the container with id 142432fa1cfb46ab4dbd25a766446622f345a094149aafd6e1dbb103eda24f93 Jul 15 13:14:36.040035 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:36.039992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" event={"ID":"a17a743a-63b2-44f5-969a-2d6af5888522","Type":"ContainerStarted","Data":"142432fa1cfb46ab4dbd25a766446622f345a094149aafd6e1dbb103eda24f93"} Jul 15 13:14:36.383187 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:36.383111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:36.453207 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:36.453176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:38.050974 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.050933 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" event={"ID":"a17a743a-63b2-44f5-969a-2d6af5888522","Type":"ContainerStarted","Data":"072d551b17e97f52d3af408188dcf5e8eef031b10c14abbb80537cf84f12deaf"} Jul 15 13:14:38.386300 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.386222 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:38.486439 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.486406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:38.772708 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.772658 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-flqls" podStartSLOduration=2.614078743 podStartE2EDuration="4.772639612s" totalImagesPullingTime="2.158560869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:38.072671897 +0000 UTC m=+489.343780400" watchObservedRunningTime="2026-07-15 13:14:38.772639612 +0000 UTC m=+490.043748112" Jul 15 13:14:38.773852 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.773832 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fxczl"] Jul 15 13:14:38.796540 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.796516 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fxczl"] Jul 15 13:14:38.796655 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.796598 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:38.799116 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.799091 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 13:14:38.799242 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.799125 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 13:14:38.799930 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.799893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qx7jl\"" Jul 15 13:14:38.880400 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.880373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fxczl\" (UID: \"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:38.880541 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.880404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvs6j\" (UniqueName: \"kubernetes.io/projected/ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b-kube-api-access-rvs6j\") pod \"cert-manager-webhook-6486ffd997-fxczl\" (UID: \"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:38.981637 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.981613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fxczl\" (UID: \"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:38.981769 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.981642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvs6j\" (UniqueName: \"kubernetes.io/projected/ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b-kube-api-access-rvs6j\") pod \"cert-manager-webhook-6486ffd997-fxczl\" (UID: \"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:38.990244 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.990217 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fxczl\" (UID: \"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:38.990482 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:38.990462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvs6j\" (UniqueName: \"kubernetes.io/projected/ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b-kube-api-access-rvs6j\") pod \"cert-manager-webhook-6486ffd997-fxczl\" (UID: \"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:39.117959 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:39.117886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:39.258101 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:39.258079 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fxczl"] Jul 15 13:14:39.259968 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:14:39.259940 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab0ac4f8_7b60_4eb3_a494_2cadf067ea2b.slice/crio-e9f5a109a473d643f62bd2de8a9fbfc8745afb5f30ccf8f1c88a431ca80a593a WatchSource:0}: Error finding container e9f5a109a473d643f62bd2de8a9fbfc8745afb5f30ccf8f1c88a431ca80a593a: Status 404 returned error can't find the container with id e9f5a109a473d643f62bd2de8a9fbfc8745afb5f30ccf8f1c88a431ca80a593a Jul 15 13:14:40.061278 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:40.061235 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" event={"ID":"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b","Type":"ContainerStarted","Data":"e9f5a109a473d643f62bd2de8a9fbfc8745afb5f30ccf8f1c88a431ca80a593a"} Jul 15 13:14:40.786810 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:40.786777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:41.013794 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:41.013761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:41.114441 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:41.114338 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:41.214115 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:41.214082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:43.076234 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:43.076203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" event={"ID":"ab0ac4f8-7b60-4eb3-a494-2cadf067ea2b","Type":"ContainerStarted","Data":"a3733c11e238efeeb6786c3b870e9c1f650833db249bc506a93403b4a0dab67d"} Jul 15 13:14:43.076746 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:43.076324 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:43.094900 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:43.094849 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" podStartSLOduration=2.086871911 podStartE2EDuration="5.094837093s" totalImagesPullingTime="3.007965182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:43.093305206 +0000 UTC m=+494.364413718" watchObservedRunningTime="2026-07-15 13:14:43.094837093 +0000 UTC m=+494.365945594" Jul 15 13:14:48.009654 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.009619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:48.713227 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.713193 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grwbl"] Jul 15 13:14:48.715483 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.715468 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:48.717971 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.717946 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-56fbh\"" Jul 15 13:14:48.728768 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.728741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grwbl"] Jul 15 13:14:48.858719 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.858698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnjg\" (UniqueName: \"kubernetes.io/projected/1c9c4406-57ad-44a3-9d8a-1a4fb580a619-kube-api-access-qvnjg\") pod \"cert-manager-55b4d954d5-grwbl\" (UID: \"1c9c4406-57ad-44a3-9d8a-1a4fb580a619\") " pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:48.858838 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.858742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c9c4406-57ad-44a3-9d8a-1a4fb580a619-bound-sa-token\") pod \"cert-manager-55b4d954d5-grwbl\" (UID: \"1c9c4406-57ad-44a3-9d8a-1a4fb580a619\") " pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:48.959576 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.959540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c9c4406-57ad-44a3-9d8a-1a4fb580a619-bound-sa-token\") pod \"cert-manager-55b4d954d5-grwbl\" (UID: \"1c9c4406-57ad-44a3-9d8a-1a4fb580a619\") " pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:48.959710 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.959637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnjg\" (UniqueName: \"kubernetes.io/projected/1c9c4406-57ad-44a3-9d8a-1a4fb580a619-kube-api-access-qvnjg\") pod \"cert-manager-55b4d954d5-grwbl\" (UID: \"1c9c4406-57ad-44a3-9d8a-1a4fb580a619\") " pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:48.969454 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.969374 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c9c4406-57ad-44a3-9d8a-1a4fb580a619-bound-sa-token\") pod \"cert-manager-55b4d954d5-grwbl\" (UID: \"1c9c4406-57ad-44a3-9d8a-1a4fb580a619\") " pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:48.969542 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:48.969520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnjg\" (UniqueName: \"kubernetes.io/projected/1c9c4406-57ad-44a3-9d8a-1a4fb580a619-kube-api-access-qvnjg\") pod \"cert-manager-55b4d954d5-grwbl\" (UID: \"1c9c4406-57ad-44a3-9d8a-1a4fb580a619\") " pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:49.024440 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:49.024403 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grwbl" Jul 15 13:14:49.083154 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:49.083124 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fxczl" Jul 15 13:14:49.157163 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:49.157130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grwbl"] Jul 15 13:14:49.160368 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:14:49.160343 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c9c4406_57ad_44a3_9d8a_1a4fb580a619.slice/crio-82c54788dea9cce96463b8a9e33036d32403680b679ce33b2a3951819f450d4a WatchSource:0}: Error finding container 82c54788dea9cce96463b8a9e33036d32403680b679ce33b2a3951819f450d4a: Status 404 returned error can't find the container with id 82c54788dea9cce96463b8a9e33036d32403680b679ce33b2a3951819f450d4a Jul 15 13:14:50.043881 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:50.043845 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:50.114858 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:50.114829 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grwbl" event={"ID":"1c9c4406-57ad-44a3-9d8a-1a4fb580a619","Type":"ContainerStarted","Data":"a4555a7e1e5c8e3f8b97cf5a0aa4215f6cff055e3d6bf68d0c7ba66098820ede"} Jul 15 13:14:50.114997 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:50.114868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grwbl" event={"ID":"1c9c4406-57ad-44a3-9d8a-1a4fb580a619","Type":"ContainerStarted","Data":"82c54788dea9cce96463b8a9e33036d32403680b679ce33b2a3951819f450d4a"} Jul 15 13:14:50.132872 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:50.132833 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-grwbl" podStartSLOduration=2.132820515 podStartE2EDuration="2.132820515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:50.13234524 +0000 UTC m=+501.403453744" watchObservedRunningTime="2026-07-15 13:14:50.132820515 +0000 UTC m=+501.403929014" Jul 15 13:14:50.313965 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:50.313879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:51.214029 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.213991 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh"] Jul 15 13:14:51.216375 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.216353 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.219060 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.219039 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:14:51.219804 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.219788 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whlrm\"" Jul 15 13:14:51.219899 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.219790 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:14:51.230847 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.230822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh"] Jul 15 13:14:51.383281 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.383251 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.383281 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.383283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.383472 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.383349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwtd\" (UniqueName: \"kubernetes.io/projected/38c1885e-7637-4dca-830d-b3242f49330b-kube-api-access-llwtd\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.484044 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.483966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwtd\" (UniqueName: \"kubernetes.io/projected/38c1885e-7637-4dca-830d-b3242f49330b-kube-api-access-llwtd\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.484044 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.484020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.484044 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.484040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.484348 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.484334 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.484401 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.484366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.492959 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.492931 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwtd\" (UniqueName: \"kubernetes.io/projected/38c1885e-7637-4dca-830d-b3242f49330b-kube-api-access-llwtd\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.525856 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.525834 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:51.649270 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.649244 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh"] Jul 15 13:14:51.651375 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:14:51.651350 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c1885e_7637_4dca_830d_b3242f49330b.slice/crio-df558d0404bd0f3f50ac096dad9e530ae41f5652d162453cef7b14ad2a0a3c49 WatchSource:0}: Error finding container df558d0404bd0f3f50ac096dad9e530ae41f5652d162453cef7b14ad2a0a3c49: Status 404 returned error can't find the container with id df558d0404bd0f3f50ac096dad9e530ae41f5652d162453cef7b14ad2a0a3c49 Jul 15 13:14:51.831710 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:51.831681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:14:52.125147 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:52.125062 2579 generic.go:356] "Generic (PLEG): container finished" podID="38c1885e-7637-4dca-830d-b3242f49330b" containerID="dc0c9d62c05aa4a1e981b48252ff6748839a22004363db8c703fc096cfcd9fd7" exitCode=0 Jul 15 13:14:52.125147 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:52.125127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" event={"ID":"38c1885e-7637-4dca-830d-b3242f49330b","Type":"ContainerDied","Data":"dc0c9d62c05aa4a1e981b48252ff6748839a22004363db8c703fc096cfcd9fd7"} Jul 15 13:14:52.125323 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:52.125168 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" event={"ID":"38c1885e-7637-4dca-830d-b3242f49330b","Type":"ContainerStarted","Data":"df558d0404bd0f3f50ac096dad9e530ae41f5652d162453cef7b14ad2a0a3c49"} Jul 15 13:14:55.145321 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:55.145288 2579 generic.go:356] "Generic (PLEG): container finished" podID="38c1885e-7637-4dca-830d-b3242f49330b" containerID="60a11f02e69a3311e3247a60a0c69ef9dd285b40b646ea3a8a7a9dd88bcd5eb7" exitCode=0 Jul 15 13:14:55.145755 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:55.145377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" event={"ID":"38c1885e-7637-4dca-830d-b3242f49330b","Type":"ContainerDied","Data":"60a11f02e69a3311e3247a60a0c69ef9dd285b40b646ea3a8a7a9dd88bcd5eb7"} Jul 15 13:14:56.154047 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:56.154014 2579 generic.go:356] "Generic (PLEG): container finished" podID="38c1885e-7637-4dca-830d-b3242f49330b" containerID="179f0b22810b4877a495d8b2e382e98f121fbb1500da8fcb6bfcedd6e07e7ae0" exitCode=0 Jul 15 13:14:56.154411 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:56.154048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" event={"ID":"38c1885e-7637-4dca-830d-b3242f49330b","Type":"ContainerDied","Data":"179f0b22810b4877a495d8b2e382e98f121fbb1500da8fcb6bfcedd6e07e7ae0"} Jul 15 13:14:57.281624 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.281601 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:57.433505 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.433476 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llwtd\" (UniqueName: \"kubernetes.io/projected/38c1885e-7637-4dca-830d-b3242f49330b-kube-api-access-llwtd\") pod \"38c1885e-7637-4dca-830d-b3242f49330b\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " Jul 15 13:14:57.433671 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.433552 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-util\") pod \"38c1885e-7637-4dca-830d-b3242f49330b\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " Jul 15 13:14:57.433671 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.433604 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-bundle\") pod \"38c1885e-7637-4dca-830d-b3242f49330b\" (UID: \"38c1885e-7637-4dca-830d-b3242f49330b\") " Jul 15 13:14:57.434035 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.434009 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-bundle" (OuterVolumeSpecName: "bundle") pod "38c1885e-7637-4dca-830d-b3242f49330b" (UID: "38c1885e-7637-4dca-830d-b3242f49330b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:14:57.435593 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.435573 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38c1885e-7637-4dca-830d-b3242f49330b-kube-api-access-llwtd" (OuterVolumeSpecName: "kube-api-access-llwtd") pod "38c1885e-7637-4dca-830d-b3242f49330b" (UID: "38c1885e-7637-4dca-830d-b3242f49330b"). InnerVolumeSpecName "kube-api-access-llwtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:14:57.440320 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.440296 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-util" (OuterVolumeSpecName: "util") pod "38c1885e-7637-4dca-830d-b3242f49330b" (UID: "38c1885e-7637-4dca-830d-b3242f49330b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:14:57.534614 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.534589 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-bundle\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:14:57.534614 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.534610 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llwtd\" (UniqueName: \"kubernetes.io/projected/38c1885e-7637-4dca-830d-b3242f49330b-kube-api-access-llwtd\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:14:57.534758 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:57.534620 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1885e-7637-4dca-830d-b3242f49330b-util\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:14:58.165021 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:58.164993 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" Jul 15 13:14:58.165021 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:58.164999 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5sjjh" event={"ID":"38c1885e-7637-4dca-830d-b3242f49330b","Type":"ContainerDied","Data":"df558d0404bd0f3f50ac096dad9e530ae41f5652d162453cef7b14ad2a0a3c49"} Jul 15 13:14:58.165263 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:14:58.165051 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df558d0404bd0f3f50ac096dad9e530ae41f5652d162453cef7b14ad2a0a3c49" Jul 15 13:15:01.386485 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:01.386450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:01.486039 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:01.486005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:06.106584 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:06.106537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:11.616265 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:11.616229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:13.311672 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.311639 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc"] Jul 15 13:15:13.312109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.311971 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c1885e-7637-4dca-830d-b3242f49330b" containerName="util" Jul 15 13:15:13.312109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.311984 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c1885e-7637-4dca-830d-b3242f49330b" containerName="util" Jul 15 13:15:13.312109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.311996 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c1885e-7637-4dca-830d-b3242f49330b" containerName="extract" Jul 15 13:15:13.312109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.312002 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c1885e-7637-4dca-830d-b3242f49330b" containerName="extract" Jul 15 13:15:13.312109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.312011 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c1885e-7637-4dca-830d-b3242f49330b" containerName="pull" Jul 15 13:15:13.312109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.312016 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c1885e-7637-4dca-830d-b3242f49330b" containerName="pull" Jul 15 13:15:13.312109 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.312069 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38c1885e-7637-4dca-830d-b3242f49330b" containerName="extract" Jul 15 13:15:13.316165 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.316147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.318766 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.318743 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 15 13:15:13.319402 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.319386 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 15 13:15:13.319555 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.319508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:15:13.319645 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.319569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 15 13:15:13.319645 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.319614 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-7gdwp\"" Jul 15 13:15:13.319757 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.319736 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 15 13:15:13.327011 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.326991 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc"] Jul 15 13:15:13.354571 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.354544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlz42\" (UniqueName: \"kubernetes.io/projected/c7a123dd-6d42-4cba-879c-a12d85e1fe47-kube-api-access-zlz42\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.354657 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.354577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a123dd-6d42-4cba-879c-a12d85e1fe47-metrics-certs\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.354657 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.354607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7a123dd-6d42-4cba-879c-a12d85e1fe47-manager-config\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.354730 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.354695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7a123dd-6d42-4cba-879c-a12d85e1fe47-cert\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.455840 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.455818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlz42\" (UniqueName: \"kubernetes.io/projected/c7a123dd-6d42-4cba-879c-a12d85e1fe47-kube-api-access-zlz42\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.455929 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.455850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a123dd-6d42-4cba-879c-a12d85e1fe47-metrics-certs\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.455929 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.455880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7a123dd-6d42-4cba-879c-a12d85e1fe47-manager-config\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.455929 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.455924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7a123dd-6d42-4cba-879c-a12d85e1fe47-cert\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.456588 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.456570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7a123dd-6d42-4cba-879c-a12d85e1fe47-manager-config\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.458496 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.458478 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7a123dd-6d42-4cba-879c-a12d85e1fe47-cert\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.458554 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.458534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a123dd-6d42-4cba-879c-a12d85e1fe47-metrics-certs\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.465583 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.465558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlz42\" (UniqueName: \"kubernetes.io/projected/c7a123dd-6d42-4cba-879c-a12d85e1fe47-kube-api-access-zlz42\") pod \"jobset-controller-manager-c7f7f7d84-8stwc\" (UID: \"c7a123dd-6d42-4cba-879c-a12d85e1fe47\") " pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.585873 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.585807 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:13.626632 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.626606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:13.754535 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:13.754509 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc"] Jul 15 13:15:13.756401 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:15:13.756375 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a123dd_6d42_4cba_879c_a12d85e1fe47.slice/crio-822e2bd835c0de1bd7cf42f55ebe8598d80d98e53ae5da645c2dd671fd0a200a WatchSource:0}: Error finding container 822e2bd835c0de1bd7cf42f55ebe8598d80d98e53ae5da645c2dd671fd0a200a: Status 404 returned error can't find the container with id 822e2bd835c0de1bd7cf42f55ebe8598d80d98e53ae5da645c2dd671fd0a200a Jul 15 13:15:14.081747 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:14.081720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:14.239511 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:14.239480 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" event={"ID":"c7a123dd-6d42-4cba-879c-a12d85e1fe47","Type":"ContainerStarted","Data":"822e2bd835c0de1bd7cf42f55ebe8598d80d98e53ae5da645c2dd671fd0a200a"} Jul 15 13:15:16.250936 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:16.250908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" event={"ID":"c7a123dd-6d42-4cba-879c-a12d85e1fe47","Type":"ContainerStarted","Data":"ae96ee9f87fcbcf43b45e9edfeae50c70b0c74483ab7f29c776b8c93a549b1a6"} Jul 15 13:15:16.251253 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:16.251033 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:16.271295 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:16.271252 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" podStartSLOduration=0.869665137 podStartE2EDuration="3.271239419s" totalImagesPullingTime="2.401574282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:16.269234481 +0000 UTC m=+527.540342995" watchObservedRunningTime="2026-07-15 13:15:16.271239419 +0000 UTC m=+527.542347918" Jul 15 13:15:27.261507 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:27.261474 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-c7f7f7d84-8stwc" Jul 15 13:15:27.520384 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:27.520303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:27.621579 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:27.621546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:30.449036 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:30.448998 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:31.418995 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:31.418963 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:32.275468 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:32.275403 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:35.529249 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:15:35.529212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:37.201482 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:16:37.201449 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:37.299087 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:16:37.299056 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:59.759877 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:16:59.759796 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:59.883498 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:16:59.883449 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:59.970134 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:16:59.970098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:05.618268 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.618232 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67d45b7d6c-dtzcx"] Jul 15 13:17:05.621332 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.621314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.634133 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.634105 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d45b7d6c-dtzcx"] Jul 15 13:17:05.701189 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.701161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:05.724099 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.724076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07dfff04-9076-489b-985b-95ed83de3f7c-console-oauth-config\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.724213 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.724110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kstr\" (UniqueName: \"kubernetes.io/projected/07dfff04-9076-489b-985b-95ed83de3f7c-kube-api-access-2kstr\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.724213 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.724138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-oauth-serving-cert\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.724213 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.724185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07dfff04-9076-489b-985b-95ed83de3f7c-console-serving-cert\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.724365 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.724236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-service-ca\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.724365 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.724301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-trusted-ca-bundle\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.724365 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.724358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-console-config\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.794081 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.794052 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:05.825523 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.825501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-oauth-serving-cert\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.825615 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.825530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07dfff04-9076-489b-985b-95ed83de3f7c-console-serving-cert\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.825615 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.825565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-service-ca\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.825710 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.825683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-trusted-ca-bundle\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.825747 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.825731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-console-config\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.825788 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.825763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07dfff04-9076-489b-985b-95ed83de3f7c-console-oauth-config\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.825824 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.825803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kstr\" (UniqueName: \"kubernetes.io/projected/07dfff04-9076-489b-985b-95ed83de3f7c-kube-api-access-2kstr\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.826333 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.826308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-oauth-serving-cert\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.826525 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.826308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-service-ca\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.826525 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.826515 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-trusted-ca-bundle\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.826647 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.826559 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07dfff04-9076-489b-985b-95ed83de3f7c-console-config\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.828159 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.828125 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07dfff04-9076-489b-985b-95ed83de3f7c-console-serving-cert\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.828159 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.828132 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07dfff04-9076-489b-985b-95ed83de3f7c-console-oauth-config\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.832871 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.832854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kstr\" (UniqueName: \"kubernetes.io/projected/07dfff04-9076-489b-985b-95ed83de3f7c-kube-api-access-2kstr\") pod \"console-67d45b7d6c-dtzcx\" (UID: \"07dfff04-9076-489b-985b-95ed83de3f7c\") " pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.895491 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.895438 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:05.930504 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.930475 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:05.978170 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:05.978134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:06.066230 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:06.066175 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d45b7d6c-dtzcx"] Jul 15 13:17:06.068571 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:17:06.068541 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07dfff04_9076_489b_985b_95ed83de3f7c.slice/crio-1e4f431df9fec447529387709731100918607f5645deb59201997b01be0c9a85 WatchSource:0}: Error finding container 1e4f431df9fec447529387709731100918607f5645deb59201997b01be0c9a85: Status 404 returned error can't find the container with id 1e4f431df9fec447529387709731100918607f5645deb59201997b01be0c9a85 Jul 15 13:17:06.436575 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:06.436540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:06.534939 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:06.534910 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:06.731132 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:06.731052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d45b7d6c-dtzcx" event={"ID":"07dfff04-9076-489b-985b-95ed83de3f7c","Type":"ContainerStarted","Data":"529182be974f6617ac5bf9a88fd9b0580f788996e76cac88738298baee354ecf"} Jul 15 13:17:06.731132 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:06.731101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d45b7d6c-dtzcx" event={"ID":"07dfff04-9076-489b-985b-95ed83de3f7c","Type":"ContainerStarted","Data":"1e4f431df9fec447529387709731100918607f5645deb59201997b01be0c9a85"} Jul 15 13:17:06.751127 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:06.751082 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67d45b7d6c-dtzcx" podStartSLOduration=1.751066694 podStartE2EDuration="1.751066694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:06.748681518 +0000 UTC m=+638.019790029" watchObservedRunningTime="2026-07-15 13:17:06.751066694 +0000 UTC m=+638.022175193" Jul 15 13:17:15.931483 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:15.931449 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:15.931907 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:15.931515 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:15.936314 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:15.936295 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:16.780186 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:16.780156 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67d45b7d6c-dtzcx" Jul 15 13:17:16.836244 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:16.836215 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9b76fb7b-r2jg8"] Jul 15 13:17:16.997754 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:16.997721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:17.100162 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:17.100080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:41.867472 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:41.867400 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f9b76fb7b-r2jg8" podUID="29f6906c-1d45-4e10-b374-f0b40f992889" containerName="console" containerID="cri-o://4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89" gracePeriod=15 Jul 15 13:17:42.122564 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.122512 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:17:42.215020 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.214972 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-console-config\") pod \"29f6906c-1d45-4e10-b374-f0b40f992889\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " Jul 15 13:17:42.215215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-trusted-ca-bundle\") pod \"29f6906c-1d45-4e10-b374-f0b40f992889\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " Jul 15 13:17:42.215215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215085 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98q22\" (UniqueName: \"kubernetes.io/projected/29f6906c-1d45-4e10-b374-f0b40f992889-kube-api-access-98q22\") pod \"29f6906c-1d45-4e10-b374-f0b40f992889\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " Jul 15 13:17:42.215215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215109 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-oauth-config\") pod \"29f6906c-1d45-4e10-b374-f0b40f992889\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " Jul 15 13:17:42.215215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215124 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-serving-cert\") pod \"29f6906c-1d45-4e10-b374-f0b40f992889\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " Jul 15 13:17:42.215215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215151 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-oauth-serving-cert\") pod \"29f6906c-1d45-4e10-b374-f0b40f992889\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " Jul 15 13:17:42.215215 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215187 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-service-ca\") pod \"29f6906c-1d45-4e10-b374-f0b40f992889\" (UID: \"29f6906c-1d45-4e10-b374-f0b40f992889\") " Jul 15 13:17:42.215567 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215467 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-console-config" (OuterVolumeSpecName: "console-config") pod "29f6906c-1d45-4e10-b374-f0b40f992889" (UID: "29f6906c-1d45-4e10-b374-f0b40f992889"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:42.215669 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215637 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "29f6906c-1d45-4e10-b374-f0b40f992889" (UID: "29f6906c-1d45-4e10-b374-f0b40f992889"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:42.215723 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215707 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-service-ca" (OuterVolumeSpecName: "service-ca") pod "29f6906c-1d45-4e10-b374-f0b40f992889" (UID: "29f6906c-1d45-4e10-b374-f0b40f992889"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:42.215723 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.215715 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29f6906c-1d45-4e10-b374-f0b40f992889" (UID: "29f6906c-1d45-4e10-b374-f0b40f992889"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:42.217455 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.217400 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f6906c-1d45-4e10-b374-f0b40f992889-kube-api-access-98q22" (OuterVolumeSpecName: "kube-api-access-98q22") pod "29f6906c-1d45-4e10-b374-f0b40f992889" (UID: "29f6906c-1d45-4e10-b374-f0b40f992889"). InnerVolumeSpecName "kube-api-access-98q22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:17:42.217575 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.217470 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29f6906c-1d45-4e10-b374-f0b40f992889" (UID: "29f6906c-1d45-4e10-b374-f0b40f992889"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:42.217575 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.217485 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29f6906c-1d45-4e10-b374-f0b40f992889" (UID: "29f6906c-1d45-4e10-b374-f0b40f992889"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:42.316777 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.316736 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-trusted-ca-bundle\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:17:42.316777 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.316771 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98q22\" (UniqueName: \"kubernetes.io/projected/29f6906c-1d45-4e10-b374-f0b40f992889-kube-api-access-98q22\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:17:42.316777 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.316785 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-oauth-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:17:42.317014 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.316797 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f6906c-1d45-4e10-b374-f0b40f992889-console-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:17:42.317014 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.316809 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-oauth-serving-cert\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:17:42.317014 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.316823 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-service-ca\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:17:42.317014 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.316834 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f6906c-1d45-4e10-b374-f0b40f992889-console-config\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:17:42.893573 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.893540 2579 generic.go:356] "Generic (PLEG): container finished" podID="29f6906c-1d45-4e10-b374-f0b40f992889" containerID="4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89" exitCode=0 Jul 15 13:17:42.893994 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.893584 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9b76fb7b-r2jg8" Jul 15 13:17:42.893994 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.893628 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9b76fb7b-r2jg8" event={"ID":"29f6906c-1d45-4e10-b374-f0b40f992889","Type":"ContainerDied","Data":"4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89"} Jul 15 13:17:42.893994 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.893685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9b76fb7b-r2jg8" event={"ID":"29f6906c-1d45-4e10-b374-f0b40f992889","Type":"ContainerDied","Data":"45061d0a8da9843babf1a2d1d74b0f0c7817466551e360f6031d7e4692892dc5"} Jul 15 13:17:42.893994 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.893708 2579 scope.go:117] "RemoveContainer" containerID="4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89" Jul 15 13:17:42.901790 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.901773 2579 scope.go:117] "RemoveContainer" containerID="4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89" Jul 15 13:17:42.902040 ip-10-0-129-104 kubenswrapper[2579]: E0715 13:17:42.902023 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89\": container with ID starting with 4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89 not found: ID does not exist" containerID="4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89" Jul 15 13:17:42.902082 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.902047 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89"} err="failed to get container status \"4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89\": rpc error: code = NotFound desc = could not find container \"4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89\": container with ID starting with 4bf09d9a089c85bceaaf7801f2635349046c91bc7a0942f1fd1d027c28620d89 not found: ID does not exist" Jul 15 13:17:42.917223 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.917194 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9b76fb7b-r2jg8"] Jul 15 13:17:42.920995 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:42.920972 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f9b76fb7b-r2jg8"] Jul 15 13:17:44.353243 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:17:44.353211 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f6906c-1d45-4e10-b374-f0b40f992889" path="/var/lib/kubelet/pods/29f6906c-1d45-4e10-b374-f0b40f992889/volumes" Jul 15 13:19:30.083351 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:19:30.083313 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:38.529595 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:19:38.529560 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:13.541173 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:13.541100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:28.590976 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:28.590944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:29.121302 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.121268 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49"] Jul 15 13:20:29.121629 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.121615 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f6906c-1d45-4e10-b374-f0b40f992889" containerName="console" Jul 15 13:20:29.121695 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.121630 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f6906c-1d45-4e10-b374-f0b40f992889" containerName="console" Jul 15 13:20:29.121695 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.121678 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f6906c-1d45-4e10-b374-f0b40f992889" containerName="console" Jul 15 13:20:29.124510 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.124489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:20:29.127096 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.127068 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l7trh\"/\"kube-root-ca.crt\"" Jul 15 13:20:29.127250 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.127224 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-l7trh\"/\"default-dockercfg-ng2n9\"" Jul 15 13:20:29.127321 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.127303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-l7trh\"/\"openshift-service-ca.crt\"" Jul 15 13:20:29.128225 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.128199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:29.137930 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.137910 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49"] Jul 15 13:20:29.307184 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.307158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt7w9\" (UniqueName: \"kubernetes.io/projected/b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd-kube-api-access-mt7w9\") pod \"progression-job-failure-node-0-0-nml49\" (UID: \"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd\") " pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:20:29.408075 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.408014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt7w9\" (UniqueName: \"kubernetes.io/projected/b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd-kube-api-access-mt7w9\") pod \"progression-job-failure-node-0-0-nml49\" (UID: \"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd\") " pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:20:29.415995 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.415973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt7w9\" (UniqueName: \"kubernetes.io/projected/b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd-kube-api-access-mt7w9\") pod \"progression-job-failure-node-0-0-nml49\" (UID: \"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd\") " pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:20:29.434282 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.434260 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:20:29.561903 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.561878 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49"] Jul 15 13:20:29.567584 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:20:29.567557 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb386a1d5_182b_4ba2_bd8b_3fcbbe0404cd.slice/crio-11f646ccc01f468d9dc3b065570089f051a3a35ab85bbf86344a55e9d830cb5c WatchSource:0}: Error finding container 11f646ccc01f468d9dc3b065570089f051a3a35ab85bbf86344a55e9d830cb5c: Status 404 returned error can't find the container with id 11f646ccc01f468d9dc3b065570089f051a3a35ab85bbf86344a55e9d830cb5c Jul 15 13:20:29.569307 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.569287 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:20:29.613281 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:20:29.613258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" event={"ID":"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd","Type":"ContainerStarted","Data":"11f646ccc01f468d9dc3b065570089f051a3a35ab85bbf86344a55e9d830cb5c"} Jul 15 13:21:12.299608 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:21:12.299576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:24.191708 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:24.191670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" event={"ID":"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd","Type":"ContainerStarted","Data":"6931b8736e46013e16901ca92e7fede04861801d60a4fd5dcad4f410839e237f"} Jul 15 13:22:24.192103 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:24.191743 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:22:24.223219 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:24.223167 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" podStartSLOduration=1.003521209 podStartE2EDuration="1m55.223151291s" totalImagesPullingTime="1m54.219630082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:22:24.222050638 +0000 UTC m=+955.493159139" watchObservedRunningTime="2026-07-15 13:22:24.223151291 +0000 UTC m=+955.494259799" Jul 15 13:22:25.194811 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:25.194785 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:22:33.192177 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:33.192140 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" podUID="b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd" containerName="node" probeResult="failure" output="Get \"http://10.133.0.31:28080/metrics\": dial tcp 10.133.0.31:28080: connect: connection refused" Jul 15 13:22:33.233476 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:33.233386 2579 generic.go:356] "Generic (PLEG): container finished" podID="b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd" containerID="6931b8736e46013e16901ca92e7fede04861801d60a4fd5dcad4f410839e237f" exitCode=1 Jul 15 13:22:33.233476 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:33.233443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" event={"ID":"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd","Type":"ContainerDied","Data":"6931b8736e46013e16901ca92e7fede04861801d60a4fd5dcad4f410839e237f"} Jul 15 13:22:34.362145 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:34.362120 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:22:34.484760 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:34.484731 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt7w9\" (UniqueName: \"kubernetes.io/projected/b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd-kube-api-access-mt7w9\") pod \"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd\" (UID: \"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd\") " Jul 15 13:22:34.486876 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:34.486845 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd-kube-api-access-mt7w9" (OuterVolumeSpecName: "kube-api-access-mt7w9") pod "b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd" (UID: "b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd"). InnerVolumeSpecName "kube-api-access-mt7w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:22:34.586149 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:34.586122 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt7w9\" (UniqueName: \"kubernetes.io/projected/b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd-kube-api-access-mt7w9\") on node \"ip-10-0-129-104.ec2.internal\" DevicePath \"\"" Jul 15 13:22:35.243213 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:35.243182 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" Jul 15 13:22:35.243376 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:35.243216 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49" event={"ID":"b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd","Type":"ContainerDied","Data":"11f646ccc01f468d9dc3b065570089f051a3a35ab85bbf86344a55e9d830cb5c"} Jul 15 13:22:35.243376 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:35.243261 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11f646ccc01f468d9dc3b065570089f051a3a35ab85bbf86344a55e9d830cb5c" Jul 15 13:22:37.165390 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:37.165359 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:49.158456 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:49.158404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:49.808222 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:49.808184 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:49.922445 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:49.922393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:54.172012 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:54.171938 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49"] Jul 15 13:22:54.178525 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:54.178502 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-l7trh/progression-job-failure-node-0-0-nml49"] Jul 15 13:22:54.330643 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:54.330615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:54.352889 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:54.352858 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd" path="/var/lib/kubelet/pods/b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd/volumes" Jul 15 13:22:54.461242 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:54.461172 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:56.060460 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:56.060405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:56.781103 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:56.781067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:56.882527 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:22:56.882495 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:01.390017 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:01.389982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:01.471014 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:01.470970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:44.935084 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:44.935047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:45.084330 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:45.084272 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:45.153931 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:45.153901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:47.820412 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:47.820385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ndlzv_94533b2e-1971-41a5-85b9-c87137ae7b59/global-pull-secret-syncer/0.log" Jul 15 13:23:47.864789 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:47.864763 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" Jul 15 13:23:47.982569 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:47.982528 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-104.ec2.internal_9a577634d414d36381327713dceaa9a2/haproxy/0.log" Jul 15 13:23:50.720453 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:50.720389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:50.821279 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:50.821242 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:51.577901 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:51.577870 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-dlvkl_fa5f9520-c485-45dd-b348-3deeb37eb2b8/cluster-monitoring-operator/0.log" Jul 15 13:23:51.680726 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:51.680701 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58d647f4c4-xghkh_b1fa3574-0564-4ce0-b6f0-b943e531c720/metrics-server/0.log" Jul 15 13:23:51.919907 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:51.919882 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxtsj_5a246094-62c7-442f-a731-8cb1c21a6d8f/node-exporter/0.log" Jul 15 13:23:51.943775 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:51.943752 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxtsj_5a246094-62c7-442f-a731-8cb1c21a6d8f/kube-rbac-proxy/0.log" Jul 15 13:23:51.968904 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:51.968882 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxtsj_5a246094-62c7-442f-a731-8cb1c21a6d8f/init-textfile/0.log" Jul 15 13:23:52.238291 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.238201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-6t6gk_405a4cde-2f38-4c27-82a4-c4066f41c769/prometheus-operator/0.log" Jul 15 13:23:52.264629 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.264603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-6t6gk_405a4cde-2f38-4c27-82a4-c4066f41c769/kube-rbac-proxy/0.log" Jul 15 13:23:52.319357 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.319330 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9f959bb7-l6n2r_772ebf2f-7024-4704-86f7-7c98fe9406b7/telemeter-client/0.log" Jul 15 13:23:52.340473 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.340449 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9f959bb7-l6n2r_772ebf2f-7024-4704-86f7-7c98fe9406b7/reload/0.log" Jul 15 13:23:52.366189 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.366161 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9f959bb7-l6n2r_772ebf2f-7024-4704-86f7-7c98fe9406b7/kube-rbac-proxy/0.log" Jul 15 13:23:52.399272 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.399246 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/thanos-query/0.log" Jul 15 13:23:52.424212 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.424192 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy-web/0.log" Jul 15 13:23:52.450135 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.450117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy/0.log" Jul 15 13:23:52.470254 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.470231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/prom-label-proxy/0.log" Jul 15 13:23:52.490687 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.490632 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy-rules/0.log" Jul 15 13:23:52.510240 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:52.510218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6874f5f684-r6lvn_e857f580-7b45-4f8d-ac3e-d01704846730/kube-rbac-proxy-metrics/0.log" Jul 15 13:23:54.651840 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:54.651804 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67d45b7d6c-dtzcx_07dfff04-9076-489b-985b-95ed83de3f7c/console/0.log" Jul 15 13:23:55.230033 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.230007 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-h5smd_2db8e1d3-b7b6-4018-a152-b735b844d456/volume-data-source-validator/0.log" Jul 15 13:23:55.261545 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.261517 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n"] Jul 15 13:23:55.261845 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.261832 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd" containerName="node" Jul 15 13:23:55.261902 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.261846 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd" containerName="node" Jul 15 13:23:55.261964 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.261903 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b386a1d5-182b-4ba2-bd8b-3fcbbe0404cd" containerName="node" Jul 15 13:23:55.263779 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.263757 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.266232 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.266205 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z8qcw\"/\"openshift-service-ca.crt\"" Jul 15 13:23:55.266327 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.266260 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z8qcw\"/\"kube-root-ca.crt\"" Jul 15 13:23:55.267020 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.267002 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z8qcw\"/\"default-dockercfg-ddkhq\"" Jul 15 13:23:55.274149 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.274119 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n"] Jul 15 13:23:55.323614 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.323587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-sys\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.323768 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.323623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-lib-modules\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.323768 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.323644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g544m\" (UniqueName: \"kubernetes.io/projected/90acc07a-acec-4a3e-96de-add0fd7370c7-kube-api-access-g544m\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.323768 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.323671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-podres\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.323768 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.323713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-proc\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424160 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-sys\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424160 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-lib-modules\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424364 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g544m\" (UniqueName: \"kubernetes.io/projected/90acc07a-acec-4a3e-96de-add0fd7370c7-kube-api-access-g544m\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424364 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-podres\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424364 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-sys\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424364 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-proc\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424364 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424322 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-lib-modules\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424607 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424392 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-proc\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.424607 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.424405 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90acc07a-acec-4a3e-96de-add0fd7370c7-podres\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.432244 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.432228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g544m\" (UniqueName: \"kubernetes.io/projected/90acc07a-acec-4a3e-96de-add0fd7370c7-kube-api-access-g544m\") pod \"perf-node-gather-daemonset-zgb7n\" (UID: \"90acc07a-acec-4a3e-96de-add0fd7370c7\") " pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.574492 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.574386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:55.700563 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:55.700535 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n"] Jul 15 13:23:55.702844 ip-10-0-129-104 kubenswrapper[2579]: W0715 13:23:55.702820 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod90acc07a_acec_4a3e_96de_add0fd7370c7.slice/crio-477e4096a5f09fd9adf404fc1e0add2a13f406eb41c138fdf17db282d9854de2 WatchSource:0}: Error finding container 477e4096a5f09fd9adf404fc1e0add2a13f406eb41c138fdf17db282d9854de2: Status 404 returned error can't find the container with id 477e4096a5f09fd9adf404fc1e0add2a13f406eb41c138fdf17db282d9854de2 Jul 15 13:23:56.179047 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.179021 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mkbqn_4aee88a8-f4be-4b83-8026-6ed5811b04be/dns/0.log" Jul 15 13:23:56.200796 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.200775 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mkbqn_4aee88a8-f4be-4b83-8026-6ed5811b04be/kube-rbac-proxy/0.log" Jul 15 13:23:56.224522 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.224500 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49ctm_0c896098-424f-4310-8978-d4ffb2db603d/dns-node-resolver/0.log" Jul 15 13:23:56.601392 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.601300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" event={"ID":"90acc07a-acec-4a3e-96de-add0fd7370c7","Type":"ContainerStarted","Data":"06e3726a21d5bc501356a91065d8e3b22bbbc2e8fbc31e5f99617733f0086d79"} Jul 15 13:23:56.601392 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.601362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" event={"ID":"90acc07a-acec-4a3e-96de-add0fd7370c7","Type":"ContainerStarted","Data":"477e4096a5f09fd9adf404fc1e0add2a13f406eb41c138fdf17db282d9854de2"} Jul 15 13:23:56.601633 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.601401 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:23:56.617656 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.617607 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" podStartSLOduration=1.617590898 podStartE2EDuration="1.617590898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:56.616836357 +0000 UTC m=+1047.887944855" watchObservedRunningTime="2026-07-15 13:23:56.617590898 +0000 UTC m=+1047.888699409" Jul 15 13:23:56.658653 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.658621 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86b68bb6f5-z7tjc_e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6/registry/0.log" Jul 15 13:23:56.661193 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.661173 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86b68bb6f5-z7tjc_e34e780e-ef1a-4cd4-ab05-52a3c8c82ad6/registry/1.log" Jul 15 13:23:56.678146 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:56.678129 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44ffz_6a915b40-77d6-45db-bbf5-533616e8b4a9/node-ca/0.log" Jul 15 13:23:57.429449 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:57.429403 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bb7b4d6f6-nnrsb_0581b85f-3730-4cd7-8ce8-fb17ebaf3b51/router/0.log" Jul 15 13:23:57.773773 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:57.773642 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-np2ct_acc4218d-8405-4947-ad4d-e75fca122c4b/serve-healthcheck-canary/0.log" Jul 15 13:23:58.292058 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:58.292029 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jc26_23f70fb0-38a1-42a2-b090-9e2dfe0518c7/kube-rbac-proxy/0.log" Jul 15 13:23:58.314335 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:58.314311 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jc26_23f70fb0-38a1-42a2-b090-9e2dfe0518c7/exporter/0.log" Jul 15 13:23:58.334812 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:58.334787 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jc26_23f70fb0-38a1-42a2-b090-9e2dfe0518c7/extractor/0.log" Jul 15 13:23:59.924972 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:23:59.924948 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-c7f7f7d84-8stwc_c7a123dd-6d42-4cba-879c-a12d85e1fe47/manager/0.log" Jul 15 13:24:02.615397 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:02.615371 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z8qcw/perf-node-gather-daemonset-zgb7n" Jul 15 13:24:04.353740 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.353647 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rj6v_e8d62da5-3820-4d31-9bff-afa87c2a005e/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:04.498167 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.498139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vjml_0e9d97a3-f4f8-4963-b189-363102af76b0/kube-multus-additional-cni-plugins/0.log" Jul 15 13:24:04.538998 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.538973 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vjml_0e9d97a3-f4f8-4963-b189-363102af76b0/egress-router-binary-copy/0.log" Jul 15 13:24:04.580921 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.580898 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vjml_0e9d97a3-f4f8-4963-b189-363102af76b0/cni-plugins/0.log" Jul 15 13:24:04.603872 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.603811 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vjml_0e9d97a3-f4f8-4963-b189-363102af76b0/bond-cni-plugin/0.log" Jul 15 13:24:04.626083 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.626066 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vjml_0e9d97a3-f4f8-4963-b189-363102af76b0/routeoverride-cni/0.log" Jul 15 13:24:04.649105 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.649087 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vjml_0e9d97a3-f4f8-4963-b189-363102af76b0/whereabouts-cni-bincopy/0.log" Jul 15 13:24:04.670125 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:04.670101 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vjml_0e9d97a3-f4f8-4963-b189-363102af76b0/whereabouts-cni/0.log" Jul 15 13:24:05.222750 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:05.222723 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wwc4d_7c20a2da-dc20-485c-be40-54f12372dc80/kube-multus/0.log" Jul 15 13:24:05.242117 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:05.242096 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hrwxj_c4a4cd0e-42ef-4e1f-9595-f047ff8512ff/network-metrics-daemon/0.log" Jul 15 13:24:05.263982 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:05.263958 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hrwxj_c4a4cd0e-42ef-4e1f-9595-f047ff8512ff/kube-rbac-proxy/0.log" Jul 15 13:24:06.102289 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.102260 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/ovn-controller/0.log" Jul 15 13:24:06.122216 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.122186 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/ovn-acl-logging/0.log" Jul 15 13:24:06.147538 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.147464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/kube-rbac-proxy-node/0.log" Jul 15 13:24:06.173163 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.173143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/kube-rbac-proxy-ovn-metrics/0.log" Jul 15 13:24:06.197368 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.197341 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/northd/0.log" Jul 15 13:24:06.233312 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.233292 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/nbdb/0.log" Jul 15 13:24:06.256248 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.256219 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/sbdb/0.log" Jul 15 13:24:06.298708 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:06.298683 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ms7vj_ebd5f567-c371-4463-894b-4f3a952cc95c/ovnkube-controller/0.log" Jul 15 13:24:07.670618 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:07.670586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2l2rq_b516107a-a85f-4e09-8f11-f354e274ef27/network-check-target-container/0.log" Jul 15 13:24:08.569334 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:08.569302 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7nznt_42cd2274-5832-41a5-a6ba-b63009e462d0/iptables-alerter/0.log" Jul 15 13:24:09.236154 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:09.236124 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-j5vd9_8b1988a4-14cf-4b5e-9568-e50e910cee1d/tuned/0.log" Jul 15 13:24:10.891177 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:10.891153 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-nkcmp_129c307c-3493-4d7f-b3b7-4b4c380ea6da/cluster-samples-operator/0.log" Jul 15 13:24:10.906071 ip-10-0-129-104 kubenswrapper[2579]: I0715 13:24:10.906047 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-nkcmp_129c307c-3493-4d7f-b3b7-4b4c380ea6da/cluster-samples-operator-watch/0.log"