Jul 02 15:27:26.001979 ip-10-0-129-25 systemd[1]: Starting Kubernetes Kubelet... Jul 02 15:27:26.416942 ip-10-0-129-25 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:27:26.416942 ip-10-0-129-25 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 15:27:26.416942 ip-10-0-129-25 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:27:26.416942 ip-10-0-129-25 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 15:27:26.416942 ip-10-0-129-25 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:27:26.419675 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.419571 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 15:27:26.425518 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425500 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:26.425518 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425517 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425522 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425525 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425528 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425531 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425534 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425537 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425541 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425544 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425547 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425549 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425553 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425555 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425558 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425561 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425571 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425574 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425577 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425580 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425583 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:26.425592 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425586 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425588 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425591 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425593 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425596 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425599 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425602 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425605 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425608 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425610 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425613 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425617 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425621 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425624 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425627 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425630 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425633 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425636 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425639 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:26.426088 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425653 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425656 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425658 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425661 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425664 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425667 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425670 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425673 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425676 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425679 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425682 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425686 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425688 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425691 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425694 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425697 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425699 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425702 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425704 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425707 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:26.426731 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425710 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425713 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425716 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425718 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425721 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425724 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425727 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425729 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425732 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425735 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425738 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425741 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425745 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425749 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425753 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425756 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425759 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425762 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425765 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:26.427378 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425769 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425772 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425775 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425777 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425780 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425782 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425785 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425787 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425791 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425793 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425796 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425799 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425801 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425804 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425807 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425809 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425812 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425814 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425817 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:26.427859 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.425819 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:26.428381 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428364 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:26.428381 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428381 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428386 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428390 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428393 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428396 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428399 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428402 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428404 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428407 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428410 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428413 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428417 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428420 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428422 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428425 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428428 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428431 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428433 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428436 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428439 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:26.428437 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428442 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428445 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428448 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428451 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428454 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428458 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428462 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428465 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428468 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428471 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428473 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428476 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428479 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428482 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428485 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428487 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428490 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428492 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428495 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:26.428938 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428497 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428501 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428505 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428507 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428510 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428512 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428514 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428517 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428520 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428522 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428524 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428527 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428529 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428533 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428535 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428538 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428541 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428543 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428546 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:26.429410 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428549 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428551 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428554 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428557 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428559 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428562 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428564 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428567 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428569 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428572 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428574 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428577 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428579 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428582 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428584 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428586 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428589 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428592 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428594 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428597 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:26.429906 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428599 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428601 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428604 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428606 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428617 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428620 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428622 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428625 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428628 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428631 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428634 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428637 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428639 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428656 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428660 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428663 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428666 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428669 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428672 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.428674 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:26.430386 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429107 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429112 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429114 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429117 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429119 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429122 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429124 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429127 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429130 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429133 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429136 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429138 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429141 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429144 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429146 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429151 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429161 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429164 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429168 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429170 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:26.430890 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429173 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429176 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429179 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429182 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429184 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429187 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429189 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429192 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429194 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429197 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429199 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429202 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429206 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429209 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429211 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429214 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429217 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429220 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429222 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:26.431382 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429225 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429227 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429230 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429232 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429235 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429238 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429240 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429243 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429245 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429251 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429259 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429262 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429264 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429268 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429270 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429273 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429275 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429278 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429280 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429283 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:26.431849 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429285 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429288 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429290 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429293 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429296 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429300 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429304 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429307 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429309 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429312 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429314 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429317 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429319 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429322 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429324 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429327 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429329 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429332 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429335 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:26.432348 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429337 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429340 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429344 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429346 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429350 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429353 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429355 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429358 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429360 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429362 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429365 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429367 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429370 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429372 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429375 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429378 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429380 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429383 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429385 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429387 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.429390 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:26.432826 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429463 2549 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429470 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429484 2549 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429501 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429508 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429512 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429516 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429520 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429523 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429527 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429530 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429533 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429537 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429541 2549 flags.go:64] FLAG: --cgroup-root="" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429544 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429547 2549 flags.go:64] FLAG: --client-ca-file="" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429551 2549 flags.go:64] FLAG: --cloud-provider="external" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429554 2549 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429559 2549 flags.go:64] FLAG: --cluster-domain="" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429562 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429565 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429568 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429571 2549 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429575 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 15:27:26.433354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429578 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429581 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429584 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429588 2549 flags.go:64] FLAG: --contention-profiling="false" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429591 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429594 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429597 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429600 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429604 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429607 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429610 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429613 2549 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429616 2549 flags.go:64] FLAG: --enable-server="true" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429619 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429623 2549 flags.go:64] FLAG: --event-burst="100" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429626 2549 flags.go:64] FLAG: --event-qps="50" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429629 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429632 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429635 2549 flags.go:64] FLAG: --eviction-hard="" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429638 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429653 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429658 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429661 2549 flags.go:64] FLAG: --eviction-soft="" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429664 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429666 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 15:27:26.433954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429670 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429673 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429676 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429679 2549 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429682 2549 flags.go:64] FLAG: --feature-gates="" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429686 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429689 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429692 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429696 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429699 2549 flags.go:64] FLAG: --healthz-port="10248" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429702 2549 flags.go:64] FLAG: --help="false" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429704 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429707 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429710 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429713 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429716 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429719 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429722 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429725 2549 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429728 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429730 2549 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429733 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429736 2549 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429739 2549 flags.go:64] FLAG: --kube-reserved="" Jul 02 15:27:26.434583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429744 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429747 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429750 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429753 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429757 2549 flags.go:64] FLAG: --lock-file="" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429760 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429763 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429766 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429771 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429775 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429778 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429781 2549 flags.go:64] FLAG: --logging-format="text" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429783 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429787 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429790 2549 flags.go:64] FLAG: --manifest-url="" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429792 2549 flags.go:64] FLAG: --manifest-url-header="" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429797 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429800 2549 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429805 2549 flags.go:64] FLAG: --max-pods="110" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429808 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429810 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429813 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429816 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429819 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429822 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 15:27:26.435242 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429825 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429833 2549 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429836 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429838 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429842 2549 flags.go:64] FLAG: --pod-cidr="" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429844 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429850 2549 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429854 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429857 2549 flags.go:64] FLAG: --pods-per-core="0" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429860 2549 flags.go:64] FLAG: --port="10250" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429863 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429866 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-004cc3171d9a3f272" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429871 2549 flags.go:64] FLAG: --qos-reserved="" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429881 2549 flags.go:64] FLAG: --read-only-port="10255" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429885 2549 flags.go:64] FLAG: --register-node="true" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429888 2549 flags.go:64] FLAG: --register-with-taints="" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429892 2549 flags.go:64] FLAG: --registry-burst="10" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429896 2549 flags.go:64] FLAG: --registry-qps="5" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429899 2549 flags.go:64] FLAG: --reserved-cpus="" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429902 2549 flags.go:64] FLAG: --reserved-memory="" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429906 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429910 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429913 2549 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429916 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429919 2549 flags.go:64] FLAG: --runonce="false" Jul 02 15:27:26.435860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429922 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429925 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429928 2549 flags.go:64] FLAG: --seccomp-default="false" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429931 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429934 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429937 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429940 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429943 2549 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429946 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429949 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429951 2549 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429954 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429957 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429960 2549 flags.go:64] FLAG: --system-cgroups="" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429964 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429969 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429972 2549 flags.go:64] FLAG: --tls-cert-file="" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429974 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429979 2549 flags.go:64] FLAG: --tls-min-version="" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429983 2549 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429986 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429988 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429992 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429995 2549 flags.go:64] FLAG: --v="2" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.429999 2549 flags.go:64] FLAG: --version="false" Jul 02 15:27:26.436461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.430003 2549 flags.go:64] FLAG: --vmodule="" Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.430007 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.430011 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430160 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430165 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430168 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430171 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430174 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430177 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430179 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430182 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430184 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430187 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430190 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430192 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430195 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430198 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430201 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430203 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:26.437117 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430206 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430208 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430212 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430215 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430218 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430220 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430223 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430227 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430229 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430232 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430235 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430237 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430240 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430242 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430248 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430251 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430253 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430256 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430258 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430261 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:26.437586 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430263 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430267 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430271 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430274 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430276 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430279 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430282 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430285 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430287 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430290 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430292 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430295 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430297 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430300 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430304 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430306 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430309 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430311 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430314 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:26.438113 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430317 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430320 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430323 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430325 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430328 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430331 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430333 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430336 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430339 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430342 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430344 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430346 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430349 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430352 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430354 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430357 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430359 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430362 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430364 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:26.438584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430367 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430369 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430372 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430375 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430377 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430380 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430383 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430385 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430390 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430392 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430395 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430399 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430403 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430406 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430409 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430411 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430414 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430416 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430419 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:26.439062 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430422 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430424 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430427 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430430 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430433 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.430435 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.432165 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.439072 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 15:27:26.439519 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.439089 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 15:27:26.439826 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.439815 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 15:27:26.439856 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.439826 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 15:27:26.439895 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439887 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439896 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439900 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439903 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439907 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439911 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439915 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439918 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439922 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439925 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:26.439923 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439928 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439932 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439935 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439938 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439940 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439943 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439946 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439949 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439951 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439954 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439957 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439959 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439962 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439965 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439968 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439971 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439974 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439976 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439979 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439981 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:26.440167 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439984 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439986 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439989 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439991 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439994 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439997 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.439999 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440002 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440004 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440007 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440010 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440012 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440015 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440018 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440021 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440023 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440026 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440028 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440031 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:26.440695 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440035 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440038 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440041 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440044 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440047 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440049 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440052 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440055 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440058 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440061 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440064 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440066 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440070 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440072 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440076 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440078 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440081 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440083 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440086 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440089 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:26.441154 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440092 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440095 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440097 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440100 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440103 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440106 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440108 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440111 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440113 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440116 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440118 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440121 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440123 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440126 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440128 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440131 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440133 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440136 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440138 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440141 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:26.441637 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440144 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440147 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440149 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440152 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440155 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440158 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440161 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440163 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440166 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440169 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.440174 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440312 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440317 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440321 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440324 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:27:26.442122 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440326 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440329 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440332 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440335 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440338 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440341 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440343 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440346 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440348 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440351 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440353 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440356 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440358 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440361 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440363 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440366 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440369 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440371 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440374 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:27:26.442489 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440376 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440380 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440383 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440386 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440390 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440393 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440395 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440398 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440400 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440403 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440406 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440409 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440411 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440414 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440416 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440419 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440421 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440424 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440426 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:27:26.442983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440429 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440431 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440434 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440437 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440439 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440442 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440445 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440447 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440450 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440452 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440455 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440457 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440460 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440462 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440465 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440468 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440471 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440473 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440476 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440480 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:27:26.443440 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440484 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440486 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440489 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440492 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440495 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440499 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440502 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440505 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440508 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440510 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440513 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440516 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440519 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440522 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440525 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440527 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440530 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440532 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440535 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440538 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:27:26.443990 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440540 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440543 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440545 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440548 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440552 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440555 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440558 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440561 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440564 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440567 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440570 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440573 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440575 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440577 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440580 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440583 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:27:26.444477 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:26.440586 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:27:26.444879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.440590 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:27:26.444879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.440726 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 15:27:26.444879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.442826 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 15:27:26.444879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.444311 2549 server.go:1019] "Starting client certificate rotation" Jul 02 15:27:26.444879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.444413 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:27:26.444879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.444448 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:27:26.448513 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.448497 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:27:26.450093 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.450074 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:27:26.467201 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.467176 2549 log.go:25] "Validated CRI v1 runtime API" Jul 02 15:27:26.469712 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.469694 2549 log.go:25] "Validated CRI v1 image API" Jul 02 15:27:26.470460 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.470443 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 15:27:26.472956 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.472935 2549 fs.go:135] Filesystem UUIDs: map[3174a533-b91a-47e8-9c0c-c75fb3117cce:/dev/nvme0n1p3 5ce34266-970c-4c0e-b6a2-fc517c33f6eb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 02 15:27:26.473042 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.472954 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 15:27:26.478676 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.478639 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:27:26.478996 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.478886 2549 manager.go:216] Machine: {Timestamp:2026-07-02 15:27:26.477593947 +0000 UTC m=+0.342450134 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099227 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2014fff426b83f6298f31253d9202d SystemUUID:ec2014ff-f426-b83f-6298-f31253d9202d BootID:cb243b68-4656-4f99-94ce-1f782006851d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:c2:40:23:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:c2:40:23:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:17:0a:5d:d6:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 15:27:26.478996 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.478997 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 15:27:26.479145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.479121 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 15:27:26.480070 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.480041 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 15:27:26.480209 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.480072 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 15:27:26.480830 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.480810 2549 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 15:27:26.480830 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.480833 2549 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 15:27:26.480905 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.480841 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:27:26.483218 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.483206 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:27:26.484174 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.484164 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 15:27:26.486980 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.486968 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:27:26.487103 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487094 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 15:27:26.487183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487126 2549 kubelet.go:486] "Attempting to sync node with API server" Jul 02 15:27:26.487183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487136 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 15:27:26.487183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487146 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 15:27:26.487183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487155 2549 kubelet.go:398] "Adding apiserver pod source" Jul 02 15:27:26.487183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487164 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 15:27:26.487549 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487537 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:27:26.487581 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.487555 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:27:26.489836 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.489813 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 15:27:26.491118 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491103 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 15:27:26.491169 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491134 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 15:27:26.491738 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491727 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 15:27:26.491772 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491743 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 15:27:26.491772 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491749 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 15:27:26.491772 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491755 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 15:27:26.491772 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491763 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 15:27:26.491772 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491769 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 15:27:26.491902 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491805 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 15:27:26.491902 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491811 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 15:27:26.491902 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491823 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 15:27:26.491902 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491829 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 15:27:26.491902 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491839 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 15:27:26.491902 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.491847 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 15:27:26.492443 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.492433 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 15:27:26.492478 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.492445 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 15:27:26.495913 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.495899 2549 server.go:1268] "Started kubelet" Jul 02 15:27:26.495990 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.495959 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 15:27:26.496238 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.496176 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 15:27:26.496331 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.496264 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 15:27:26.496876 ip-10-0-129-25 systemd[1]: Started Kubernetes Kubelet. Jul 02 15:27:26.499964 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.499938 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 15:27:26.500440 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.500401 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 15:27:26.500659 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.500625 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 15:27:26.500728 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.500639 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 15:27:26.503434 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.503418 2549 server.go:310] "Adding debug handlers to kubelet server" Jul 02 15:27:26.503838 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.503799 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 15:27:26.505549 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.504577 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-25.ec2.internal.18be828d71c29585 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-25.ec2.internal,UID:ip-10-0-129-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-25.ec2.internal,},FirstTimestamp:2026-07-02 15:27:26.495872389 +0000 UTC m=+0.360728578,LastTimestamp:2026-07-02 15:27:26.495872389 +0000 UTC m=+0.360728578,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-25.ec2.internal,}" Jul 02 15:27:26.506683 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.506664 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 15:27:26.506683 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.506679 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 15:27:26.506854 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.506833 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:26.507486 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.507468 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 15:27:26.507590 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.507495 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 15:27:26.507590 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.507466 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 15:27:26.507590 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.507578 2549 reconstruct.go:97] "Volume reconstruction finished" Jul 02 15:27:26.507590 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.507586 2549 reconciler.go:29] "Reconciler: start to sync state" Jul 02 15:27:26.507863 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.507842 2549 factory.go:55] Registering systemd factory Jul 02 15:27:26.507863 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.507866 2549 factory.go:223] Registration of the systemd container factory successfully Jul 02 15:27:26.508116 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.508102 2549 factory.go:153] Registering CRI-O factory Jul 02 15:27:26.508116 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.508119 2549 factory.go:223] Registration of the crio container factory successfully Jul 02 15:27:26.508219 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.508162 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 15:27:26.508219 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.508182 2549 factory.go:103] Registering Raw factory Jul 02 15:27:26.508219 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.508192 2549 manager.go:1196] Started watching for new ooms in manager Jul 02 15:27:26.508780 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.508767 2549 manager.go:349] Starting recovery of all containers Jul 02 15:27:26.513122 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.513098 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znmsg" Jul 02 15:27:26.519263 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.519246 2549 manager.go:354] Recovery completed Jul 02 15:27:26.519347 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.519263 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 15:27:26.519422 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.519360 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 15:27:26.520004 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.519981 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znmsg" Jul 02 15:27:26.525235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.525219 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.527017 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.527002 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.527109 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.527035 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.527109 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.527050 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.527570 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.527557 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 15:27:26.527570 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.527570 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 15:27:26.527684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.527584 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:27:26.527684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.527626 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.528309 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.528294 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.528376 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.528319 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.528376 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.528329 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.528682 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.528670 2549 policy_none.go:49] "None policy: Start" Jul 02 15:27:26.528743 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.528689 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 15:27:26.528743 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.528702 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 15:27:26.529738 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.529724 2549 policy_none.go:47] "Start" Jul 02 15:27:26.530232 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.530161 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-25.ec2.internal.18be828d739dd5da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-25.ec2.internal,UID:ip-10-0-129-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-25.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-25.ec2.internal,},FirstTimestamp:2026-07-02 15:27:26.527018458 +0000 UTC m=+0.391874650,LastTimestamp:2026-07-02 15:27:26.527018458 +0000 UTC m=+0.391874650,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-25.ec2.internal,}" Jul 02 15:27:26.566295 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.566274 2549 manager.go:337] "Starting Device Plugin manager" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.566318 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.566329 2549 server.go:87] "Starting device plugin registration server" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.566580 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.566592 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.566702 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.566786 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.566814 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.567475 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.567528 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.571246 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.572414 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.572452 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.572473 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.572512 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 15:27:26.577823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.574765 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:26.666878 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.666842 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.667893 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.667828 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.667893 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.667863 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.667893 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.667876 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.668068 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.667908 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.672975 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.672956 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal"] Jul 02 15:27:26.673038 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.673022 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.673856 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.673838 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.673968 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.673884 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.673968 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.673905 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.675302 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.675286 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.675437 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.675417 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.675493 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.675455 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.676044 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.676021 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.676126 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.676047 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.676126 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.676062 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.676126 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.676081 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.676126 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.676090 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.676126 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.676064 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.676844 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.676832 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.676898 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.676850 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-25.ec2.internal\": node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:26.678000 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.677985 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.678103 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.678007 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:27:26.678669 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.678634 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:27:26.678749 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.678682 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:27:26.678749 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.678699 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:27:26.695219 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.695201 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-25.ec2.internal\" not found" node="ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.699201 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.699182 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-25.ec2.internal\" not found" node="ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.700283 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.700266 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:26.709524 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.709505 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1ab4c0d6465e7f5a7a74878f3504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"8e1ab4c0d6465e7f5a7a74878f3504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.709620 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.709531 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.709620 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.709550 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.800378 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.800348 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:26.810044 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.810022 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1ab4c0d6465e7f5a7a74878f3504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"8e1ab4c0d6465e7f5a7a74878f3504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.810127 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.810049 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.810127 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.810072 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.810127 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.810111 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.810226 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.810128 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1ab4c0d6465e7f5a7a74878f3504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"8e1ab4c0d6465e7f5a7a74878f3504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.810226 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.810132 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:26.900980 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:26.900934 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:26.998842 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:26.998783 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:27.001831 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.001789 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:27.002885 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.002872 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 02 15:27:27.102914 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.102873 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:27.203392 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.203360 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:27.303983 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.303905 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:27.404485 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.404450 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 02 15:27:27.443880 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.443851 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 15:27:27.444455 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.443999 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:27:27.466027 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.465973 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1ab4c0d6465e7f5a7a74878f3504c3.slice/crio-edea56b017c3656a8c596793a8cbfbcc229c6ff2168b3bca31e0eb1f44d845ad WatchSource:0}: Error finding container edea56b017c3656a8c596793a8cbfbcc229c6ff2168b3bca31e0eb1f44d845ad: Status 404 returned error can't find the container with id edea56b017c3656a8c596793a8cbfbcc229c6ff2168b3bca31e0eb1f44d845ad Jul 02 15:27:27.466336 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.466324 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8addf80ffef511284ff88389f3e758ea.slice/crio-348da6443d8c91e6ba4dd3b6e5af9a635c652f9df91689fbcf52e7b7fe8b8861 WatchSource:0}: Error finding container 348da6443d8c91e6ba4dd3b6e5af9a635c652f9df91689fbcf52e7b7fe8b8861: Status 404 returned error can't find the container with id 348da6443d8c91e6ba4dd3b6e5af9a635c652f9df91689fbcf52e7b7fe8b8861 Jul 02 15:27:27.472274 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.472260 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:27:27.481004 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.480987 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:27.487707 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.487688 2549 apiserver.go:52] "Watching apiserver" Jul 02 15:27:27.497492 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.497468 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 15:27:27.498690 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.498669 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l","openshift-cluster-node-tuning-operator/tuned-4l9hk","openshift-dns/node-resolver-tpczq","openshift-network-diagnostics/network-check-target-xw8st","openshift-ovn-kubernetes/ovnkube-node-9wwd4","kube-system/global-pull-secret-syncer-8b2vb","kube-system/konnectivity-agent-zsz8n","openshift-image-registry/node-ca-6lgzk","openshift-multus/multus-additional-cni-plugins-7bwb8","openshift-multus/multus-gw2pv","openshift-multus/network-metrics-daemon-tm2v8","openshift-network-operator/iptables-alerter-q9clt"] Jul 02 15:27:27.500698 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.500681 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.501738 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.501720 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.502972 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.502955 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.503067 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.502975 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 15:27:27.503188 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.503169 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 15:27:27.503308 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.503290 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gzrsd\"" Jul 02 15:27:27.503377 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.503357 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 15:27:27.504043 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.504027 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.504741 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.504560 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 15:27:27.504741 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.504620 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 15:27:27.504741 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.504569 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5xkqh\"" Jul 02 15:27:27.504741 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.504673 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 15:27:27.505236 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.505091 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:27:27.505236 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.505162 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 15:27:27.505464 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.505251 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tcfs8\"" Jul 02 15:27:27.505464 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.505335 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:27.505464 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.505440 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:27.505769 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.505719 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 15:27:27.505842 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.505775 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9mzpb\"" Jul 02 15:27:27.506104 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.506085 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 15:27:27.506628 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.506612 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.507220 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.506747 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 15:27:27.507220 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.506955 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 02 15:27:27.508479 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.508463 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 15:27:27.508549 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.508496 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 15:27:27.508876 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.508712 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bh52k\"" Jul 02 15:27:27.509060 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.509044 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 15:27:27.509142 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.509046 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 15:27:27.509201 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.509158 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 15:27:27.509626 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.509612 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 15:27:27.509911 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.509895 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.509987 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.509947 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:27.511044 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.511025 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.512993 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.512973 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.513082 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513013 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87xsd\" (UniqueName: \"kubernetes.io/projected/a496d1d4-a398-481d-82ca-9a1f72745d53-kube-api-access-87xsd\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.513082 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysconfig\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.513082 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513070 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-var-lib-kubelet\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513092 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-tuned\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513117 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-systemd-units\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513142 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-ovn\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513165 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-sys-fs\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513188 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-run\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513214 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df8h8\" (UniqueName: \"kubernetes.io/projected/b224e118-ed34-4948-8a59-db55276adaad-kube-api-access-df8h8\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513255 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-slash\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513300 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-node-log\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513330 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-log-socket\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513396 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-cni-bin\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513413 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-kubernetes\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-etc-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513463 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513491 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-ovnkube-script-lib\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513498 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513518 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rhqq\" (UniqueName: \"kubernetes.io/projected/eb17ecef-a11c-4858-9e47-b65838828f9b-kube-api-access-7rhqq\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.513627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513538 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513551 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tbtjf\"" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513580 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-socket-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513622 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513616 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a496d1d4-a398-481d-82ca-9a1f72745d53-host\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513677 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a496d1d4-a398-481d-82ca-9a1f72745d53-serviceca\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513706 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-systemd\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-cni-netd\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513773 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513800 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-lib-modules\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513824 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b224e118-ed34-4948-8a59-db55276adaad-hosts-file\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513848 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b224e118-ed34-4948-8a59-db55276adaad-tmp-dir\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513872 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513920 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-run-netns\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513946 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-var-lib-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.513971 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514028 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-device-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514070 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-kubelet\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.514444 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514099 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-ovnkube-config\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514123 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-env-overrides\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514147 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb17ecef-a11c-4858-9e47-b65838828f9b-ovn-node-metrics-cert\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514191 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysctl-d\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514217 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysctl-conf\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514241 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-systemd\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514265 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14a03165-9d9b-47ee-91cf-d074540c4b19-kubelet-config\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514289 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14a03165-9d9b-47ee-91cf-d074540c4b19-dbus\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514327 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-registration-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514349 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514372 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-modprobe-d\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514396 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-sys\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514433 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-host\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514458 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-tmp\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514473 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfbn5\" (UniqueName: \"kubernetes.io/projected/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-kube-api-access-nfbn5\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514495 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514534 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.515205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514573 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2tlb\" (UniqueName: \"kubernetes.io/projected/dd3008b9-ee31-4307-b772-44731cb59d39-kube-api-access-z2tlb\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.515818 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.514716 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 15:27:27.515818 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.515394 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:27.515818 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.515667 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:27.516788 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.516360 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 15:27:27.516788 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.516584 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 15:27:27.516788 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.516670 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 15:27:27.517695 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.517147 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xpgcr\"" Jul 02 15:27:27.517695 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.517213 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 15:27:27.517695 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.517526 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 15:27:27.517695 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.517548 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bb86j\"" Jul 02 15:27:27.519366 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.519346 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.519940 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.519926 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:27:27.520005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.519998 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 02 15:27:27.520434 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.520415 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal"] Jul 02 15:27:27.521438 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.521420 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 15:27:27.521438 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.521435 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:27:27.521568 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.521541 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 15:27:27.521913 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.521895 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x5mc7\"" Jul 02 15:27:27.524061 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.524042 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:27:27.524179 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.524140 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 15:22:26 +0000 UTC" deadline="2028-02-26 02:33:21.415897046 +0000 UTC" Jul 02 15:27:27.524266 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.524180 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14483h5m53.891719344s" Jul 02 15:27:27.528293 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.528273 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:27:27.528440 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.528424 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal"] Jul 02 15:27:27.549123 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.549098 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqxx9" Jul 02 15:27:27.556314 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.556259 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqxx9" Jul 02 15:27:27.575844 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.575799 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"8addf80ffef511284ff88389f3e758ea","Type":"ContainerStarted","Data":"348da6443d8c91e6ba4dd3b6e5af9a635c652f9df91689fbcf52e7b7fe8b8861"} Jul 02 15:27:27.576855 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.576832 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" event={"ID":"8e1ab4c0d6465e7f5a7a74878f3504c3","Type":"ContainerStarted","Data":"edea56b017c3656a8c596793a8cbfbcc229c6ff2168b3bca31e0eb1f44d845ad"} Jul 02 15:27:27.608613 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.608590 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 15:27:27.614948 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.614924 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.615099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.614955 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-ovn\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.614974 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:27.615099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.614992 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-os-release\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.615099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615017 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-netns\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.615099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615046 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df8h8\" (UniqueName: \"kubernetes.io/projected/b224e118-ed34-4948-8a59-db55276adaad-kube-api-access-df8h8\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.615099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615056 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-ovn\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615069 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-slash\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615111 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-slash\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-node-log\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615142 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-node-log\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615149 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-log-socket\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615174 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-cni-bin\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615203 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ba4ea5-4738-4a52-b912-0e19c086f52d-host-slash\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615177 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-log-socket\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615232 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-system-cni-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615231 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-cni-bin\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615266 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615322 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615342 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rhqq\" (UniqueName: \"kubernetes.io/projected/eb17ecef-a11c-4858-9e47-b65838828f9b-kube-api-access-7rhqq\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615369 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.615384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615392 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a496d1d4-a398-481d-82ca-9a1f72745d53-host\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615430 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a496d1d4-a398-481d-82ca-9a1f72745d53-serviceca\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615447 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-cni-bin\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.615458 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615466 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-daemon-config\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615477 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a496d1d4-a398-481d-82ca-9a1f72745d53-host\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615488 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-multus-certs\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615527 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-systemd\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.615548 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret podName:14a03165-9d9b-47ee-91cf-d074540c4b19 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:28.115529756 +0000 UTC m=+1.980385936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret") pod "global-pull-secret-syncer-8b2vb" (UID: "14a03165-9d9b-47ee-91cf-d074540c4b19") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615608 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-systemd\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615613 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-cni-netd\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615678 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615683 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-cni-netd\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615713 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56ee9c6b-baa2-4da2-a5f6-db977253977b-agent-certs\") pod \"konnectivity-agent-zsz8n\" (UID: \"56ee9c6b-baa2-4da2-a5f6-db977253977b\") " pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615756 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56ee9c6b-baa2-4da2-a5f6-db977253977b-konnectivity-ca\") pod \"konnectivity-agent-zsz8n\" (UID: \"56ee9c6b-baa2-4da2-a5f6-db977253977b\") " pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615781 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-etc-kubernetes\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615786 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.616005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615825 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615849 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-var-lib-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615865 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615880 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-device-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615921 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a496d1d4-a398-481d-82ca-9a1f72745d53-serviceca\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615923 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-socket-dir-parent\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615945 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615964 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-var-lib-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.615981 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-systemd\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616000 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-device-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616009 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfbn5\" (UniqueName: \"kubernetes.io/projected/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-kube-api-access-nfbn5\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616055 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6cg\" (UniqueName: \"kubernetes.io/projected/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-kube-api-access-gj6cg\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616074 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-cni-multus\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616082 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-systemd\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616090 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-kubelet\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616128 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p425\" (UniqueName: \"kubernetes.io/projected/7e41d4f5-bd22-441c-82e2-69b68080db60-kube-api-access-8p425\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616144 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14a03165-9d9b-47ee-91cf-d074540c4b19-kubelet-config\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.616812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616162 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14a03165-9d9b-47ee-91cf-d074540c4b19-dbus\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616185 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-registration-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616204 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-modprobe-d\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616226 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7sj\" (UniqueName: \"kubernetes.io/projected/d9ba4ea5-4738-4a52-b912-0e19c086f52d-kube-api-access-6h7sj\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616228 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14a03165-9d9b-47ee-91cf-d074540c4b19-kubelet-config\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616268 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616266 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-registration-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616300 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2tlb\" (UniqueName: \"kubernetes.io/projected/dd3008b9-ee31-4307-b772-44731cb59d39-kube-api-access-z2tlb\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616316 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14a03165-9d9b-47ee-91cf-d074540c4b19-dbus\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616321 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616328 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87xsd\" (UniqueName: \"kubernetes.io/projected/a496d1d4-a398-481d-82ca-9a1f72745d53-kube-api-access-87xsd\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616352 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-tuned\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616316 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-modprobe-d\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616397 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-system-cni-dir\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616432 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-cni-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616451 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-conf-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616476 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-systemd-units\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.617475 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616520 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-systemd-units\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616551 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-sys-fs\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616588 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-sys-fs\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616594 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-run\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616611 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616622 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616689 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-run\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616709 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-kubernetes\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616735 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-etc-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616760 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-ovnkube-script-lib\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616784 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-socket-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616797 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-kubernetes\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616827 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-etc-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616837 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-lib-modules\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616866 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e41d4f5-bd22-441c-82e2-69b68080db60-cni-binary-copy\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616892 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cnibin\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616907 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd3008b9-ee31-4307-b772-44731cb59d39-socket-dir\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616919 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b224e118-ed34-4948-8a59-db55276adaad-hosts-file\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.618130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616946 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b224e118-ed34-4948-8a59-db55276adaad-tmp-dir\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616953 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b224e118-ed34-4948-8a59-db55276adaad-hosts-file\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616982 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-run-netns\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617000 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-run-netns\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.616983 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-lib-modules\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617011 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617036 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-cnibin\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617061 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-k8s-cni-cncf-io\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617090 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-hostroot\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617122 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwj5t\" (UniqueName: \"kubernetes.io/projected/5e28d45a-fd9a-44be-8366-927ee969e3fd-kube-api-access-rwj5t\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617150 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-kubelet\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617171 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-ovnkube-config\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617192 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-env-overrides\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617233 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b224e118-ed34-4948-8a59-db55276adaad-tmp-dir\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617200 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-host-kubelet\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617236 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb17ecef-a11c-4858-9e47-b65838828f9b-ovn-node-metrics-cert\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617327 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysctl-d\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.618658 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617348 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-ovnkube-script-lib\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysctl-conf\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617376 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-tmp\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617397 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-sys\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617416 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-host\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ba4ea5-4738-4a52-b912-0e19c086f52d-iptables-alerter-script\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617508 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-sys\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617517 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysctl-conf\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617562 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617588 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-os-release\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617609 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-host\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617614 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617670 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb17ecef-a11c-4858-9e47-b65838828f9b-run-openvswitch\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617659 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysconfig\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617467 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysctl-d\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617728 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-ovnkube-config\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617733 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-var-lib-kubelet\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617804 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-sysconfig\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617886 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-var-lib-kubelet\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619958 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.617737 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb17ecef-a11c-4858-9e47-b65838828f9b-env-overrides\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.619958 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.619867 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-tmp\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.619958 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.619947 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-etc-tuned\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.620144 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.620121 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb17ecef-a11c-4858-9e47-b65838828f9b-ovn-node-metrics-cert\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.625310 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.625290 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:27.625310 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.625314 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:27.625470 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.625324 2549 projected.go:196] Error preparing data for projected volume kube-api-access-svvtq for pod openshift-network-diagnostics/network-check-target-xw8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:27.625470 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.625408 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq podName:fa4ab49a-79ab-40b1-895b-d60d887e411c nodeName:}" failed. No retries permitted until 2026-07-02 15:27:28.125386176 +0000 UTC m=+1.990242351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-svvtq" (UniqueName: "kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq") pod "network-check-target-xw8st" (UID: "fa4ab49a-79ab-40b1-895b-d60d887e411c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:27.629592 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.627415 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87xsd\" (UniqueName: \"kubernetes.io/projected/a496d1d4-a398-481d-82ca-9a1f72745d53-kube-api-access-87xsd\") pod \"node-ca-6lgzk\" (UID: \"a496d1d4-a398-481d-82ca-9a1f72745d53\") " pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.629592 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.627612 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfbn5\" (UniqueName: \"kubernetes.io/projected/a88bf094-985c-4679-bb58-f3ddf9c4fd7f-kube-api-access-nfbn5\") pod \"tuned-4l9hk\" (UID: \"a88bf094-985c-4679-bb58-f3ddf9c4fd7f\") " pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.629592 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.627685 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2tlb\" (UniqueName: \"kubernetes.io/projected/dd3008b9-ee31-4307-b772-44731cb59d39-kube-api-access-z2tlb\") pod \"aws-ebs-csi-driver-node-8ss6l\" (UID: \"dd3008b9-ee31-4307-b772-44731cb59d39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.629984 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.629945 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rhqq\" (UniqueName: \"kubernetes.io/projected/eb17ecef-a11c-4858-9e47-b65838828f9b-kube-api-access-7rhqq\") pod \"ovnkube-node-9wwd4\" (UID: \"eb17ecef-a11c-4858-9e47-b65838828f9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.630030 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.629965 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df8h8\" (UniqueName: \"kubernetes.io/projected/b224e118-ed34-4948-8a59-db55276adaad-kube-api-access-df8h8\") pod \"node-resolver-tpczq\" (UID: \"b224e118-ed34-4948-8a59-db55276adaad\") " pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.718431 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e41d4f5-bd22-441c-82e2-69b68080db60-cni-binary-copy\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.718431 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718433 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cnibin\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718451 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718468 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-cnibin\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718485 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-k8s-cni-cncf-io\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718507 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-hostroot\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cnibin\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718548 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwj5t\" (UniqueName: \"kubernetes.io/projected/5e28d45a-fd9a-44be-8366-927ee969e3fd-kube-api-access-rwj5t\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718571 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-cnibin\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718575 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-k8s-cni-cncf-io\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718596 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-hostroot\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718611 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ba4ea5-4738-4a52-b912-0e19c086f52d-iptables-alerter-script\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.718684 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718682 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718714 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-os-release\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718841 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718856 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-os-release\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718872 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718910 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-os-release\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718935 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-netns\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718975 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ba4ea5-4738-4a52-b912-0e19c086f52d-host-slash\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.718999 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-system-cni-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719005 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-os-release\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719025 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-netns\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719053 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-cni-bin\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719057 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e41d4f5-bd22-441c-82e2-69b68080db60-cni-binary-copy\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719077 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-daemon-config\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719083 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-cni-bin\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.719090 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719084 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-system-cni-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.719873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719100 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-multus-certs\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719131 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-run-multus-certs\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719132 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56ee9c6b-baa2-4da2-a5f6-db977253977b-agent-certs\") pod \"konnectivity-agent-zsz8n\" (UID: \"56ee9c6b-baa2-4da2-a5f6-db977253977b\") " pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:27.719158 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs podName:5e28d45a-fd9a-44be-8366-927ee969e3fd nodeName:}" failed. No retries permitted until 2026-07-02 15:27:28.219140604 +0000 UTC m=+2.083996785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs") pod "network-metrics-daemon-tm2v8" (UID: "5e28d45a-fd9a-44be-8366-927ee969e3fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719226 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56ee9c6b-baa2-4da2-a5f6-db977253977b-konnectivity-ca\") pod \"konnectivity-agent-zsz8n\" (UID: \"56ee9c6b-baa2-4da2-a5f6-db977253977b\") " pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719054 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ba4ea5-4738-4a52-b912-0e19c086f52d-host-slash\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719254 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-etc-kubernetes\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719287 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719292 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ba4ea5-4738-4a52-b912-0e19c086f52d-iptables-alerter-script\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719290 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-etc-kubernetes\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719317 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-socket-dir-parent\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6cg\" (UniqueName: \"kubernetes.io/projected/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-kube-api-access-gj6cg\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719368 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719379 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-cni-multus\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719404 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-kubelet\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719424 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p425\" (UniqueName: \"kubernetes.io/projected/7e41d4f5-bd22-441c-82e2-69b68080db60-kube-api-access-8p425\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720418 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719427 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-cni-multus\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719442 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7sj\" (UniqueName: \"kubernetes.io/projected/d9ba4ea5-4738-4a52-b912-0e19c086f52d-kube-api-access-6h7sj\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719432 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-socket-dir-parent\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719468 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-system-cni-dir\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719485 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-host-var-lib-kubelet\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719492 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-cni-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719524 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-conf-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719546 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-cni-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719556 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-conf-dir\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719555 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719586 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-system-cni-dir\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719599 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e41d4f5-bd22-441c-82e2-69b68080db60-multus-daemon-config\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719736 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56ee9c6b-baa2-4da2-a5f6-db977253977b-konnectivity-ca\") pod \"konnectivity-agent-zsz8n\" (UID: \"56ee9c6b-baa2-4da2-a5f6-db977253977b\") " pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.720926 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.719998 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.721406 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.721389 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56ee9c6b-baa2-4da2-a5f6-db977253977b-agent-certs\") pod \"konnectivity-agent-zsz8n\" (UID: \"56ee9c6b-baa2-4da2-a5f6-db977253977b\") " pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.727301 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.727274 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwj5t\" (UniqueName: \"kubernetes.io/projected/5e28d45a-fd9a-44be-8366-927ee969e3fd-kube-api-access-rwj5t\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:27.727524 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.727509 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7sj\" (UniqueName: \"kubernetes.io/projected/d9ba4ea5-4738-4a52-b912-0e19c086f52d-kube-api-access-6h7sj\") pod \"iptables-alerter-q9clt\" (UID: \"d9ba4ea5-4738-4a52-b912-0e19c086f52d\") " pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.727955 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.727936 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6cg\" (UniqueName: \"kubernetes.io/projected/3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8-kube-api-access-gj6cg\") pod \"multus-additional-cni-plugins-7bwb8\" (UID: \"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8\") " pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.728308 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.728292 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:27.728563 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.728548 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p425\" (UniqueName: \"kubernetes.io/projected/7e41d4f5-bd22-441c-82e2-69b68080db60-kube-api-access-8p425\") pod \"multus-gw2pv\" (UID: \"7e41d4f5-bd22-441c-82e2-69b68080db60\") " pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.812219 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.812136 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" Jul 02 15:27:27.817997 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.817977 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6lgzk" Jul 02 15:27:27.820668 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.820632 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3008b9_ee31_4307_b772_44731cb59d39.slice/crio-8cd26ea4c9dfac3998d6084a7d704e7bd70a9479ebfb6e8c633c018bbc66e791 WatchSource:0}: Error finding container 8cd26ea4c9dfac3998d6084a7d704e7bd70a9479ebfb6e8c633c018bbc66e791: Status 404 returned error can't find the container with id 8cd26ea4c9dfac3998d6084a7d704e7bd70a9479ebfb6e8c633c018bbc66e791 Jul 02 15:27:27.824841 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.824815 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" Jul 02 15:27:27.825363 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.825339 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda496d1d4_a398_481d_82ca_9a1f72745d53.slice/crio-175f9ebeb7bcad5502ae636925bb745b4f88e429da5afad34cfa15f0b3ef987c WatchSource:0}: Error finding container 175f9ebeb7bcad5502ae636925bb745b4f88e429da5afad34cfa15f0b3ef987c: Status 404 returned error can't find the container with id 175f9ebeb7bcad5502ae636925bb745b4f88e429da5afad34cfa15f0b3ef987c Jul 02 15:27:27.828800 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.828709 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tpczq" Jul 02 15:27:27.833433 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.833410 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88bf094_985c_4679_bb58_f3ddf9c4fd7f.slice/crio-50f7c09385421121169512f0945e52b0cb2ac8c3d978ab655e9f0edb325703c0 WatchSource:0}: Error finding container 50f7c09385421121169512f0945e52b0cb2ac8c3d978ab655e9f0edb325703c0: Status 404 returned error can't find the container with id 50f7c09385421121169512f0945e52b0cb2ac8c3d978ab655e9f0edb325703c0 Jul 02 15:27:27.834188 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.834171 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:27.836387 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.836364 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb224e118_ed34_4948_8a59_db55276adaad.slice/crio-b8419c6e1ebd11e1a65af97acf0e1ea428cfd48b59f6e0af26c380cc99ca56c3 WatchSource:0}: Error finding container b8419c6e1ebd11e1a65af97acf0e1ea428cfd48b59f6e0af26c380cc99ca56c3: Status 404 returned error can't find the container with id b8419c6e1ebd11e1a65af97acf0e1ea428cfd48b59f6e0af26c380cc99ca56c3 Jul 02 15:27:27.838913 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.838891 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:27.843318 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.843290 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb17ecef_a11c_4858_9e47_b65838828f9b.slice/crio-dbe64af9e4e9205c3660f2a17ad2d17a6a26339ab503a699cd8654ca282479c8 WatchSource:0}: Error finding container dbe64af9e4e9205c3660f2a17ad2d17a6a26339ab503a699cd8654ca282479c8: Status 404 returned error can't find the container with id dbe64af9e4e9205c3660f2a17ad2d17a6a26339ab503a699cd8654ca282479c8 Jul 02 15:27:27.844382 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.844362 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" Jul 02 15:27:27.847338 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.847319 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ee9c6b_baa2_4da2_a5f6_db977253977b.slice/crio-056f382a3d0f734fc596c3ca5329523a83e09a582cd927eecb02426ec2eb0985 WatchSource:0}: Error finding container 056f382a3d0f734fc596c3ca5329523a83e09a582cd927eecb02426ec2eb0985: Status 404 returned error can't find the container with id 056f382a3d0f734fc596c3ca5329523a83e09a582cd927eecb02426ec2eb0985 Jul 02 15:27:27.850269 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.850245 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gw2pv" Jul 02 15:27:27.851983 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.851959 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f55abed_fdbb_4d2b_a2a3_05607c9a9ab8.slice/crio-42387893c1f1885645139197647c6542a804d543061b20378110ab282dd8690d WatchSource:0}: Error finding container 42387893c1f1885645139197647c6542a804d543061b20378110ab282dd8690d: Status 404 returned error can't find the container with id 42387893c1f1885645139197647c6542a804d543061b20378110ab282dd8690d Jul 02 15:27:27.855178 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:27.855159 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q9clt" Jul 02 15:27:27.860703 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.860629 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e41d4f5_bd22_441c_82e2_69b68080db60.slice/crio-0b55e7247c86b342a986c3beaa44ad5a339467376507ee97344586ac49798240 WatchSource:0}: Error finding container 0b55e7247c86b342a986c3beaa44ad5a339467376507ee97344586ac49798240: Status 404 returned error can't find the container with id 0b55e7247c86b342a986c3beaa44ad5a339467376507ee97344586ac49798240 Jul 02 15:27:27.865276 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:27:27.865249 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ba4ea5_4738_4a52_b912_0e19c086f52d.slice/crio-1fd9066346f5217e13b7eeb58fc2fb6310c41c2474d5f12e1c8543d9a9a0a3cf WatchSource:0}: Error finding container 1fd9066346f5217e13b7eeb58fc2fb6310c41c2474d5f12e1c8543d9a9a0a3cf: Status 404 returned error can't find the container with id 1fd9066346f5217e13b7eeb58fc2fb6310c41c2474d5f12e1c8543d9a9a0a3cf Jul 02 15:27:28.039565 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.039525 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:28.123546 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.123453 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:28.123746 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.123605 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:28.123746 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.123678 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret podName:14a03165-9d9b-47ee-91cf-d074540c4b19 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:29.123658438 +0000 UTC m=+2.988514618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret") pod "global-pull-secret-syncer-8b2vb" (UID: "14a03165-9d9b-47ee-91cf-d074540c4b19") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:28.224574 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.224532 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:28.224777 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.224730 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:28.224842 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.224792 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:28.224842 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.224805 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs podName:5e28d45a-fd9a-44be-8366-927ee969e3fd nodeName:}" failed. No retries permitted until 2026-07-02 15:27:29.224784557 +0000 UTC m=+3.089640760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs") pod "network-metrics-daemon-tm2v8" (UID: "5e28d45a-fd9a-44be-8366-927ee969e3fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:28.224958 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.224897 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:28.224958 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.224914 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:28.224958 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.224928 2549 projected.go:196] Error preparing data for projected volume kube-api-access-svvtq for pod openshift-network-diagnostics/network-check-target-xw8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:28.225102 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:28.224977 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq podName:fa4ab49a-79ab-40b1-895b-d60d887e411c nodeName:}" failed. No retries permitted until 2026-07-02 15:27:29.22496332 +0000 UTC m=+3.089819499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-svvtq" (UniqueName: "kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq") pod "network-check-target-xw8st" (UID: "fa4ab49a-79ab-40b1-895b-d60d887e411c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:28.292468 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.292430 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:27:28.558532 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.558340 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:22:27 +0000 UTC" deadline="2028-02-22 09:37:33.053913788 +0000 UTC" Jul 02 15:27:28.558532 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.558410 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14394h10m4.495510068s" Jul 02 15:27:28.583215 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.583173 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tpczq" event={"ID":"b224e118-ed34-4948-8a59-db55276adaad","Type":"ContainerStarted","Data":"b8419c6e1ebd11e1a65af97acf0e1ea428cfd48b59f6e0af26c380cc99ca56c3"} Jul 02 15:27:28.585826 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.585793 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" event={"ID":"a88bf094-985c-4679-bb58-f3ddf9c4fd7f","Type":"ContainerStarted","Data":"50f7c09385421121169512f0945e52b0cb2ac8c3d978ab655e9f0edb325703c0"} Jul 02 15:27:28.588828 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.588797 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6lgzk" event={"ID":"a496d1d4-a398-481d-82ca-9a1f72745d53","Type":"ContainerStarted","Data":"175f9ebeb7bcad5502ae636925bb745b4f88e429da5afad34cfa15f0b3ef987c"} Jul 02 15:27:28.596069 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.596038 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" event={"ID":"dd3008b9-ee31-4307-b772-44731cb59d39","Type":"ContainerStarted","Data":"8cd26ea4c9dfac3998d6084a7d704e7bd70a9479ebfb6e8c633c018bbc66e791"} Jul 02 15:27:28.601027 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.600942 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gw2pv" event={"ID":"7e41d4f5-bd22-441c-82e2-69b68080db60","Type":"ContainerStarted","Data":"0b55e7247c86b342a986c3beaa44ad5a339467376507ee97344586ac49798240"} Jul 02 15:27:28.609480 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.609443 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsz8n" event={"ID":"56ee9c6b-baa2-4da2-a5f6-db977253977b","Type":"ContainerStarted","Data":"056f382a3d0f734fc596c3ca5329523a83e09a582cd927eecb02426ec2eb0985"} Jul 02 15:27:28.613550 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.613517 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q9clt" event={"ID":"d9ba4ea5-4738-4a52-b912-0e19c086f52d","Type":"ContainerStarted","Data":"1fd9066346f5217e13b7eeb58fc2fb6310c41c2474d5f12e1c8543d9a9a0a3cf"} Jul 02 15:27:28.621905 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.621868 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerStarted","Data":"42387893c1f1885645139197647c6542a804d543061b20378110ab282dd8690d"} Jul 02 15:27:28.627167 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:28.627134 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"dbe64af9e4e9205c3660f2a17ad2d17a6a26339ab503a699cd8654ca282479c8"} Jul 02 15:27:29.133792 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.133746 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:29.134001 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.133969 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:29.134064 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.134046 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret podName:14a03165-9d9b-47ee-91cf-d074540c4b19 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:31.13402614 +0000 UTC m=+4.998882321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret") pod "global-pull-secret-syncer-8b2vb" (UID: "14a03165-9d9b-47ee-91cf-d074540c4b19") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:29.235198 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.235148 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:29.235403 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.235243 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:29.235476 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.235426 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:29.235476 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.235453 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:29.235476 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.235469 2549 projected.go:196] Error preparing data for projected volume kube-api-access-svvtq for pod openshift-network-diagnostics/network-check-target-xw8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:29.235639 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.235539 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq podName:fa4ab49a-79ab-40b1-895b-d60d887e411c nodeName:}" failed. No retries permitted until 2026-07-02 15:27:31.235520314 +0000 UTC m=+5.100376495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-svvtq" (UniqueName: "kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq") pod "network-check-target-xw8st" (UID: "fa4ab49a-79ab-40b1-895b-d60d887e411c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:29.236133 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.236106 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:29.236256 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.236174 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs podName:5e28d45a-fd9a-44be-8366-927ee969e3fd nodeName:}" failed. No retries permitted until 2026-07-02 15:27:31.236154985 +0000 UTC m=+5.101011167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs") pod "network-metrics-daemon-tm2v8" (UID: "5e28d45a-fd9a-44be-8366-927ee969e3fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:29.558897 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.558845 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:22:27 +0000 UTC" deadline="2028-03-07 04:04:45.980294667 +0000 UTC" Jul 02 15:27:29.558897 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.558896 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14724h37m16.421405078s" Jul 02 15:27:29.573010 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.572964 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:29.573238 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.573205 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:29.573331 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.573320 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:29.573441 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.573420 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:29.573900 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:29.573877 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:29.574043 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:29.573997 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:31.152576 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:31.152526 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:31.153096 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.152802 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:31.153096 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.152881 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret podName:14a03165-9d9b-47ee-91cf-d074540c4b19 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:35.152856931 +0000 UTC m=+9.017713123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret") pod "global-pull-secret-syncer-8b2vb" (UID: "14a03165-9d9b-47ee-91cf-d074540c4b19") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:31.254193 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:31.253412 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:31.254193 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:31.253513 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:31.254193 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.253664 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:31.254193 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.253701 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:31.254193 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.253716 2549 projected.go:196] Error preparing data for projected volume kube-api-access-svvtq for pod openshift-network-diagnostics/network-check-target-xw8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:31.254193 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.253786 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq podName:fa4ab49a-79ab-40b1-895b-d60d887e411c nodeName:}" failed. No retries permitted until 2026-07-02 15:27:35.253764087 +0000 UTC m=+9.118620265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-svvtq" (UniqueName: "kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq") pod "network-check-target-xw8st" (UID: "fa4ab49a-79ab-40b1-895b-d60d887e411c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:31.254193 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.254159 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:31.254858 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.254223 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs podName:5e28d45a-fd9a-44be-8366-927ee969e3fd nodeName:}" failed. No retries permitted until 2026-07-02 15:27:35.254205796 +0000 UTC m=+9.119061978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs") pod "network-metrics-daemon-tm2v8" (UID: "5e28d45a-fd9a-44be-8366-927ee969e3fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:31.573602 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:31.572724 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:31.573602 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.572876 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:31.573602 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:31.573282 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:31.573602 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.573377 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:31.573602 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:31.573430 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:31.573602 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:31.573505 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:33.573413 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:33.573362 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:33.573923 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:33.573523 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:33.574607 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:33.574231 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:33.574607 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:33.574360 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:33.574607 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:33.574467 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:33.574607 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:33.574543 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:35.186457 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:35.186047 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:35.186457 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.186232 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:35.187007 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.186471 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret podName:14a03165-9d9b-47ee-91cf-d074540c4b19 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:43.186446921 +0000 UTC m=+17.051303114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret") pod "global-pull-secret-syncer-8b2vb" (UID: "14a03165-9d9b-47ee-91cf-d074540c4b19") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:35.287117 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:35.287193 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.287229 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.287294 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs podName:5e28d45a-fd9a-44be-8366-927ee969e3fd nodeName:}" failed. No retries permitted until 2026-07-02 15:27:43.287276229 +0000 UTC m=+17.152132417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs") pod "network-metrics-daemon-tm2v8" (UID: "5e28d45a-fd9a-44be-8366-927ee969e3fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.287309 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.287323 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.287337 2549 projected.go:196] Error preparing data for projected volume kube-api-access-svvtq for pod openshift-network-diagnostics/network-check-target-xw8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:35.287403 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.287374 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq podName:fa4ab49a-79ab-40b1-895b-d60d887e411c nodeName:}" failed. No retries permitted until 2026-07-02 15:27:43.287362265 +0000 UTC m=+17.152218460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-svvtq" (UniqueName: "kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq") pod "network-check-target-xw8st" (UID: "fa4ab49a-79ab-40b1-895b-d60d887e411c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:35.573408 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:35.573325 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:35.573568 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.573477 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:35.573568 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:35.573549 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:35.573714 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.573619 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:35.573714 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:35.573678 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:35.573818 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:35.573757 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:37.573049 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:37.573010 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:37.573540 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:37.573010 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:37.573540 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:37.573017 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:37.573540 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:37.573259 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:37.573540 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:37.573209 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:37.573540 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:37.573394 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:39.573040 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:39.572916 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:39.573040 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:39.572950 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:39.573040 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:39.572962 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:39.573559 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:39.573064 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:39.573559 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:39.573148 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:39.573559 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:39.573244 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:41.573023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:41.572953 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:41.573023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:41.572968 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:41.573526 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:41.572954 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:41.573526 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:41.573080 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:41.573526 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:41.573173 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:41.573526 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:41.573216 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:43.244255 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:43.244175 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:43.244676 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.244312 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:43.244676 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.244367 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret podName:14a03165-9d9b-47ee-91cf-d074540c4b19 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:59.244354593 +0000 UTC m=+33.109210771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret") pod "global-pull-secret-syncer-8b2vb" (UID: "14a03165-9d9b-47ee-91cf-d074540c4b19") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:43.344628 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:43.344590 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:43.344808 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:43.344659 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:43.344808 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.344743 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:43.344808 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.344758 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:43.344808 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.344777 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:43.344808 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.344800 2549 projected.go:196] Error preparing data for projected volume kube-api-access-svvtq for pod openshift-network-diagnostics/network-check-target-xw8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:43.344808 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.344808 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs podName:5e28d45a-fd9a-44be-8366-927ee969e3fd nodeName:}" failed. No retries permitted until 2026-07-02 15:27:59.344792541 +0000 UTC m=+33.209648716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs") pod "network-metrics-daemon-tm2v8" (UID: "5e28d45a-fd9a-44be-8366-927ee969e3fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:43.345022 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.344844 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq podName:fa4ab49a-79ab-40b1-895b-d60d887e411c nodeName:}" failed. No retries permitted until 2026-07-02 15:27:59.34483306 +0000 UTC m=+33.209689235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-svvtq" (UniqueName: "kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq") pod "network-check-target-xw8st" (UID: "fa4ab49a-79ab-40b1-895b-d60d887e411c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:43.573192 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:43.573154 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:43.573192 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:43.573181 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:43.573453 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:43.573285 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:43.573453 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.573294 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:43.573558 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.573451 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:43.573558 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:43.573544 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:45.573005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:45.572965 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:45.573425 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:45.573027 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:45.573425 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:45.573137 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:45.573425 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:45.573177 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:45.573425 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:45.573251 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:45.573425 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:45.573309 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:47.572746 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:47.572717 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:47.572746 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:47.572742 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:47.573207 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:47.572779 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:47.573207 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:47.572882 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:47.573207 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:47.573008 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:47.573207 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:47.573067 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:48.673050 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.672597 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" event={"ID":"8e1ab4c0d6465e7f5a7a74878f3504c3","Type":"ContainerStarted","Data":"d89eaf9037c0b5f43d7261978773d34f8e24511e39c489c95a4b8ff8a29e0c77"} Jul 02 15:27:48.675907 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.675728 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gw2pv" event={"ID":"7e41d4f5-bd22-441c-82e2-69b68080db60","Type":"ContainerStarted","Data":"88bcd33b0ae17ba531ef2a544b918a0d46473abd7c48260ff51deabc8329e395"} Jul 02 15:27:48.678229 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.678167 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:27:48.678618 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.678599 2549 generic.go:356] "Generic (PLEG): container finished" podID="eb17ecef-a11c-4858-9e47-b65838828f9b" containerID="f8940d7e858a63aebaf5b409cc2f01d3f63b1a10e4ffafa6efeb396b24232194" exitCode=1 Jul 02 15:27:48.678718 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.678670 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"4be6957019023004cfebc595ac2a23c222cb50ac26327c38eb91d7199b8d7822"} Jul 02 15:27:48.678768 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.678735 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerDied","Data":"f8940d7e858a63aebaf5b409cc2f01d3f63b1a10e4ffafa6efeb396b24232194"} Jul 02 15:27:48.678819 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.678776 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"f85ef5eb317183ef70e78546dce0bb8e4a7d24a170df739322b9fca098fb6ab0"} Jul 02 15:27:48.682268 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.682218 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" event={"ID":"a88bf094-985c-4679-bb58-f3ddf9c4fd7f","Type":"ContainerStarted","Data":"732aa26057df7b517710bcce35ddb07d74daa5e81e02b508c4d68b35456ae37c"} Jul 02 15:27:48.690671 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.690608 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" podStartSLOduration=21.690592477 podStartE2EDuration="21.690592477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:48.689686588 +0000 UTC m=+22.554542790" watchObservedRunningTime="2026-07-02 15:27:48.690592477 +0000 UTC m=+22.555448673" Jul 02 15:27:48.707413 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.707338 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4l9hk" podStartSLOduration=1.952442365 podStartE2EDuration="21.707323184s" totalImagesPullingTime="19.754880819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:48.706971725 +0000 UTC m=+22.571827922" watchObservedRunningTime="2026-07-02 15:27:48.707323184 +0000 UTC m=+22.572179380" Jul 02 15:27:48.724237 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:48.724197 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gw2pv" podStartSLOduration=1.964356318 podStartE2EDuration="21.724181585s" totalImagesPullingTime="19.759825267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:48.723784483 +0000 UTC m=+22.588640680" watchObservedRunningTime="2026-07-02 15:27:48.724181585 +0000 UTC m=+22.589037782" Jul 02 15:27:49.573877 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.573674 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:49.574111 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.573674 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:49.574111 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:49.573957 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:49.574111 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.573675 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:49.574111 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:49.574040 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:49.574322 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:49.574130 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:49.685864 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.685828 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsz8n" event={"ID":"56ee9c6b-baa2-4da2-a5f6-db977253977b","Type":"ContainerStarted","Data":"679fb1f0dda311619c2c05271520a218f571900f58a982a185926fd53a4e1f9a"} Jul 02 15:27:49.687267 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.687245 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q9clt" event={"ID":"d9ba4ea5-4738-4a52-b912-0e19c086f52d","Type":"ContainerStarted","Data":"0f02a2d26527a1c6a1b9bab1f45887df85d3373328b07732f66554ea3999f95b"} Jul 02 15:27:49.688879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.688855 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8" containerID="dbc658e53473e6e6d2273036e64d40387eae8096c319b6bf34ada491cd0bd78d" exitCode=0 Jul 02 15:27:49.688958 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.688943 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerDied","Data":"dbc658e53473e6e6d2273036e64d40387eae8096c319b6bf34ada491cd0bd78d"} Jul 02 15:27:49.691816 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.691799 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:27:49.692202 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.692183 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"971c70900742abf2b90b31d919db70f9bd10b788c0affeeedbbc8305d52063f5"} Jul 02 15:27:49.692298 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.692253 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"29dd7501f643d15e144d51ba83bdb38f0054704d970454b81953f6ff4bb41b11"} Jul 02 15:27:49.692353 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.692301 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"8a67b7942168f7685fb50da9e08fab889d032ca338843e294df89b668d0e7afb"} Jul 02 15:27:49.693482 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.693452 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tpczq" event={"ID":"b224e118-ed34-4948-8a59-db55276adaad","Type":"ContainerStarted","Data":"afeeb4433824bde9bb59dc4421292b1d814d24860fdfe8ce1e4dda098af966a0"} Jul 02 15:27:49.694740 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.694722 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6lgzk" event={"ID":"a496d1d4-a398-481d-82ca-9a1f72745d53","Type":"ContainerStarted","Data":"4adf1b2b7b723257c88c149b907361446bedc42aae99f580f17684e822e7726f"} Jul 02 15:27:49.696236 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.696206 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" event={"ID":"dd3008b9-ee31-4307-b772-44731cb59d39","Type":"ContainerStarted","Data":"56d602453c95faf212692001e0ae361c8047b14d3b9396fc52e7db403fbdd2eb"} Jul 02 15:27:49.697539 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.697517 2549 generic.go:356] "Generic (PLEG): container finished" podID="8addf80ffef511284ff88389f3e758ea" containerID="2b32631ecfbccadb76a51e0d05c5977ab547254a5bffca98c15f53aeb30d7f17" exitCode=0 Jul 02 15:27:49.697618 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.697573 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"8addf80ffef511284ff88389f3e758ea","Type":"ContainerDied","Data":"2b32631ecfbccadb76a51e0d05c5977ab547254a5bffca98c15f53aeb30d7f17"} Jul 02 15:27:49.702726 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.702680 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zsz8n" podStartSLOduration=2.996909729 podStartE2EDuration="22.702666602s" totalImagesPullingTime="19.705756873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.702495307 +0000 UTC m=+23.567351530" watchObservedRunningTime="2026-07-02 15:27:49.702666602 +0000 UTC m=+23.567522796" Jul 02 15:27:49.726900 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.726857 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q9clt" podStartSLOduration=3.005997308 podStartE2EDuration="22.726842129s" totalImagesPullingTime="19.720844821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.726216981 +0000 UTC m=+23.591073178" watchObservedRunningTime="2026-07-02 15:27:49.726842129 +0000 UTC m=+23.591698337" Jul 02 15:27:49.780610 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.780561 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tpczq" podStartSLOduration=7.668791076 podStartE2EDuration="22.780543716s" totalImagesPullingTime="15.11175264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.748597352 +0000 UTC m=+23.613453551" watchObservedRunningTime="2026-07-02 15:27:49.780543716 +0000 UTC m=+23.645399913" Jul 02 15:27:49.810436 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:49.810386 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6lgzk" podStartSLOduration=4.047612568 podStartE2EDuration="23.810368809s" totalImagesPullingTime="19.762756241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:49.809803865 +0000 UTC m=+23.674660063" watchObservedRunningTime="2026-07-02 15:27:49.810368809 +0000 UTC m=+23.675225048" Jul 02 15:27:50.106951 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:50.106917 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:50.632439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:50.632407 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 15:27:50.701823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:50.701779 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" event={"ID":"dd3008b9-ee31-4307-b772-44731cb59d39","Type":"ContainerStarted","Data":"a18ccb76161d660aebc2f07f62fc7cf82b67109bf086e7bc8a5781a4504a397d"} Jul 02 15:27:50.704006 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:50.703968 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"8addf80ffef511284ff88389f3e758ea","Type":"ContainerStarted","Data":"e175b5e35835c4f4230677fa6d6abd6d23a05245cd3bc42c19151944864d630e"} Jul 02 15:27:50.720481 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:50.720429 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" podStartSLOduration=23.720408416 podStartE2EDuration="23.720408416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:50.720107944 +0000 UTC m=+24.584964141" watchObservedRunningTime="2026-07-02 15:27:50.720408416 +0000 UTC m=+24.585264615" Jul 02 15:27:50.798628 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:50.798577 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:50.799211 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:50.799189 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:51.573250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.573210 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:51.573420 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.573232 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:51.573420 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:51.573338 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:51.573420 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.573231 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:51.573420 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:51.573399 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:51.573562 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:51.573479 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:51.579279 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.579172 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T15:27:50.632432235Z","UUID":"324a9881-db24-4995-83b2-4118eb0858fc","Handler":null,"Name":"","Endpoint":""} Jul 02 15:27:51.581141 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.580981 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 15:27:51.581141 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.581025 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 15:27:51.710435 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.710403 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:27:51.710904 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.710822 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"28fe6eb90802ca4352c9b3743e2bb3bdaafcb6aacbb351ab027c6f6f9ef9067d"} Jul 02 15:27:51.711859 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:51.711830 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zsz8n" Jul 02 15:27:52.715778 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:52.715580 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" event={"ID":"dd3008b9-ee31-4307-b772-44731cb59d39","Type":"ContainerStarted","Data":"5104f7c58deb413d3c93bd5eaa46bf6e670c2b6d4d04a1486b7ca6de5be60005"} Jul 02 15:27:52.734126 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:52.734069 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ss6l" podStartSLOduration=4.418775695 podStartE2EDuration="26.734047575s" totalImagesPullingTime="22.31527188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:52.733421655 +0000 UTC m=+26.598277849" watchObservedRunningTime="2026-07-02 15:27:52.734047575 +0000 UTC m=+26.598903776" Jul 02 15:27:53.573544 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:53.573502 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:53.573544 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:53.573544 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:53.573544 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:53.573546 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:53.573871 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:53.573630 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:53.573871 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:53.573700 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:53.573871 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:53.573782 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:54.721826 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.721528 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerStarted","Data":"6053c3f6a65456fe6a6ac29d2c8e36c50df8f526c535e06b1c3efa909d6efbf1"} Jul 02 15:27:54.727066 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.727044 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:27:54.727474 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.727449 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"39855eb2c78b9be0380db261dffcded8ffb3e2abbdd1dc90b9835e24953fda33"} Jul 02 15:27:54.727861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.727831 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:54.727971 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.727897 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:54.727971 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.727965 2549 scope.go:117] "RemoveContainer" containerID="f8940d7e858a63aebaf5b409cc2f01d3f63b1a10e4ffafa6efeb396b24232194" Jul 02 15:27:54.743914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.743888 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:54.744548 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:54.744527 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:55.573625 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.573591 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:55.574029 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.573595 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:55.574029 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.573595 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:55.574029 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:55.573794 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:55.574029 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:55.573893 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:55.574029 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:55.573971 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:55.632308 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.632273 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:27:55.731083 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.731049 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8" containerID="6053c3f6a65456fe6a6ac29d2c8e36c50df8f526c535e06b1c3efa909d6efbf1" exitCode=0 Jul 02 15:27:55.731548 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.731131 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerDied","Data":"6053c3f6a65456fe6a6ac29d2c8e36c50df8f526c535e06b1c3efa909d6efbf1"} Jul 02 15:27:55.735144 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.735124 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:27:55.735568 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.735544 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" event={"ID":"eb17ecef-a11c-4858-9e47-b65838828f9b","Type":"ContainerStarted","Data":"7bc0bd0c848b170db1ad1e53b3cc8d3451b580cd5278273b87a4f4a3514f0e38"} Jul 02 15:27:55.779785 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:55.779733 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" podStartSLOduration=8.353517445 podStartE2EDuration="28.779718185s" totalImagesPullingTime="20.42620074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:55.779121128 +0000 UTC m=+29.643977326" watchObservedRunningTime="2026-07-02 15:27:55.779718185 +0000 UTC m=+29.644574395" Jul 02 15:27:56.809820 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:56.809288 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8b2vb"] Jul 02 15:27:56.809820 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:56.809459 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:56.810162 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:56.809629 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:56.811275 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:56.811247 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tm2v8"] Jul 02 15:27:56.811421 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:56.811361 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:56.811482 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:56.811448 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:56.811898 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:56.811873 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xw8st"] Jul 02 15:27:56.812006 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:56.811982 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:56.812094 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:56.812075 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:57.743544 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:57.743295 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8" containerID="324b24e26d009fc2f8374e34e1472e0b90c0f25a9c5342d6433579bbdb25fa59" exitCode=0 Jul 02 15:27:57.743709 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:57.743378 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerDied","Data":"324b24e26d009fc2f8374e34e1472e0b90c0f25a9c5342d6433579bbdb25fa59"} Jul 02 15:27:58.089883 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:58.089856 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tpczq_b224e118-ed34-4948-8a59-db55276adaad/dns-node-resolver/0.log" Jul 02 15:27:58.572837 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:58.572800 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:58.572991 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:58.572800 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:58.572991 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:58.572908 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:27:58.573090 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:58.573001 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:27:58.573090 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:58.572808 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:58.573163 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:58.573113 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:27:58.665953 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:58.665878 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6lgzk_a496d1d4-a398-481d-82ca-9a1f72745d53/node-ca/0.log" Jul 02 15:27:59.257892 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:59.257854 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:27:59.258330 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.258001 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:59.258330 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.258067 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret podName:14a03165-9d9b-47ee-91cf-d074540c4b19 nodeName:}" failed. No retries permitted until 2026-07-02 15:28:31.258046739 +0000 UTC m=+65.122902916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret") pod "global-pull-secret-syncer-8b2vb" (UID: "14a03165-9d9b-47ee-91cf-d074540c4b19") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:59.359183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:59.359147 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:27:59.359374 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:59.359195 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:27:59.359374 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.359297 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:59.359374 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.359357 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs podName:5e28d45a-fd9a-44be-8366-927ee969e3fd nodeName:}" failed. No retries permitted until 2026-07-02 15:28:31.359342727 +0000 UTC m=+65.224198906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs") pod "network-metrics-daemon-tm2v8" (UID: "5e28d45a-fd9a-44be-8366-927ee969e3fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:59.359520 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.359303 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:59.359520 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.359402 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:59.359520 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.359411 2549 projected.go:196] Error preparing data for projected volume kube-api-access-svvtq for pod openshift-network-diagnostics/network-check-target-xw8st: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:59.359520 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:27:59.359465 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq podName:fa4ab49a-79ab-40b1-895b-d60d887e411c nodeName:}" failed. No retries permitted until 2026-07-02 15:28:31.359454229 +0000 UTC m=+65.224310422 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-svvtq" (UniqueName: "kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq") pod "network-check-target-xw8st" (UID: "fa4ab49a-79ab-40b1-895b-d60d887e411c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:59.750133 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:59.750100 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8" containerID="50243c1fde2a305ea48cc789d303745d9c19a973722e0f533b585b02fd4156ff" exitCode=0 Jul 02 15:27:59.750133 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:27:59.750137 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerDied","Data":"50243c1fde2a305ea48cc789d303745d9c19a973722e0f533b585b02fd4156ff"} Jul 02 15:28:00.577121 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:00.577091 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:00.577121 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:00.577119 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:00.577632 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:00.577128 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:00.577632 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:00.577228 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:00.577632 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:00.577322 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:00.577632 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:00.577414 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:02.577130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:02.577091 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:02.577710 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:02.577221 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:02.577710 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:02.577233 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:02.577710 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:02.577269 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:02.577710 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:02.577365 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:02.577710 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:02.577435 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:04.572965 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:04.572927 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:04.573429 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:04.572984 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:04.573429 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:04.572928 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:04.573429 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:04.573054 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:04.573429 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:04.573124 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:04.573429 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:04.573199 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:04.765956 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:04.765921 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8" containerID="0e355819722021cd616a82329fd4e2d25d8dd1af11c172be1cfd5b3b37461547" exitCode=0 Jul 02 15:28:04.766096 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:04.765967 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerDied","Data":"0e355819722021cd616a82329fd4e2d25d8dd1af11c172be1cfd5b3b37461547"} Jul 02 15:28:05.771171 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:05.771134 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8" containerID="b4994d4e1b5b62583737a947e4f47d3f9c296e4b1a54c3f05666bbb1895f262c" exitCode=0 Jul 02 15:28:05.771855 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:05.771193 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerDied","Data":"b4994d4e1b5b62583737a947e4f47d3f9c296e4b1a54c3f05666bbb1895f262c"} Jul 02 15:28:06.573615 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:06.573584 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:06.573814 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:06.573678 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:06.573814 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:06.573691 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:06.573814 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:06.573780 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:06.574018 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:06.573808 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:06.574018 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:06.573871 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:06.776432 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:06.776399 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" event={"ID":"3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8","Type":"ContainerStarted","Data":"60fdf3aedd0b9a77094563f14fc9a6c4ed1802b69467d89a6feedaa5d1533058"} Jul 02 15:28:06.800596 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:06.800536 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7bwb8" podStartSLOduration=9.237560524 podStartE2EDuration="39.800518926s" totalImagesPullingTime="30.562958402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:06.800269716 +0000 UTC m=+40.665125914" watchObservedRunningTime="2026-07-02 15:28:06.800518926 +0000 UTC m=+40.665375124" Jul 02 15:28:08.573338 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:08.573302 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:08.573338 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:08.573323 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:08.573891 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:08.573443 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:08.573891 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:08.573516 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:08.573891 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:08.573532 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:08.573891 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:08.573625 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:10.573740 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:10.573705 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:10.573740 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:10.573737 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:10.574207 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:10.573705 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:10.574207 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:10.573815 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:10.574207 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:10.573873 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:10.574207 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:10.573951 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:12.572974 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:12.572938 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:12.572974 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:12.572973 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:12.573467 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:12.572938 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:12.573467 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:12.573049 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:12.573467 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:12.573114 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:12.573467 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:12.573192 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:14.573594 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:14.573562 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:14.573989 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:14.573563 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:14.573989 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:14.573692 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:14.573989 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:14.573687 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:14.573989 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:14.573768 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:14.573989 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:14.573845 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:16.579123 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.579092 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:16.579574 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.579196 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:16.579574 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:16.579239 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xw8st" podUID="fa4ab49a-79ab-40b1-895b-d60d887e411c" Jul 02 15:28:16.579574 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:16.579285 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tm2v8" podUID="5e28d45a-fd9a-44be-8366-927ee969e3fd" Jul 02 15:28:16.579574 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.579308 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:16.579574 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:16.579400 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8b2vb" podUID="14a03165-9d9b-47ee-91cf-d074540c4b19" Jul 02 15:28:16.809716 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.809616 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeReady" Jul 02 15:28:16.809866 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.809790 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 15:28:16.872040 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.872006 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-97559659f-bv7n7"] Jul 02 15:28:16.878806 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.878782 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.881929 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.881901 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 15:28:16.882113 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.882088 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 15:28:16.882910 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.882891 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 15:28:16.883588 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.883564 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9ppmh\"" Jul 02 15:28:16.889598 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.889578 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 15:28:16.916755 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.916727 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zvwwb"] Jul 02 15:28:16.926992 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.926963 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-97559659f-bv7n7"] Jul 02 15:28:16.927147 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.927097 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:16.931727 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.931704 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 15:28:16.931996 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.931979 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b95v2\"" Jul 02 15:28:16.932053 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.931979 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 15:28:16.934718 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.934695 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 15:28:16.948846 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.948821 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zvwwb"] Jul 02 15:28:16.981264 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981221 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-installation-pull-secrets\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.981264 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981265 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-registry-certificates\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.981500 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981284 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-registry-tls\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.981500 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981301 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgqwf\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-kube-api-access-jgqwf\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.981500 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981379 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-image-registry-private-configuration\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.981500 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981454 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-ca-trust-extracted\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.981500 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981473 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-bound-sa-token\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:16.981700 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:16.981503 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-trusted-ca\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.004031 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.003992 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xc9vv"] Jul 02 15:28:17.019988 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.019965 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4kngp"] Jul 02 15:28:17.020141 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.020073 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.028476 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.028449 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kngp"] Jul 02 15:28:17.028620 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.028581 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.030571 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.030544 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xc9vv"] Jul 02 15:28:17.034128 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.034110 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lk69t\"" Jul 02 15:28:17.036131 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.036098 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 15:28:17.036401 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.036382 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 15:28:17.036541 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.036438 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgxj4\"" Jul 02 15:28:17.036541 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.036465 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 15:28:17.036727 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.036711 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 15:28:17.037453 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.037439 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 15:28:17.039374 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.039349 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 15:28:17.082881 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.082786 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-image-registry-private-configuration\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.082881 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.082827 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff147a57-69b7-47b9-81fe-5acb01b98613-cert\") pod \"ingress-canary-zvwwb\" (UID: \"ff147a57-69b7-47b9-81fe-5acb01b98613\") " pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:17.082881 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.082847 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktxrl\" (UniqueName: \"kubernetes.io/projected/ff147a57-69b7-47b9-81fe-5acb01b98613-kube-api-access-ktxrl\") pod \"ingress-canary-zvwwb\" (UID: \"ff147a57-69b7-47b9-81fe-5acb01b98613\") " pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:17.083148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.082966 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-ca-trust-extracted\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.083148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.082998 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-bound-sa-token\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.083148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.083034 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-trusted-ca\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.083148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.083064 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-installation-pull-secrets\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.083148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.083092 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-registry-certificates\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.083148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.083114 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-registry-tls\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.083148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.083144 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgqwf\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-kube-api-access-jgqwf\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.083498 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.083475 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-ca-trust-extracted\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.084314 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.084125 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-registry-certificates\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.085393 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.085368 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-trusted-ca\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.087250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.087226 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-image-registry-private-configuration\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.087250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.087245 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-installation-pull-secrets\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.087379 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.087289 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-registry-tls\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.115128 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.115085 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgqwf\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-kube-api-access-jgqwf\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.134516 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.134490 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63bc4173-bcb7-4be1-8d9d-f173298e3c5a-bound-sa-token\") pod \"image-registry-97559659f-bv7n7\" (UID: \"63bc4173-bcb7-4be1-8d9d-f173298e3c5a\") " pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.183914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.183876 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-data-volume\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.183914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.183914 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.184138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.183935 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82d9b801-8075-4c2d-a0b4-b3837aea7458-tmp-dir\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.184138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.183994 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.184138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.184015 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-crio-socket\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.184138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.184036 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82d9b801-8075-4c2d-a0b4-b3837aea7458-metrics-tls\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.184138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.184060 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdn8s\" (UniqueName: \"kubernetes.io/projected/82d9b801-8075-4c2d-a0b4-b3837aea7458-kube-api-access-cdn8s\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.184138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.184103 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff147a57-69b7-47b9-81fe-5acb01b98613-cert\") pod \"ingress-canary-zvwwb\" (UID: \"ff147a57-69b7-47b9-81fe-5acb01b98613\") " pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:17.184138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.184127 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvh7l\" (UniqueName: \"kubernetes.io/projected/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-kube-api-access-tvh7l\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.184435 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.184148 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktxrl\" (UniqueName: \"kubernetes.io/projected/ff147a57-69b7-47b9-81fe-5acb01b98613-kube-api-access-ktxrl\") pod \"ingress-canary-zvwwb\" (UID: \"ff147a57-69b7-47b9-81fe-5acb01b98613\") " pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:17.184435 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.184162 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82d9b801-8075-4c2d-a0b4-b3837aea7458-config-volume\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.186523 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.186503 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff147a57-69b7-47b9-81fe-5acb01b98613-cert\") pod \"ingress-canary-zvwwb\" (UID: \"ff147a57-69b7-47b9-81fe-5acb01b98613\") " pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:17.190405 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.190379 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.209586 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.209558 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktxrl\" (UniqueName: \"kubernetes.io/projected/ff147a57-69b7-47b9-81fe-5acb01b98613-kube-api-access-ktxrl\") pod \"ingress-canary-zvwwb\" (UID: \"ff147a57-69b7-47b9-81fe-5acb01b98613\") " pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:17.235756 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.235724 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvwwb" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.285382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvh7l\" (UniqueName: \"kubernetes.io/projected/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-kube-api-access-tvh7l\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.285439 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82d9b801-8075-4c2d-a0b4-b3837aea7458-config-volume\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.285530 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-data-volume\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.285575 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.285985 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-data-volume\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286045 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82d9b801-8075-4c2d-a0b4-b3837aea7458-tmp-dir\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286236 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82d9b801-8075-4c2d-a0b4-b3837aea7458-config-volume\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286301 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.286384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286308 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82d9b801-8075-4c2d-a0b4-b3837aea7458-tmp-dir\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.287005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286400 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.287005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286436 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-crio-socket\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.287005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286461 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82d9b801-8075-4c2d-a0b4-b3837aea7458-metrics-tls\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.287005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286498 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdn8s\" (UniqueName: \"kubernetes.io/projected/82d9b801-8075-4c2d-a0b4-b3837aea7458-kube-api-access-cdn8s\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.287005 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.286760 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-crio-socket\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.291183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.291071 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82d9b801-8075-4c2d-a0b4-b3837aea7458-metrics-tls\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.291183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.291140 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.300990 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.300925 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvh7l\" (UniqueName: \"kubernetes.io/projected/ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f-kube-api-access-tvh7l\") pod \"insights-runtime-extractor-4kngp\" (UID: \"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f\") " pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.304088 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.304005 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdn8s\" (UniqueName: \"kubernetes.io/projected/82d9b801-8075-4c2d-a0b4-b3837aea7458-kube-api-access-cdn8s\") pod \"dns-default-xc9vv\" (UID: \"82d9b801-8075-4c2d-a0b4-b3837aea7458\") " pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.329125 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.329087 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:17.338359 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.338250 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kngp" Jul 02 15:28:17.423300 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.423039 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-97559659f-bv7n7"] Jul 02 15:28:17.423300 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.423141 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zvwwb"] Jul 02 15:28:17.518250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.518219 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xc9vv"] Jul 02 15:28:17.522308 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:17.522274 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d9b801_8075_4c2d_a0b4_b3837aea7458.slice/crio-d422dc7873731e4415de48c8402137b31da094c4c316ce032665df6a8ebda8c0 WatchSource:0}: Error finding container d422dc7873731e4415de48c8402137b31da094c4c316ce032665df6a8ebda8c0: Status 404 returned error can't find the container with id d422dc7873731e4415de48c8402137b31da094c4c316ce032665df6a8ebda8c0 Jul 02 15:28:17.538361 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.538332 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kngp"] Jul 02 15:28:17.542008 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:17.541982 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8f48a0_c03e_43dc_ae4e_b60e7dd4c24f.slice/crio-8d9421cea9b72d579c1fb79bca6515f69c78bd3a04012d33bb61abff1967203b WatchSource:0}: Error finding container 8d9421cea9b72d579c1fb79bca6515f69c78bd3a04012d33bb61abff1967203b: Status 404 returned error can't find the container with id 8d9421cea9b72d579c1fb79bca6515f69c78bd3a04012d33bb61abff1967203b Jul 02 15:28:17.801223 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.801190 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97559659f-bv7n7" event={"ID":"63bc4173-bcb7-4be1-8d9d-f173298e3c5a","Type":"ContainerStarted","Data":"f8834f7126be46e081be50c73349cb3a234779565a2dc558ecc60d3e43832772"} Jul 02 15:28:17.801636 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.801241 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97559659f-bv7n7" event={"ID":"63bc4173-bcb7-4be1-8d9d-f173298e3c5a","Type":"ContainerStarted","Data":"5da73e013d95b6bd3849614fd0761595f9fac12e869d3e81a23bc3517d84988c"} Jul 02 15:28:17.801636 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.801286 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:17.802577 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.802549 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zvwwb" event={"ID":"ff147a57-69b7-47b9-81fe-5acb01b98613","Type":"ContainerStarted","Data":"61c2c30e56e45696363a860410d3f1a98ff842ae9efd44a4ed64c33e6ce759c6"} Jul 02 15:28:17.803734 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.803706 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kngp" event={"ID":"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f","Type":"ContainerStarted","Data":"8d9421cea9b72d579c1fb79bca6515f69c78bd3a04012d33bb61abff1967203b"} Jul 02 15:28:17.804812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:17.804794 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xc9vv" event={"ID":"82d9b801-8075-4c2d-a0b4-b3837aea7458","Type":"ContainerStarted","Data":"d422dc7873731e4415de48c8402137b31da094c4c316ce032665df6a8ebda8c0"} Jul 02 15:28:18.578207 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.573693 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:18.578207 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.574216 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:18.578207 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.574812 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:18.579741 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.579503 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:28:18.579741 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.579554 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:28:18.579931 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.579821 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:28:18.585999 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.585978 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzs8w\"" Jul 02 15:28:18.586260 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.586241 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mj52l\"" Jul 02 15:28:18.586459 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:18.586444 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:28:23.822215 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.822119 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zvwwb" event={"ID":"ff147a57-69b7-47b9-81fe-5acb01b98613","Type":"ContainerStarted","Data":"cd8661af512f9e9f8ba3548770fa67518f725472c10905e636f0acd7ddf2183f"} Jul 02 15:28:23.823845 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.823811 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kngp" event={"ID":"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f","Type":"ContainerStarted","Data":"be46c848954142dcc24c5f272db5166142c3ad10dc319b510289be7ac0622814"} Jul 02 15:28:23.823943 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.823860 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kngp" event={"ID":"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f","Type":"ContainerStarted","Data":"04ab654f53eb94622b1760f99f7c443ae8f239d76f55f9f32b74f2888dae8af3"} Jul 02 15:28:23.825365 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.825343 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xc9vv" event={"ID":"82d9b801-8075-4c2d-a0b4-b3837aea7458","Type":"ContainerStarted","Data":"e7c905901a51577bed9094b0044bcf35e3fb594354550bd3cac6c20fca8bc117"} Jul 02 15:28:23.825510 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.825380 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xc9vv" event={"ID":"82d9b801-8075-4c2d-a0b4-b3837aea7458","Type":"ContainerStarted","Data":"b06fa0d459072fbe80e7f8dcb59b6f376253645352be38ce0246aa84bc61e41a"} Jul 02 15:28:23.825510 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.825489 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:23.847600 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.847557 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-97559659f-bv7n7" podStartSLOduration=7.847542015 podStartE2EDuration="7.847542015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:17.832559995 +0000 UTC m=+51.697416196" watchObservedRunningTime="2026-07-02 15:28:23.847542015 +0000 UTC m=+57.712398211" Jul 02 15:28:23.866943 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.866885 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xc9vv" podStartSLOduration=2.5997152569999997 podStartE2EDuration="7.866864405s" totalImagesPullingTime="5.267149148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:23.866551392 +0000 UTC m=+57.731407589" watchObservedRunningTime="2026-07-02 15:28:23.866864405 +0000 UTC m=+57.731720602" Jul 02 15:28:23.867217 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:23.867188 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zvwwb" podStartSLOduration=2.488464348 podStartE2EDuration="7.867179511s" totalImagesPullingTime="5.378715163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:23.847234498 +0000 UTC m=+57.712090695" watchObservedRunningTime="2026-07-02 15:28:23.867179511 +0000 UTC m=+57.732035714" Jul 02 15:28:26.756175 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:26.756146 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9wwd4" Jul 02 15:28:26.842728 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:26.842688 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kngp" event={"ID":"ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f","Type":"ContainerStarted","Data":"7241e91f7ff464a48acb17287811b65f3e3f51a3701eadb0ad62192d726eeeca"} Jul 02 15:28:26.869726 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:26.869673 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4kngp" podStartSLOduration=2.548147841 podStartE2EDuration="10.869657802s" totalImagesPullingTime="8.321509961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:28:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:26.868220501 +0000 UTC m=+60.733076698" watchObservedRunningTime="2026-07-02 15:28:26.869657802 +0000 UTC m=+60.734513990" Jul 02 15:28:30.872098 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:30.872059 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm"] Jul 02 15:28:30.874986 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:30.874970 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:30.877911 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:30.877890 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 15:28:30.878091 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:30.877919 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fz7hl\"" Jul 02 15:28:30.883310 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:30.883284 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm"] Jul 02 15:28:30.905098 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:30.905069 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-hpvxm\" (UID: \"cc21a31e-965f-420d-bdc9-e395ec961b8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:31.005719 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.005637 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-hpvxm\" (UID: \"cc21a31e-965f-420d-bdc9-e395ec961b8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:31.005882 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:31.005783 2549 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 15:28:31.005882 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:31.005862 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates podName:cc21a31e-965f-420d-bdc9-e395ec961b8a nodeName:}" failed. No retries permitted until 2026-07-02 15:28:31.505845344 +0000 UTC m=+65.370701524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" (UID: "cc21a31e-965f-420d-bdc9-e395ec961b8a") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 15:28:31.307271 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.307236 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:31.309612 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.309587 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:28:31.320416 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.320384 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14a03165-9d9b-47ee-91cf-d074540c4b19-original-pull-secret\") pod \"global-pull-secret-syncer-8b2vb\" (UID: \"14a03165-9d9b-47ee-91cf-d074540c4b19\") " pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:31.407755 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.407711 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:31.407946 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.407806 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:31.410195 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.410171 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:28:31.410251 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.410170 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:28:31.420794 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.420768 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:28:31.421023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.421006 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e28d45a-fd9a-44be-8366-927ee969e3fd-metrics-certs\") pod \"network-metrics-daemon-tm2v8\" (UID: \"5e28d45a-fd9a-44be-8366-927ee969e3fd\") " pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:31.431617 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.431594 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svvtq\" (UniqueName: \"kubernetes.io/projected/fa4ab49a-79ab-40b1-895b-d60d887e411c-kube-api-access-svvtq\") pod \"network-check-target-xw8st\" (UID: \"fa4ab49a-79ab-40b1-895b-d60d887e411c\") " pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:31.493045 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.493013 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mj52l\"" Jul 02 15:28:31.501716 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.501696 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tm2v8" Jul 02 15:28:31.503986 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.503752 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzs8w\"" Jul 02 15:28:31.508980 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.508956 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-hpvxm\" (UID: \"cc21a31e-965f-420d-bdc9-e395ec961b8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:31.509078 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:31.509065 2549 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 15:28:31.509139 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:31.509125 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates podName:cc21a31e-965f-420d-bdc9-e395ec961b8a nodeName:}" failed. No retries permitted until 2026-07-02 15:28:32.509111871 +0000 UTC m=+66.373968046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" (UID: "cc21a31e-965f-420d-bdc9-e395ec961b8a") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 15:28:31.510956 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.510935 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8b2vb" Jul 02 15:28:31.512048 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.512018 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:31.647898 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.647501 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tm2v8"] Jul 02 15:28:31.650357 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:31.650321 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e28d45a_fd9a_44be_8366_927ee969e3fd.slice/crio-44f316ade585ffff4544cdc1f4f07e408fe6775ddbdd8464ae76492421c6583b WatchSource:0}: Error finding container 44f316ade585ffff4544cdc1f4f07e408fe6775ddbdd8464ae76492421c6583b: Status 404 returned error can't find the container with id 44f316ade585ffff4544cdc1f4f07e408fe6775ddbdd8464ae76492421c6583b Jul 02 15:28:31.860426 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.860352 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tm2v8" event={"ID":"5e28d45a-fd9a-44be-8366-927ee969e3fd","Type":"ContainerStarted","Data":"44f316ade585ffff4544cdc1f4f07e408fe6775ddbdd8464ae76492421c6583b"} Jul 02 15:28:31.867512 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.867482 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8b2vb"] Jul 02 15:28:31.870870 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:31.870840 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a03165_9d9b_47ee_91cf_d074540c4b19.slice/crio-e1410b62eaf44efadbfd76bb79b067bf4a7f9eba2706faf14ea2e199a82b369d WatchSource:0}: Error finding container e1410b62eaf44efadbfd76bb79b067bf4a7f9eba2706faf14ea2e199a82b369d: Status 404 returned error can't find the container with id e1410b62eaf44efadbfd76bb79b067bf4a7f9eba2706faf14ea2e199a82b369d Jul 02 15:28:31.870998 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:31.870911 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xw8st"] Jul 02 15:28:31.874296 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:31.874274 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4ab49a_79ab_40b1_895b_d60d887e411c.slice/crio-6be603ebe64893df55b3ba84b71b46a0ef51746c159229547005a97a322ddb6d WatchSource:0}: Error finding container 6be603ebe64893df55b3ba84b71b46a0ef51746c159229547005a97a322ddb6d: Status 404 returned error can't find the container with id 6be603ebe64893df55b3ba84b71b46a0ef51746c159229547005a97a322ddb6d Jul 02 15:28:32.517880 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.517828 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-hpvxm\" (UID: \"cc21a31e-965f-420d-bdc9-e395ec961b8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:32.520920 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.520863 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cc21a31e-965f-420d-bdc9-e395ec961b8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-hpvxm\" (UID: \"cc21a31e-965f-420d-bdc9-e395ec961b8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:32.683892 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.683684 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:32.857029 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.856911 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm"] Jul 02 15:28:32.859806 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:32.859772 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc21a31e_965f_420d_bdc9_e395ec961b8a.slice/crio-951b854a62cad7da67cc3d38250674c5b636b72495274e9953498383394b5ea7 WatchSource:0}: Error finding container 951b854a62cad7da67cc3d38250674c5b636b72495274e9953498383394b5ea7: Status 404 returned error can't find the container with id 951b854a62cad7da67cc3d38250674c5b636b72495274e9953498383394b5ea7 Jul 02 15:28:32.867520 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.867482 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tm2v8" event={"ID":"5e28d45a-fd9a-44be-8366-927ee969e3fd","Type":"ContainerStarted","Data":"ccd825065f5c23ffb76445a460db5a3fef4bd5034a883557316e2a22d1cc1ae1"} Jul 02 15:28:32.867634 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.867555 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tm2v8" event={"ID":"5e28d45a-fd9a-44be-8366-927ee969e3fd","Type":"ContainerStarted","Data":"8a36d3995aadac17753a0eba948e4b8a5f4ad35b45f9371a2c8cd3ef12ee3fd8"} Jul 02 15:28:32.868991 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.868963 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" event={"ID":"cc21a31e-965f-420d-bdc9-e395ec961b8a","Type":"ContainerStarted","Data":"951b854a62cad7da67cc3d38250674c5b636b72495274e9953498383394b5ea7"} Jul 02 15:28:32.870704 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.870676 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8b2vb" event={"ID":"14a03165-9d9b-47ee-91cf-d074540c4b19","Type":"ContainerStarted","Data":"e1410b62eaf44efadbfd76bb79b067bf4a7f9eba2706faf14ea2e199a82b369d"} Jul 02 15:28:32.872108 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.872083 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xw8st" event={"ID":"fa4ab49a-79ab-40b1-895b-d60d887e411c","Type":"ContainerStarted","Data":"6be603ebe64893df55b3ba84b71b46a0ef51746c159229547005a97a322ddb6d"} Jul 02 15:28:32.882777 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:32.882147 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tm2v8" podStartSLOduration=64.959226646 podStartE2EDuration="1m5.882129165s" totalImagesPullingTime="922.902519ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:32.881184423 +0000 UTC m=+66.746040622" watchObservedRunningTime="2026-07-02 15:28:32.882129165 +0000 UTC m=+66.746985364" Jul 02 15:28:33.832203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:33.832168 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xc9vv" Jul 02 15:28:37.195066 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.194975 2549 patch_prober.go:28] interesting pod/image-registry-97559659f-bv7n7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 15:28:37.195066 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.195036 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-97559659f-bv7n7" podUID="63bc4173-bcb7-4be1-8d9d-f173298e3c5a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:28:37.892661 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.892609 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" event={"ID":"cc21a31e-965f-420d-bdc9-e395ec961b8a","Type":"ContainerStarted","Data":"36cad8795cfa909d382edd9db08989d00ea02c2099d210e2224aef4cf37cb5a3"} Jul 02 15:28:37.892958 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.892791 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:37.894324 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.894281 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8b2vb" event={"ID":"14a03165-9d9b-47ee-91cf-d074540c4b19","Type":"ContainerStarted","Data":"38f888f174babb82bd17b34187a491623afd813ef30ea31282eac65b02b71bd1"} Jul 02 15:28:37.896014 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.895986 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xw8st" event={"ID":"fa4ab49a-79ab-40b1-895b-d60d887e411c","Type":"ContainerStarted","Data":"cda477a30eddd1904514303fe479745c772632acd53a554dc3c5cf5bcc5d79e1"} Jul 02 15:28:37.896125 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.896033 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:28:37.898092 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.898074 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" Jul 02 15:28:37.907952 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.907907 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-hpvxm" podStartSLOduration=3.901440318 podStartE2EDuration="7.907892033s" totalImagesPullingTime="4.006451715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:37.90681926 +0000 UTC m=+71.771675458" watchObservedRunningTime="2026-07-02 15:28:37.907892033 +0000 UTC m=+71.772748229" Jul 02 15:28:37.923535 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.923487 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xw8st" podStartSLOduration=65.914129682 podStartE2EDuration="1m10.923472077s" totalImagesPullingTime="5.009342395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:37.922441252 +0000 UTC m=+71.787297448" watchObservedRunningTime="2026-07-02 15:28:37.923472077 +0000 UTC m=+71.788328275" Jul 02 15:28:37.938215 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:37.938174 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8b2vb" podStartSLOduration=65.920852698 podStartE2EDuration="1m10.938158973s" totalImagesPullingTime="5.017306275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:37.937568577 +0000 UTC m=+71.802424775" watchObservedRunningTime="2026-07-02 15:28:37.938158973 +0000 UTC m=+71.803015170" Jul 02 15:28:38.813885 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:38.813850 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-97559659f-bv7n7" Jul 02 15:28:43.341213 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.341184 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-nvqnj"] Jul 02 15:28:43.343336 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.343318 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.346544 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.346482 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 15:28:43.346544 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.346495 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 15:28:43.346889 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.346523 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 15:28:43.346889 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.346622 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 15:28:43.346889 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.346523 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 15:28:43.346889 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.346616 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 15:28:43.346889 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.346791 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xs8cs\"" Jul 02 15:28:43.359280 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.359259 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-nvqnj"] Jul 02 15:28:43.389698 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.389660 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sdb6m"] Jul 02 15:28:43.391893 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.391875 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.394093 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394056 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcl7q\" (UniqueName: \"kubernetes.io/projected/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-api-access-jcl7q\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.394093 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394096 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.394267 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394146 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.394267 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394187 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.394267 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394205 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.394267 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394239 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-metrics-client-ca\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.394425 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394311 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 15:28:43.394726 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394708 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b7qt4\"" Jul 02 15:28:43.394830 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394729 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 15:28:43.394830 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.394798 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 15:28:43.495349 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495312 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.495534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495354 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-metrics-client-ca\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.495534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495386 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.495534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495417 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7m7h\" (UniqueName: \"kubernetes.io/projected/e3053afe-e695-41ab-b130-372f7d13de2e-kube-api-access-t7m7h\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495435 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-tls\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495470 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495502 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-wtmp\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495580 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcl7q\" (UniqueName: \"kubernetes.io/projected/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-api-access-jcl7q\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495633 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495690 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-textfile\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495715 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495740 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495764 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-sys\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495801 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-root\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.495861 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495855 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.496192 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.495921 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3053afe-e695-41ab-b130-372f7d13de2e-metrics-client-ca\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.496192 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.496150 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-metrics-client-ca\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.496356 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.496339 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.497885 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.497861 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.497984 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.497954 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.502912 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.502889 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcl7q\" (UniqueName: \"kubernetes.io/projected/780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3-kube-api-access-jcl7q\") pod \"kube-state-metrics-845b954455-nvqnj\" (UID: \"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.597173 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597089 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7m7h\" (UniqueName: \"kubernetes.io/projected/e3053afe-e695-41ab-b130-372f7d13de2e-kube-api-access-t7m7h\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597173 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597128 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-tls\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597173 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597151 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597173 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597175 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-wtmp\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597201 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597230 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-textfile\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597256 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-sys\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597277 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-root\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597298 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3053afe-e695-41ab-b130-372f7d13de2e-metrics-client-ca\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597337 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-wtmp\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597394 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-sys\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.597688 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597400 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3053afe-e695-41ab-b130-372f7d13de2e-root\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.598000 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597746 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-textfile\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.598000 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.597902 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.598072 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.598006 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3053afe-e695-41ab-b130-372f7d13de2e-metrics-client-ca\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.599525 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.599504 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-tls\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.599610 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.599560 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3053afe-e695-41ab-b130-372f7d13de2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.605713 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.605692 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7m7h\" (UniqueName: \"kubernetes.io/projected/e3053afe-e695-41ab-b130-372f7d13de2e-kube-api-access-t7m7h\") pod \"node-exporter-sdb6m\" (UID: \"e3053afe-e695-41ab-b130-372f7d13de2e\") " pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.652739 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.652700 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" Jul 02 15:28:43.701780 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.701747 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sdb6m" Jul 02 15:28:43.713139 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:43.713093 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3053afe_e695_41ab_b130_372f7d13de2e.slice/crio-a8f174151a8f229e596796308bece94c75e7d1907361fc319f41b6bb42eae2c5 WatchSource:0}: Error finding container a8f174151a8f229e596796308bece94c75e7d1907361fc319f41b6bb42eae2c5: Status 404 returned error can't find the container with id a8f174151a8f229e596796308bece94c75e7d1907361fc319f41b6bb42eae2c5 Jul 02 15:28:43.780513 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.780478 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-nvqnj"] Jul 02 15:28:43.783783 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:43.783756 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780f8b87_18bc_4ad9_b4ba_2ee1c8682ac3.slice/crio-56225a9919dd2e1854ec8af87f5687761f133d6a4049e68c1d82f7e1595acf0d WatchSource:0}: Error finding container 56225a9919dd2e1854ec8af87f5687761f133d6a4049e68c1d82f7e1595acf0d: Status 404 returned error can't find the container with id 56225a9919dd2e1854ec8af87f5687761f133d6a4049e68c1d82f7e1595acf0d Jul 02 15:28:43.915810 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.915715 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" event={"ID":"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3","Type":"ContainerStarted","Data":"56225a9919dd2e1854ec8af87f5687761f133d6a4049e68c1d82f7e1595acf0d"} Jul 02 15:28:43.917025 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:43.917003 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdb6m" event={"ID":"e3053afe-e695-41ab-b130-372f7d13de2e","Type":"ContainerStarted","Data":"a8f174151a8f229e596796308bece94c75e7d1907361fc319f41b6bb42eae2c5"} Jul 02 15:28:44.431669 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.430947 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:28:44.434183 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.434149 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.436914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.436672 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 15:28:44.436914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.436693 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 15:28:44.436914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.436796 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 15:28:44.436914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.436845 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 15:28:44.436914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.436887 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 15:28:44.437249 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.437204 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 15:28:44.437305 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.437261 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nsc2m\"" Jul 02 15:28:44.437916 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.437525 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 15:28:44.437916 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.437599 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 15:28:44.437916 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.437624 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 15:28:44.450570 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.450542 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:28:44.505093 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505055 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505273 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505123 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505273 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505178 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8ee045-8826-4401-b786-97f5704bcfd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505273 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505276 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505306 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505334 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505351 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505374 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505609 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505440 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8ee045-8826-4401-b786-97f5704bcfd8-config-out\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505609 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505480 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505609 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505515 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxbzv\" (UniqueName: \"kubernetes.io/projected/cb8ee045-8826-4401-b786-97f5704bcfd8-kube-api-access-lxbzv\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.505609 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.505541 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-web-config\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.606676 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.606618 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8ee045-8826-4401-b786-97f5704bcfd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.606847 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.606703 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.606847 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.606767 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.606847 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.606795 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.606847 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.606827 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607187 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607162 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607291 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:44.607264 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-trusted-ca-bundle podName:cb8ee045-8826-4401-b786-97f5704bcfd8 nodeName:}" failed. No retries permitted until 2026-07-02 15:28:45.107236009 +0000 UTC m=+78.972092208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "cb8ee045-8826-4401-b786-97f5704bcfd8") : configmap references non-existent config key: ca-bundle.crt Jul 02 15:28:44.607356 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607295 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607356 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607332 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607449 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607364 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8ee045-8826-4401-b786-97f5704bcfd8-config-out\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607449 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607392 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607449 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607424 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxbzv\" (UniqueName: \"kubernetes.io/projected/cb8ee045-8826-4401-b786-97f5704bcfd8-kube-api-access-lxbzv\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607617 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607450 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-web-config\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607617 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607487 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.607617 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.607524 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.608133 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.608106 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.610396 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.610371 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.610783 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.610708 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-web-config\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.611271 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.611220 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.611417 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.611375 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb8ee045-8826-4401-b786-97f5704bcfd8-config-out\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.611585 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.611544 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb8ee045-8826-4401-b786-97f5704bcfd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.612666 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.612598 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.613277 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.613189 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.613277 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.613218 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.613431 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.613294 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb8ee045-8826-4401-b786-97f5704bcfd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.618236 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.618214 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxbzv\" (UniqueName: \"kubernetes.io/projected/cb8ee045-8826-4401-b786-97f5704bcfd8-kube-api-access-lxbzv\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:44.923626 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:44.923553 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdb6m" event={"ID":"e3053afe-e695-41ab-b130-372f7d13de2e","Type":"ContainerStarted","Data":"121f8b05999a6a8571fef44d2609451c354412b412552f73b8d2c88e9e8bdf57"} Jul 02 15:28:45.111694 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.111665 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:45.112343 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.112322 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb8ee045-8826-4401-b786-97f5704bcfd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb8ee045-8826-4401-b786-97f5704bcfd8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:45.350282 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.350196 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:28:45.493501 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.493467 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:28:45.496941 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:45.496911 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8ee045_8826_4401_b786_97f5704bcfd8.slice/crio-19b1d8341ed2c35664ad0f25afce3b791da7b6b69acd25413aaa1d0a23d0ab6d WatchSource:0}: Error finding container 19b1d8341ed2c35664ad0f25afce3b791da7b6b69acd25413aaa1d0a23d0ab6d: Status 404 returned error can't find the container with id 19b1d8341ed2c35664ad0f25afce3b791da7b6b69acd25413aaa1d0a23d0ab6d Jul 02 15:28:45.930732 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.930682 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" event={"ID":"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3","Type":"ContainerStarted","Data":"5fb7ce75866d31c11ccc03b6e9162ead67e236bf4ad59ff2ba068c633fac6fbd"} Jul 02 15:28:45.930924 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.930754 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" event={"ID":"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3","Type":"ContainerStarted","Data":"f646cf5a6d3455633f9d5399cfb2fe02d0d08299946fe85343201e0f3175f1c4"} Jul 02 15:28:45.930924 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.930786 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" event={"ID":"780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3","Type":"ContainerStarted","Data":"05e278139137faa5a6b0546f1373f1dde9ac8ebe482c6fd8c0270200bbb51cf6"} Jul 02 15:28:45.932128 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.932097 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerStarted","Data":"19b1d8341ed2c35664ad0f25afce3b791da7b6b69acd25413aaa1d0a23d0ab6d"} Jul 02 15:28:45.933950 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.933919 2549 generic.go:356] "Generic (PLEG): container finished" podID="e3053afe-e695-41ab-b130-372f7d13de2e" containerID="121f8b05999a6a8571fef44d2609451c354412b412552f73b8d2c88e9e8bdf57" exitCode=0 Jul 02 15:28:45.934065 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.933987 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdb6m" event={"ID":"e3053afe-e695-41ab-b130-372f7d13de2e","Type":"ContainerDied","Data":"121f8b05999a6a8571fef44d2609451c354412b412552f73b8d2c88e9e8bdf57"} Jul 02 15:28:45.954726 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:45.954665 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-nvqnj" podStartSLOduration=1.694279147 podStartE2EDuration="2.954604856s" totalImagesPullingTime="1.260325709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:45.95284454 +0000 UTC m=+79.817700736" watchObservedRunningTime="2026-07-02 15:28:45.954604856 +0000 UTC m=+79.819461054" Jul 02 15:28:46.939308 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:46.939269 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdb6m" event={"ID":"e3053afe-e695-41ab-b130-372f7d13de2e","Type":"ContainerStarted","Data":"70dee7ac3ead7fe2bb96eebee8b19a45bf2e019025c3c8844b6f7401f7a64155"} Jul 02 15:28:46.939762 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:46.939345 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdb6m" event={"ID":"e3053afe-e695-41ab-b130-372f7d13de2e","Type":"ContainerStarted","Data":"a4c280edc3305a7a2f6fb255bbc3f4494685b169a320d114486f311c88d13c0a"} Jul 02 15:28:46.940789 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:46.940765 2549 generic.go:356] "Generic (PLEG): container finished" podID="cb8ee045-8826-4401-b786-97f5704bcfd8" containerID="df7206e99e3f3de99d1bce54c6ccd54c39e9c6ec0cfc73b5f0a023874a9ae523" exitCode=0 Jul 02 15:28:46.940873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:46.940850 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerDied","Data":"df7206e99e3f3de99d1bce54c6ccd54c39e9c6ec0cfc73b5f0a023874a9ae523"} Jul 02 15:28:46.967800 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:46.967747 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sdb6m" podStartSLOduration=2.915672221 podStartE2EDuration="3.967731874s" totalImagesPullingTime="979.317401ms" totalInitContainerRuntime="72.742252ms" isStatefulPod=true podCreationTimestamp="2026-07-02 15:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:46.966535219 +0000 UTC m=+80.831391416" watchObservedRunningTime="2026-07-02 15:28:46.967731874 +0000 UTC m=+80.832588484" Jul 02 15:28:47.901439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.901324 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6"] Jul 02 15:28:47.904781 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.904756 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.913791 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.913473 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 15:28:47.913791 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.913514 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-40bepvgd7t0c4\"" Jul 02 15:28:47.913791 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.913521 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 15:28:47.913791 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.913576 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wmjzj\"" Jul 02 15:28:47.913791 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.913597 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 15:28:47.913791 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.913671 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 15:28:47.936487 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.936453 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdcq\" (UniqueName: \"kubernetes.io/projected/68ca24e0-48a7-4012-af21-e4a6126d1382-kube-api-access-5rdcq\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.936696 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.936514 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68ca24e0-48a7-4012-af21-e4a6126d1382-audit-log\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.936696 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.936562 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ca24e0-48a7-4012-af21-e4a6126d1382-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.936696 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.936602 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68ca24e0-48a7-4012-af21-e4a6126d1382-metrics-server-audit-profiles\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.936696 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.936676 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-secret-metrics-server-tls\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.936923 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.936709 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-client-ca-bundle\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.936923 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.936785 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-secret-metrics-server-client-certs\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:47.943099 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:47.943070 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6"] Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.037484 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-secret-metrics-server-client-certs\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.038007 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdcq\" (UniqueName: \"kubernetes.io/projected/68ca24e0-48a7-4012-af21-e4a6126d1382-kube-api-access-5rdcq\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.038115 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68ca24e0-48a7-4012-af21-e4a6126d1382-audit-log\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.038169 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ca24e0-48a7-4012-af21-e4a6126d1382-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.038204 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68ca24e0-48a7-4012-af21-e4a6126d1382-metrics-server-audit-profiles\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.038311 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-secret-metrics-server-tls\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.038349 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-client-ca-bundle\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.040102 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68ca24e0-48a7-4012-af21-e4a6126d1382-metrics-server-audit-profiles\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.040394 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68ca24e0-48a7-4012-af21-e4a6126d1382-audit-log\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.040815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.040708 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ca24e0-48a7-4012-af21-e4a6126d1382-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.041456 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.041393 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-secret-metrics-server-client-certs\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.043968 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.043937 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-secret-metrics-server-tls\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.044359 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.044172 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68ca24e0-48a7-4012-af21-e4a6126d1382-client-ca-bundle\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.062048 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.062023 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdcq\" (UniqueName: \"kubernetes.io/projected/68ca24e0-48a7-4012-af21-e4a6126d1382-kube-api-access-5rdcq\") pod \"metrics-server-5dd4f8f6bf-sq8s6\" (UID: \"68ca24e0-48a7-4012-af21-e4a6126d1382\") " pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.216222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.216189 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:28:48.219964 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.219936 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s"] Jul 02 15:28:48.223046 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.223017 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.225796 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.225775 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6rk4x\"" Jul 02 15:28:48.226118 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.226101 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 15:28:48.248998 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.248959 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s"] Jul 02 15:28:48.342210 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.342177 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjlzn\" (UniqueName: \"kubernetes.io/projected/7ef41008-57d4-419a-b26a-cce074fb02d6-kube-api-access-hjlzn\") pod \"monitoring-plugin-cd8656b8-b7b7s\" (UID: \"7ef41008-57d4-419a-b26a-cce074fb02d6\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.342356 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.342269 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ef41008-57d4-419a-b26a-cce074fb02d6-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-b7b7s\" (UID: \"7ef41008-57d4-419a-b26a-cce074fb02d6\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.383110 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.383078 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6"] Jul 02 15:28:48.385825 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:48.385801 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ca24e0_48a7_4012_af21_e4a6126d1382.slice/crio-79c732bcc3aa9f7ca463918ec8b9f2f68774cf59f0fc986d9363b2684af8a542 WatchSource:0}: Error finding container 79c732bcc3aa9f7ca463918ec8b9f2f68774cf59f0fc986d9363b2684af8a542: Status 404 returned error can't find the container with id 79c732bcc3aa9f7ca463918ec8b9f2f68774cf59f0fc986d9363b2684af8a542 Jul 02 15:28:48.442813 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.442769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjlzn\" (UniqueName: \"kubernetes.io/projected/7ef41008-57d4-419a-b26a-cce074fb02d6-kube-api-access-hjlzn\") pod \"monitoring-plugin-cd8656b8-b7b7s\" (UID: \"7ef41008-57d4-419a-b26a-cce074fb02d6\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.442949 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.442895 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ef41008-57d4-419a-b26a-cce074fb02d6-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-b7b7s\" (UID: \"7ef41008-57d4-419a-b26a-cce074fb02d6\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.443083 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:48.443067 2549 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 15:28:48.443156 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:28:48.443144 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef41008-57d4-419a-b26a-cce074fb02d6-monitoring-plugin-cert podName:7ef41008-57d4-419a-b26a-cce074fb02d6 nodeName:}" failed. No retries permitted until 2026-07-02 15:28:48.943121196 +0000 UTC m=+82.807977373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7ef41008-57d4-419a-b26a-cce074fb02d6-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-b7b7s" (UID: "7ef41008-57d4-419a-b26a-cce074fb02d6") : secret "monitoring-plugin-cert" not found Jul 02 15:28:48.452051 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.452028 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjlzn\" (UniqueName: \"kubernetes.io/projected/7ef41008-57d4-419a-b26a-cce074fb02d6-kube-api-access-hjlzn\") pod \"monitoring-plugin-cd8656b8-b7b7s\" (UID: \"7ef41008-57d4-419a-b26a-cce074fb02d6\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.946801 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.946769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ef41008-57d4-419a-b26a-cce074fb02d6-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-b7b7s\" (UID: \"7ef41008-57d4-419a-b26a-cce074fb02d6\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.949129 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.949101 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ef41008-57d4-419a-b26a-cce074fb02d6-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-b7b7s\" (UID: \"7ef41008-57d4-419a-b26a-cce074fb02d6\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:48.952046 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.952015 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerStarted","Data":"30cfdf78adaed6d8b1e2935db59fe64a8365eea5b0f5eb0a9b6103066f7bfb19"} Jul 02 15:28:48.952154 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.952083 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerStarted","Data":"ded3fc99302151e85c1ba54328f05be90fcff7d39207f39b789d5d86a71d0b22"} Jul 02 15:28:48.952154 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.952111 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerStarted","Data":"82a925f0428d73d17c70768f768ac7566f50119542b9bf59a2d24ca08f895915"} Jul 02 15:28:48.952154 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.952139 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerStarted","Data":"a2b8d8b0c4ac88d8cf4d7631b3f5afc406b162f55bce48f12b651355b046a7f9"} Jul 02 15:28:48.952372 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.952168 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerStarted","Data":"b4068c815b199b6616ead248d52d5c5949d62c5407120583e391eb076aba8513"} Jul 02 15:28:48.953689 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:48.953639 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" event={"ID":"68ca24e0-48a7-4012-af21-e4a6126d1382","Type":"ContainerStarted","Data":"79c732bcc3aa9f7ca463918ec8b9f2f68774cf59f0fc986d9363b2684af8a542"} Jul 02 15:28:49.153806 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:49.153771 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:49.804797 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:49.804756 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s"] Jul 02 15:28:49.807581 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:28:49.807555 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef41008_57d4_419a_b26a_cce074fb02d6.slice/crio-87e03d808dfa5426575d41a03e608e568160397c2c94239cf342b7a75e4674df WatchSource:0}: Error finding container 87e03d808dfa5426575d41a03e608e568160397c2c94239cf342b7a75e4674df: Status 404 returned error can't find the container with id 87e03d808dfa5426575d41a03e608e568160397c2c94239cf342b7a75e4674df Jul 02 15:28:49.961864 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:49.961766 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb8ee045-8826-4401-b786-97f5704bcfd8","Type":"ContainerStarted","Data":"a8e59a070505b1ed8bf1a48751e6f91270ef0621652ce3097f884da8c1e29c5b"} Jul 02 15:28:49.963409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:49.963379 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" event={"ID":"68ca24e0-48a7-4012-af21-e4a6126d1382","Type":"ContainerStarted","Data":"1e151b76a49bd9aa1410762fcfee952992821ab38a2632e2bb2b0bfb490af05b"} Jul 02 15:28:49.964639 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:49.964619 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" event={"ID":"7ef41008-57d4-419a-b26a-cce074fb02d6","Type":"ContainerStarted","Data":"87e03d808dfa5426575d41a03e608e568160397c2c94239cf342b7a75e4674df"} Jul 02 15:28:49.993600 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:49.993549 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.773486884 podStartE2EDuration="5.993532114s" totalImagesPullingTime="3.204216786s" totalInitContainerRuntime="15.828444ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:49.99127522 +0000 UTC m=+83.856131421" watchObservedRunningTime="2026-07-02 15:28:49.993532114 +0000 UTC m=+83.858388310" Jul 02 15:28:50.017203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:50.017146 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" podStartSLOduration=1.732056386 podStartE2EDuration="3.017130336s" totalImagesPullingTime="1.28507395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:50.014876832 +0000 UTC m=+83.879733028" watchObservedRunningTime="2026-07-02 15:28:50.017130336 +0000 UTC m=+83.881986534" Jul 02 15:28:51.974291 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:51.974254 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" event={"ID":"7ef41008-57d4-419a-b26a-cce074fb02d6","Type":"ContainerStarted","Data":"d0d77647b571e31b2e9b792647544d4274a43d7a0c70037f40775617cf479c1c"} Jul 02 15:28:51.974729 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:51.974437 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:51.979233 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:51.979207 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" Jul 02 15:28:51.996049 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:28:51.995998 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-b7b7s" podStartSLOduration=2.6727857090000002 podStartE2EDuration="3.995983588s" totalImagesPullingTime="1.323197879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:51.994332427 +0000 UTC m=+85.859188627" watchObservedRunningTime="2026-07-02 15:28:51.995983588 +0000 UTC m=+85.860839839" Jul 02 15:29:08.216315 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:29:08.216276 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:29:08.216766 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:29:08.216341 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:29:08.902555 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:29:08.902527 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xw8st" Jul 02 15:29:28.222320 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:29:28.222289 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:29:28.226233 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:29:28.226206 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dd4f8f6bf-sq8s6" Jul 02 15:30:07.777096 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.777056 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8586c58954-6957l"] Jul 02 15:30:07.780941 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.780920 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.783286 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.783263 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 15:30:07.783410 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.783265 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h2fzb\"" Jul 02 15:30:07.783410 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.783320 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 15:30:07.783570 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.783551 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 15:30:07.783570 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.783564 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 15:30:07.785016 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.784998 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 15:30:07.789114 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.789089 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 15:30:07.789665 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.789405 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8586c58954-6957l"] Jul 02 15:30:07.864036 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864000 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.864222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864049 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ltn5\" (UniqueName: \"kubernetes.io/projected/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-kube-api-access-4ltn5\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.864222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864095 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-secret-telemeter-client\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.864222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864132 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-metrics-client-ca\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.864222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864153 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-federate-client-tls\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.864222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864174 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-telemeter-client-tls\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.864222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864200 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.864222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.864216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-serving-certs-ca-bundle\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965165 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965125 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965165 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965171 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ltn5\" (UniqueName: \"kubernetes.io/projected/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-kube-api-access-4ltn5\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965421 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965199 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-secret-telemeter-client\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965421 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965230 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-metrics-client-ca\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965421 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965259 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-federate-client-tls\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965421 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965299 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-telemeter-client-tls\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965421 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.965421 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.965407 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-serving-certs-ca-bundle\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.966124 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.966071 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-metrics-client-ca\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.966268 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.966124 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-serving-certs-ca-bundle\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.966268 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.966186 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.968330 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.968305 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.968433 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.968421 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-telemeter-client-tls\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.968479 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.968437 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-secret-telemeter-client\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.968573 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.968554 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-federate-client-tls\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:07.973872 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:07.973852 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ltn5\" (UniqueName: \"kubernetes.io/projected/ad5acf78-e84f-4a73-8b5d-c5132e0000f1-kube-api-access-4ltn5\") pod \"telemeter-client-8586c58954-6957l\" (UID: \"ad5acf78-e84f-4a73-8b5d-c5132e0000f1\") " pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:08.092873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:08.092781 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8586c58954-6957l" Jul 02 15:30:08.225993 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:08.225883 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8586c58954-6957l"] Jul 02 15:30:08.228604 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:30:08.228577 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5acf78_e84f_4a73_8b5d_c5132e0000f1.slice/crio-96e173fa2f0df208d77e083c303b0d6b28fa629a88ea74973d39adcd7fe14961 WatchSource:0}: Error finding container 96e173fa2f0df208d77e083c303b0d6b28fa629a88ea74973d39adcd7fe14961: Status 404 returned error can't find the container with id 96e173fa2f0df208d77e083c303b0d6b28fa629a88ea74973d39adcd7fe14961 Jul 02 15:30:08.263067 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:08.263037 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8586c58954-6957l" event={"ID":"ad5acf78-e84f-4a73-8b5d-c5132e0000f1","Type":"ContainerStarted","Data":"96e173fa2f0df208d77e083c303b0d6b28fa629a88ea74973d39adcd7fe14961"} Jul 02 15:30:11.275737 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:11.275699 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8586c58954-6957l" event={"ID":"ad5acf78-e84f-4a73-8b5d-c5132e0000f1","Type":"ContainerStarted","Data":"3a614f831473726944bfdbdf5d418a81511492b9df529de95483e74e6f8ef3df"} Jul 02 15:30:11.276152 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:11.275772 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8586c58954-6957l" event={"ID":"ad5acf78-e84f-4a73-8b5d-c5132e0000f1","Type":"ContainerStarted","Data":"cc737440da4a65de0ef2432fe790d68f0dab799bebb1f54ad96c146d07b056ae"} Jul 02 15:30:11.276152 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:11.275801 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8586c58954-6957l" event={"ID":"ad5acf78-e84f-4a73-8b5d-c5132e0000f1","Type":"ContainerStarted","Data":"165421b5eff1dbc5283d7c6d391a643f55e9b5458698b9addfd6a96d8ffc1293"} Jul 02 15:30:11.298006 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:30:11.297949 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8586c58954-6957l" podStartSLOduration=2.202322019 podStartE2EDuration="4.297928736s" totalImagesPullingTime="2.095606717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:30:11.29626889 +0000 UTC m=+165.161125087" watchObservedRunningTime="2026-07-02 15:30:11.297928736 +0000 UTC m=+165.162784936" Jul 02 15:31:27.876761 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:27.876723 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv"] Jul 02 15:31:27.880060 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:27.880043 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:27.883608 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:27.883589 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gtdfj\"" Jul 02 15:31:27.883937 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:27.883917 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 15:31:27.884052 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:27.883973 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 15:31:27.911256 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:27.911219 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv"] Jul 02 15:31:28.025573 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.025529 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.025573 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.025584 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.025813 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.025712 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qsns\" (UniqueName: \"kubernetes.io/projected/e64340a0-d02e-4033-b3d2-0238c4e11c91-kube-api-access-8qsns\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.126382 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.126346 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qsns\" (UniqueName: \"kubernetes.io/projected/e64340a0-d02e-4033-b3d2-0238c4e11c91-kube-api-access-8qsns\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.126517 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.126399 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.126517 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.126428 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.126815 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.126775 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.126858 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.126811 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.134630 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.134598 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qsns\" (UniqueName: \"kubernetes.io/projected/e64340a0-d02e-4033-b3d2-0238c4e11c91-kube-api-access-8qsns\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.188474 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.188438 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:28.317085 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.317060 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv"] Jul 02 15:31:28.319529 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:31:28.319497 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64340a0_d02e_4033_b3d2_0238c4e11c91.slice/crio-549bce59882e054c591a52c5a50ff568997a3683f3afbe6d6f2f4bd4f365b088 WatchSource:0}: Error finding container 549bce59882e054c591a52c5a50ff568997a3683f3afbe6d6f2f4bd4f365b088: Status 404 returned error can't find the container with id 549bce59882e054c591a52c5a50ff568997a3683f3afbe6d6f2f4bd4f365b088 Jul 02 15:31:28.558758 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:28.558723 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" event={"ID":"e64340a0-d02e-4033-b3d2-0238c4e11c91","Type":"ContainerStarted","Data":"549bce59882e054c591a52c5a50ff568997a3683f3afbe6d6f2f4bd4f365b088"} Jul 02 15:31:37.595434 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:37.595329 2549 generic.go:356] "Generic (PLEG): container finished" podID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerID="9a0d9b726584a93c241ee0d853d3724dee76c5516aab22db60771fafdaac50a1" exitCode=0 Jul 02 15:31:37.595954 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:37.595450 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" event={"ID":"e64340a0-d02e-4033-b3d2-0238c4e11c91","Type":"ContainerDied","Data":"9a0d9b726584a93c241ee0d853d3724dee76c5516aab22db60771fafdaac50a1"} Jul 02 15:31:39.606608 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:39.606566 2549 generic.go:356] "Generic (PLEG): container finished" podID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerID="97f88d5019660301cd7aa6e4336666de427eb5aa5a2a5edcb50748ff522acd71" exitCode=0 Jul 02 15:31:39.607018 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:39.606630 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" event={"ID":"e64340a0-d02e-4033-b3d2-0238c4e11c91","Type":"ContainerDied","Data":"97f88d5019660301cd7aa6e4336666de427eb5aa5a2a5edcb50748ff522acd71"} Jul 02 15:31:51.655389 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:51.655353 2549 generic.go:356] "Generic (PLEG): container finished" podID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerID="1c075a34887adcf5b3f94fed8f0e1f23306a41ef5c6471f42c016bac2ffa0750" exitCode=0 Jul 02 15:31:51.655787 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:51.655442 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" event={"ID":"e64340a0-d02e-4033-b3d2-0238c4e11c91","Type":"ContainerDied","Data":"1c075a34887adcf5b3f94fed8f0e1f23306a41ef5c6471f42c016bac2ffa0750"} Jul 02 15:31:52.818627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:52.818593 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:52.939246 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:52.939151 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-util\") pod \"e64340a0-d02e-4033-b3d2-0238c4e11c91\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " Jul 02 15:31:52.939246 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:52.939224 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-bundle\") pod \"e64340a0-d02e-4033-b3d2-0238c4e11c91\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " Jul 02 15:31:52.939488 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:52.939252 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qsns\" (UniqueName: \"kubernetes.io/projected/e64340a0-d02e-4033-b3d2-0238c4e11c91-kube-api-access-8qsns\") pod \"e64340a0-d02e-4033-b3d2-0238c4e11c91\" (UID: \"e64340a0-d02e-4033-b3d2-0238c4e11c91\") " Jul 02 15:31:52.939932 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:52.939901 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-bundle" (OuterVolumeSpecName: "bundle") pod "e64340a0-d02e-4033-b3d2-0238c4e11c91" (UID: "e64340a0-d02e-4033-b3d2-0238c4e11c91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:31:52.941524 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:52.941496 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64340a0-d02e-4033-b3d2-0238c4e11c91-kube-api-access-8qsns" (OuterVolumeSpecName: "kube-api-access-8qsns") pod "e64340a0-d02e-4033-b3d2-0238c4e11c91" (UID: "e64340a0-d02e-4033-b3d2-0238c4e11c91"). InnerVolumeSpecName "kube-api-access-8qsns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:31:52.944212 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:52.944190 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-util" (OuterVolumeSpecName: "util") pod "e64340a0-d02e-4033-b3d2-0238c4e11c91" (UID: "e64340a0-d02e-4033-b3d2-0238c4e11c91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:31:53.040439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:53.040392 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:31:53.040439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:53.040436 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qsns\" (UniqueName: \"kubernetes.io/projected/e64340a0-d02e-4033-b3d2-0238c4e11c91-kube-api-access-8qsns\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:31:53.040439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:53.040446 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64340a0-d02e-4033-b3d2-0238c4e11c91-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:31:53.665119 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:53.665088 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" Jul 02 15:31:53.665119 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:53.665099 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409k8vv" event={"ID":"e64340a0-d02e-4033-b3d2-0238c4e11c91","Type":"ContainerDied","Data":"549bce59882e054c591a52c5a50ff568997a3683f3afbe6d6f2f4bd4f365b088"} Jul 02 15:31:53.665322 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:31:53.665141 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="549bce59882e054c591a52c5a50ff568997a3683f3afbe6d6f2f4bd4f365b088" Jul 02 15:32:01.372629 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.372593 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp"] Jul 02 15:32:01.373023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.372929 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerName="pull" Jul 02 15:32:01.373023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.372941 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerName="pull" Jul 02 15:32:01.373023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.372956 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerName="util" Jul 02 15:32:01.373023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.372961 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerName="util" Jul 02 15:32:01.373023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.372970 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerName="extract" Jul 02 15:32:01.373023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.372977 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerName="extract" Jul 02 15:32:01.373023 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.373025 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64340a0-d02e-4033-b3d2-0238c4e11c91" containerName="extract" Jul 02 15:32:01.375221 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.375204 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.380173 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.380144 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 15:32:01.380312 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.380151 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:32:01.380312 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.380210 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-k96d7\"" Jul 02 15:32:01.390656 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.390612 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp"] Jul 02 15:32:01.514201 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.514162 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gm9f\" (UniqueName: \"kubernetes.io/projected/040c6233-8f74-4319-92c8-abdb41080794-kube-api-access-9gm9f\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdwkp\" (UID: \"040c6233-8f74-4319-92c8-abdb41080794\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.514392 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.514250 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/040c6233-8f74-4319-92c8-abdb41080794-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdwkp\" (UID: \"040c6233-8f74-4319-92c8-abdb41080794\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.615310 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.615277 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gm9f\" (UniqueName: \"kubernetes.io/projected/040c6233-8f74-4319-92c8-abdb41080794-kube-api-access-9gm9f\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdwkp\" (UID: \"040c6233-8f74-4319-92c8-abdb41080794\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.615476 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.615329 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/040c6233-8f74-4319-92c8-abdb41080794-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdwkp\" (UID: \"040c6233-8f74-4319-92c8-abdb41080794\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.615686 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.615637 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/040c6233-8f74-4319-92c8-abdb41080794-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdwkp\" (UID: \"040c6233-8f74-4319-92c8-abdb41080794\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.624102 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.624040 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gm9f\" (UniqueName: \"kubernetes.io/projected/040c6233-8f74-4319-92c8-abdb41080794-kube-api-access-9gm9f\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdwkp\" (UID: \"040c6233-8f74-4319-92c8-abdb41080794\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.684110 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.684056 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" Jul 02 15:32:01.819460 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:01.819344 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp"] Jul 02 15:32:01.822620 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:01.822589 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040c6233_8f74_4319_92c8_abdb41080794.slice/crio-443c5c8bbebee5567ea92f69407a693d898b97a0a7f1f10f3f14ef7875019bf0 WatchSource:0}: Error finding container 443c5c8bbebee5567ea92f69407a693d898b97a0a7f1f10f3f14ef7875019bf0: Status 404 returned error can't find the container with id 443c5c8bbebee5567ea92f69407a693d898b97a0a7f1f10f3f14ef7875019bf0 Jul 02 15:32:02.702252 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:02.702218 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" event={"ID":"040c6233-8f74-4319-92c8-abdb41080794","Type":"ContainerStarted","Data":"443c5c8bbebee5567ea92f69407a693d898b97a0a7f1f10f3f14ef7875019bf0"} Jul 02 15:32:03.708880 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:03.708785 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" event={"ID":"040c6233-8f74-4319-92c8-abdb41080794","Type":"ContainerStarted","Data":"6dcc4009fbab703d1761d1913afc9156a8018527b597373ac563a7828095250d"} Jul 02 15:32:03.738057 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:03.737370 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdwkp" podStartSLOduration=1.265788164 podStartE2EDuration="2.737348919s" totalImagesPullingTime="1.471560755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:03.735167626 +0000 UTC m=+277.600023823" watchObservedRunningTime="2026-07-02 15:32:03.737348919 +0000 UTC m=+277.602205117" Jul 02 15:32:04.971205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:04.971161 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp"] Jul 02 15:32:04.973830 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:04.973805 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:04.976505 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:04.976480 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 15:32:04.976951 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:04.976927 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 15:32:04.977057 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:04.976986 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gtdfj\"" Jul 02 15:32:04.983394 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:04.983372 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp"] Jul 02 15:32:05.046201 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.046165 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.046358 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.046206 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.046358 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.046237 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t26hj\" (UniqueName: \"kubernetes.io/projected/67e8bd2a-08dd-4831-985e-278a7c132377-kube-api-access-t26hj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.147281 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.147252 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.147281 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.147287 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.147472 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.147308 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t26hj\" (UniqueName: \"kubernetes.io/projected/67e8bd2a-08dd-4831-985e-278a7c132377-kube-api-access-t26hj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.147798 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.147764 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.147798 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.147784 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.155857 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.155833 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t26hj\" (UniqueName: \"kubernetes.io/projected/67e8bd2a-08dd-4831-985e-278a7c132377-kube-api-access-t26hj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.282764 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.282727 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:05.418209 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.418186 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp"] Jul 02 15:32:05.420584 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:05.420555 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e8bd2a_08dd_4831_985e_278a7c132377.slice/crio-6aa6b32fc94d044901c3b7ec3dcba014bd4675de3c2a175b3d0493c9dab46b9d WatchSource:0}: Error finding container 6aa6b32fc94d044901c3b7ec3dcba014bd4675de3c2a175b3d0493c9dab46b9d: Status 404 returned error can't find the container with id 6aa6b32fc94d044901c3b7ec3dcba014bd4675de3c2a175b3d0493c9dab46b9d Jul 02 15:32:05.420751 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.420729 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8ssjn"] Jul 02 15:32:05.423389 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.423373 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.425862 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.425841 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kmlqb\"" Jul 02 15:32:05.425963 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.425843 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 15:32:05.425963 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.425923 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 15:32:05.435594 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.435579 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8ssjn"] Jul 02 15:32:05.551450 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.551358 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjkpt\" (UniqueName: \"kubernetes.io/projected/a5f78a3b-29b0-4630-b12c-eca036f6ab88-kube-api-access-xjkpt\") pod \"cert-manager-webhook-6486ffd997-8ssjn\" (UID: \"a5f78a3b-29b0-4630-b12c-eca036f6ab88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.551450 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.551417 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5f78a3b-29b0-4630-b12c-eca036f6ab88-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8ssjn\" (UID: \"a5f78a3b-29b0-4630-b12c-eca036f6ab88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.652280 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.652240 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjkpt\" (UniqueName: \"kubernetes.io/projected/a5f78a3b-29b0-4630-b12c-eca036f6ab88-kube-api-access-xjkpt\") pod \"cert-manager-webhook-6486ffd997-8ssjn\" (UID: \"a5f78a3b-29b0-4630-b12c-eca036f6ab88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.652466 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.652317 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5f78a3b-29b0-4630-b12c-eca036f6ab88-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8ssjn\" (UID: \"a5f78a3b-29b0-4630-b12c-eca036f6ab88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.660197 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.660174 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5f78a3b-29b0-4630-b12c-eca036f6ab88-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8ssjn\" (UID: \"a5f78a3b-29b0-4630-b12c-eca036f6ab88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.660315 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.660251 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjkpt\" (UniqueName: \"kubernetes.io/projected/a5f78a3b-29b0-4630-b12c-eca036f6ab88-kube-api-access-xjkpt\") pod \"cert-manager-webhook-6486ffd997-8ssjn\" (UID: \"a5f78a3b-29b0-4630-b12c-eca036f6ab88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.717718 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.717680 2549 generic.go:356] "Generic (PLEG): container finished" podID="67e8bd2a-08dd-4831-985e-278a7c132377" containerID="c3b0033d483c18619bcf0be1b3e2b47ca5f1784779f2478c5eafc3cb10967c03" exitCode=0 Jul 02 15:32:05.717881 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.717758 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" event={"ID":"67e8bd2a-08dd-4831-985e-278a7c132377","Type":"ContainerDied","Data":"c3b0033d483c18619bcf0be1b3e2b47ca5f1784779f2478c5eafc3cb10967c03"} Jul 02 15:32:05.717881 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.717809 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" event={"ID":"67e8bd2a-08dd-4831-985e-278a7c132377","Type":"ContainerStarted","Data":"6aa6b32fc94d044901c3b7ec3dcba014bd4675de3c2a175b3d0493c9dab46b9d"} Jul 02 15:32:05.740439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.740393 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:05.868434 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:05.868401 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8ssjn"] Jul 02 15:32:05.871884 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:05.871861 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5f78a3b_29b0_4630_b12c_eca036f6ab88.slice/crio-2ae0e9c6b44b23a3e979929530586d98b9d8c0e72a1719da0cdac248e85f696d WatchSource:0}: Error finding container 2ae0e9c6b44b23a3e979929530586d98b9d8c0e72a1719da0cdac248e85f696d: Status 404 returned error can't find the container with id 2ae0e9c6b44b23a3e979929530586d98b9d8c0e72a1719da0cdac248e85f696d Jul 02 15:32:06.724672 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:06.724618 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" event={"ID":"a5f78a3b-29b0-4630-b12c-eca036f6ab88","Type":"ContainerStarted","Data":"2ae0e9c6b44b23a3e979929530586d98b9d8c0e72a1719da0cdac248e85f696d"} Jul 02 15:32:07.064305 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.064254 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f74zv"] Jul 02 15:32:07.066993 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.066960 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:07.069319 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.069294 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cvzdj\"" Jul 02 15:32:07.075660 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.075376 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f74zv"] Jul 02 15:32:07.165970 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.165913 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fc0da79-52eb-4e11-9811-821c68e59e2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f74zv\" (UID: \"0fc0da79-52eb-4e11-9811-821c68e59e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:07.166151 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.165993 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq49b\" (UniqueName: \"kubernetes.io/projected/0fc0da79-52eb-4e11-9811-821c68e59e2f-kube-api-access-fq49b\") pod \"cert-manager-cainjector-559cdd8c87-f74zv\" (UID: \"0fc0da79-52eb-4e11-9811-821c68e59e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:07.266458 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.266424 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fc0da79-52eb-4e11-9811-821c68e59e2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f74zv\" (UID: \"0fc0da79-52eb-4e11-9811-821c68e59e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:07.266654 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.266476 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq49b\" (UniqueName: \"kubernetes.io/projected/0fc0da79-52eb-4e11-9811-821c68e59e2f-kube-api-access-fq49b\") pod \"cert-manager-cainjector-559cdd8c87-f74zv\" (UID: \"0fc0da79-52eb-4e11-9811-821c68e59e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:07.275049 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.275018 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq49b\" (UniqueName: \"kubernetes.io/projected/0fc0da79-52eb-4e11-9811-821c68e59e2f-kube-api-access-fq49b\") pod \"cert-manager-cainjector-559cdd8c87-f74zv\" (UID: \"0fc0da79-52eb-4e11-9811-821c68e59e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:07.275197 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.275105 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fc0da79-52eb-4e11-9811-821c68e59e2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f74zv\" (UID: \"0fc0da79-52eb-4e11-9811-821c68e59e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:07.379034 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:07.378958 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" Jul 02 15:32:08.095771 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:08.095575 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f74zv"] Jul 02 15:32:08.098367 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:08.098340 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fc0da79_52eb_4e11_9811_821c68e59e2f.slice/crio-e669d4ba355e3a6de74a6537c4465a0e82eac05cc4bac430b58c6a67a84f8fe5 WatchSource:0}: Error finding container e669d4ba355e3a6de74a6537c4465a0e82eac05cc4bac430b58c6a67a84f8fe5: Status 404 returned error can't find the container with id e669d4ba355e3a6de74a6537c4465a0e82eac05cc4bac430b58c6a67a84f8fe5 Jul 02 15:32:08.737479 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:08.737397 2549 generic.go:356] "Generic (PLEG): container finished" podID="67e8bd2a-08dd-4831-985e-278a7c132377" containerID="3a1cc00a0598793f1f695d61fe5b96afb0444705b7f0567c3bc02d48cf3b95cf" exitCode=0 Jul 02 15:32:08.737637 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:08.737491 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" event={"ID":"67e8bd2a-08dd-4831-985e-278a7c132377","Type":"ContainerDied","Data":"3a1cc00a0598793f1f695d61fe5b96afb0444705b7f0567c3bc02d48cf3b95cf"} Jul 02 15:32:08.738918 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:08.738890 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" event={"ID":"0fc0da79-52eb-4e11-9811-821c68e59e2f","Type":"ContainerStarted","Data":"e669d4ba355e3a6de74a6537c4465a0e82eac05cc4bac430b58c6a67a84f8fe5"} Jul 02 15:32:09.745479 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:09.745441 2549 generic.go:356] "Generic (PLEG): container finished" podID="67e8bd2a-08dd-4831-985e-278a7c132377" containerID="adfa563094107aebd06360bee7e36e9e55c5e6b4c317ad4030a017efa08624d0" exitCode=0 Jul 02 15:32:09.745943 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:09.745538 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" event={"ID":"67e8bd2a-08dd-4831-985e-278a7c132377","Type":"ContainerDied","Data":"adfa563094107aebd06360bee7e36e9e55c5e6b4c317ad4030a017efa08624d0"} Jul 02 15:32:10.751398 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:10.751353 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" event={"ID":"a5f78a3b-29b0-4630-b12c-eca036f6ab88","Type":"ContainerStarted","Data":"0fad15d774babbcbf8e6097d1586a261929aa0da307de8741f5f90c0789381c6"} Jul 02 15:32:10.751839 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:10.751442 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:10.768057 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:10.768006 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" podStartSLOduration=1.6041880910000001 podStartE2EDuration="5.7679895s" totalImagesPullingTime="4.163801409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:10.767075966 +0000 UTC m=+284.631932166" watchObservedRunningTime="2026-07-02 15:32:10.7679895 +0000 UTC m=+284.632845697" Jul 02 15:32:10.882656 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:10.882620 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:11.001352 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.001316 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t26hj\" (UniqueName: \"kubernetes.io/projected/67e8bd2a-08dd-4831-985e-278a7c132377-kube-api-access-t26hj\") pod \"67e8bd2a-08dd-4831-985e-278a7c132377\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " Jul 02 15:32:11.001608 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.001387 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-bundle\") pod \"67e8bd2a-08dd-4831-985e-278a7c132377\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " Jul 02 15:32:11.001608 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.001447 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-util\") pod \"67e8bd2a-08dd-4831-985e-278a7c132377\" (UID: \"67e8bd2a-08dd-4831-985e-278a7c132377\") " Jul 02 15:32:11.001900 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.001865 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-bundle" (OuterVolumeSpecName: "bundle") pod "67e8bd2a-08dd-4831-985e-278a7c132377" (UID: "67e8bd2a-08dd-4831-985e-278a7c132377"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:32:11.003597 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.003563 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e8bd2a-08dd-4831-985e-278a7c132377-kube-api-access-t26hj" (OuterVolumeSpecName: "kube-api-access-t26hj") pod "67e8bd2a-08dd-4831-985e-278a7c132377" (UID: "67e8bd2a-08dd-4831-985e-278a7c132377"). InnerVolumeSpecName "kube-api-access-t26hj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:32:11.005830 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.005805 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-util" (OuterVolumeSpecName: "util") pod "67e8bd2a-08dd-4831-985e-278a7c132377" (UID: "67e8bd2a-08dd-4831-985e-278a7c132377"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:32:11.102713 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.102677 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t26hj\" (UniqueName: \"kubernetes.io/projected/67e8bd2a-08dd-4831-985e-278a7c132377-kube-api-access-t26hj\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:32:11.102713 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.102706 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:32:11.102713 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.102717 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67e8bd2a-08dd-4831-985e-278a7c132377-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:32:11.758629 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.758596 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" Jul 02 15:32:11.759028 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.758599 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgsmsp" event={"ID":"67e8bd2a-08dd-4831-985e-278a7c132377","Type":"ContainerDied","Data":"6aa6b32fc94d044901c3b7ec3dcba014bd4675de3c2a175b3d0493c9dab46b9d"} Jul 02 15:32:11.759028 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:11.758755 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6aa6b32fc94d044901c3b7ec3dcba014bd4675de3c2a175b3d0493c9dab46b9d" Jul 02 15:32:16.761338 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:16.761307 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8ssjn" Jul 02 15:32:21.803941 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:21.803908 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" event={"ID":"0fc0da79-52eb-4e11-9811-821c68e59e2f","Type":"ContainerStarted","Data":"dfb1a56aad385525da8e91d3264a72345010cf1bcb258fb14ba04aaa3d554b02"} Jul 02 15:32:21.820222 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:21.820166 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f74zv" podStartSLOduration=1.52470102 podStartE2EDuration="14.82014635s" totalImagesPullingTime="13.29544533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:21.818798827 +0000 UTC m=+295.683655025" watchObservedRunningTime="2026-07-02 15:32:21.82014635 +0000 UTC m=+295.685002546" Jul 02 15:32:26.529785 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:26.529745 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:32:26.530350 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:26.530038 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:32:26.534577 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:26.534556 2549 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 15:32:27.233906 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.233864 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn"] Jul 02 15:32:27.235180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.234222 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bd2a-08dd-4831-985e-278a7c132377" containerName="util" Jul 02 15:32:27.235180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.234236 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bd2a-08dd-4831-985e-278a7c132377" containerName="util" Jul 02 15:32:27.235180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.234247 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bd2a-08dd-4831-985e-278a7c132377" containerName="pull" Jul 02 15:32:27.235180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.234252 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bd2a-08dd-4831-985e-278a7c132377" containerName="pull" Jul 02 15:32:27.235180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.234258 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bd2a-08dd-4831-985e-278a7c132377" containerName="extract" Jul 02 15:32:27.235180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.234264 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bd2a-08dd-4831-985e-278a7c132377" containerName="extract" Jul 02 15:32:27.235180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.234328 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e8bd2a-08dd-4831-985e-278a7c132377" containerName="extract" Jul 02 15:32:27.236288 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.236267 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.238667 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.238618 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 15:32:27.239265 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.239247 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gtdfj\"" Jul 02 15:32:27.239316 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.239248 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 15:32:27.244745 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.244716 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn"] Jul 02 15:32:27.340705 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.340668 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.340705 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.340716 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.341008 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.340807 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9d7\" (UniqueName: \"kubernetes.io/projected/a7085b13-d541-4f31-91f0-78147eb84f7d-kube-api-access-4h9d7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.442064 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.442019 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.442064 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.442072 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.442349 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.442114 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9d7\" (UniqueName: \"kubernetes.io/projected/a7085b13-d541-4f31-91f0-78147eb84f7d-kube-api-access-4h9d7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.442465 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.442442 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.442542 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.442502 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.450979 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.450939 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9d7\" (UniqueName: \"kubernetes.io/projected/a7085b13-d541-4f31-91f0-78147eb84f7d-kube-api-access-4h9d7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.546845 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.546803 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:27.708238 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.708207 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn"] Jul 02 15:32:27.709846 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:27.709819 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7085b13_d541_4f31_91f0_78147eb84f7d.slice/crio-59ab4bb59fffb567aefd1089b52d1b23273e0b512ae9b0089b6eb8d8ea27c32a WatchSource:0}: Error finding container 59ab4bb59fffb567aefd1089b52d1b23273e0b512ae9b0089b6eb8d8ea27c32a: Status 404 returned error can't find the container with id 59ab4bb59fffb567aefd1089b52d1b23273e0b512ae9b0089b6eb8d8ea27c32a Jul 02 15:32:27.832017 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.831980 2549 generic.go:356] "Generic (PLEG): container finished" podID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerID="db6bd0ee1ede93c88a8fb00b85015be71d581a1788b02f1870af239a1596983a" exitCode=0 Jul 02 15:32:27.832217 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.832060 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" event={"ID":"a7085b13-d541-4f31-91f0-78147eb84f7d","Type":"ContainerDied","Data":"db6bd0ee1ede93c88a8fb00b85015be71d581a1788b02f1870af239a1596983a"} Jul 02 15:32:27.832217 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.832105 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" event={"ID":"a7085b13-d541-4f31-91f0-78147eb84f7d","Type":"ContainerStarted","Data":"59ab4bb59fffb567aefd1089b52d1b23273e0b512ae9b0089b6eb8d8ea27c32a"} Jul 02 15:32:27.832570 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:27.832554 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:32:28.839094 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:28.839060 2549 generic.go:356] "Generic (PLEG): container finished" podID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerID="038bceb3291023ebfa1be97f55a8ddc42c6b5edfe7dd51ce80755927fbdd80a9" exitCode=0 Jul 02 15:32:28.839499 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:28.839124 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" event={"ID":"a7085b13-d541-4f31-91f0-78147eb84f7d","Type":"ContainerDied","Data":"038bceb3291023ebfa1be97f55a8ddc42c6b5edfe7dd51ce80755927fbdd80a9"} Jul 02 15:32:29.846781 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:29.846751 2549 generic.go:356] "Generic (PLEG): container finished" podID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerID="be6b95b210b20c99d0a78bb94401c75f1e85264ef90c4e75e7520c57ee0a8d09" exitCode=0 Jul 02 15:32:29.847177 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:29.846831 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" event={"ID":"a7085b13-d541-4f31-91f0-78147eb84f7d","Type":"ContainerDied","Data":"be6b95b210b20c99d0a78bb94401c75f1e85264ef90c4e75e7520c57ee0a8d09"} Jul 02 15:32:30.975302 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:30.975276 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:31.075503 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.075466 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-util\") pod \"a7085b13-d541-4f31-91f0-78147eb84f7d\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " Jul 02 15:32:31.075503 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.075502 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h9d7\" (UniqueName: \"kubernetes.io/projected/a7085b13-d541-4f31-91f0-78147eb84f7d-kube-api-access-4h9d7\") pod \"a7085b13-d541-4f31-91f0-78147eb84f7d\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " Jul 02 15:32:31.075752 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.075529 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-bundle\") pod \"a7085b13-d541-4f31-91f0-78147eb84f7d\" (UID: \"a7085b13-d541-4f31-91f0-78147eb84f7d\") " Jul 02 15:32:31.076258 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.076235 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-bundle" (OuterVolumeSpecName: "bundle") pod "a7085b13-d541-4f31-91f0-78147eb84f7d" (UID: "a7085b13-d541-4f31-91f0-78147eb84f7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:32:31.077618 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.077593 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7085b13-d541-4f31-91f0-78147eb84f7d-kube-api-access-4h9d7" (OuterVolumeSpecName: "kube-api-access-4h9d7") pod "a7085b13-d541-4f31-91f0-78147eb84f7d" (UID: "a7085b13-d541-4f31-91f0-78147eb84f7d"). InnerVolumeSpecName "kube-api-access-4h9d7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:32:31.082041 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.081998 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-util" (OuterVolumeSpecName: "util") pod "a7085b13-d541-4f31-91f0-78147eb84f7d" (UID: "a7085b13-d541-4f31-91f0-78147eb84f7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:32:31.177094 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.177003 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:32:31.177094 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.177033 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h9d7\" (UniqueName: \"kubernetes.io/projected/a7085b13-d541-4f31-91f0-78147eb84f7d-kube-api-access-4h9d7\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:32:31.177094 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.177044 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7085b13-d541-4f31-91f0-78147eb84f7d-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:32:31.857117 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.857087 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" event={"ID":"a7085b13-d541-4f31-91f0-78147eb84f7d","Type":"ContainerDied","Data":"59ab4bb59fffb567aefd1089b52d1b23273e0b512ae9b0089b6eb8d8ea27c32a"} Jul 02 15:32:31.857292 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.857133 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59ab4bb59fffb567aefd1089b52d1b23273e0b512ae9b0089b6eb8d8ea27c32a" Jul 02 15:32:31.857292 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:31.857183 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflwlwn" Jul 02 15:32:38.873136 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873101 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn"] Jul 02 15:32:38.873537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873386 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerName="util" Jul 02 15:32:38.873537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873396 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerName="util" Jul 02 15:32:38.873537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873412 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerName="pull" Jul 02 15:32:38.873537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873418 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerName="pull" Jul 02 15:32:38.873537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873434 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerName="extract" Jul 02 15:32:38.873537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873439 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerName="extract" Jul 02 15:32:38.873537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.873490 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7085b13-d541-4f31-91f0-78147eb84f7d" containerName="extract" Jul 02 15:32:38.876135 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.876118 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:38.883777 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.883748 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 15:32:38.883896 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.883788 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 15:32:38.883963 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.883944 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 15:32:38.884057 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.884042 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 15:32:38.885820 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.885802 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l5xkw\"" Jul 02 15:32:38.929941 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.929902 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn"] Jul 02 15:32:38.947866 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.947835 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5934564-60b2-4b98-bbde-244d910b43c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:38.948029 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.947918 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5934564-60b2-4b98-bbde-244d910b43c5-manifests\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:38.948029 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.947961 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzjsx\" (UniqueName: \"kubernetes.io/projected/b5934564-60b2-4b98-bbde-244d910b43c5-kube-api-access-gzjsx\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:38.948137 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.948026 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5934564-60b2-4b98-bbde-244d910b43c5-tmp\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:38.948137 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:38.948078 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5934564-60b2-4b98-bbde-244d910b43c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.048724 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.048686 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5934564-60b2-4b98-bbde-244d910b43c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.048882 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.048779 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5934564-60b2-4b98-bbde-244d910b43c5-manifests\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.048882 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.048808 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzjsx\" (UniqueName: \"kubernetes.io/projected/b5934564-60b2-4b98-bbde-244d910b43c5-kube-api-access-gzjsx\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.048882 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.048825 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5934564-60b2-4b98-bbde-244d910b43c5-tmp\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.048882 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.048853 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5934564-60b2-4b98-bbde-244d910b43c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.049276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.049244 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5934564-60b2-4b98-bbde-244d910b43c5-manifests\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.051204 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.051178 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5934564-60b2-4b98-bbde-244d910b43c5-tmp\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.051312 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.051291 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5934564-60b2-4b98-bbde-244d910b43c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.051370 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.051295 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5934564-60b2-4b98-bbde-244d910b43c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.061330 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.061290 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzjsx\" (UniqueName: \"kubernetes.io/projected/b5934564-60b2-4b98-bbde-244d910b43c5-kube-api-access-gzjsx\") pod \"opendatahub-operator-controller-manager-6555957f57-g8jfn\" (UID: \"b5934564-60b2-4b98-bbde-244d910b43c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.186714 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.186609 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:39.336322 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.336285 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn"] Jul 02 15:32:39.339898 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:39.339868 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5934564_60b2_4b98_bbde_244d910b43c5.slice/crio-067c0271c17e905029e6724196f409184e9db74daf4b4458af4e71dfe1b6c713 WatchSource:0}: Error finding container 067c0271c17e905029e6724196f409184e9db74daf4b4458af4e71dfe1b6c713: Status 404 returned error can't find the container with id 067c0271c17e905029e6724196f409184e9db74daf4b4458af4e71dfe1b6c713 Jul 02 15:32:39.893092 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:39.893051 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" event={"ID":"b5934564-60b2-4b98-bbde-244d910b43c5","Type":"ContainerStarted","Data":"067c0271c17e905029e6724196f409184e9db74daf4b4458af4e71dfe1b6c713"} Jul 02 15:32:42.913197 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:42.913151 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" event={"ID":"b5934564-60b2-4b98-bbde-244d910b43c5","Type":"ContainerStarted","Data":"6a8bca82cff3733502d503b4c7b6c27b471f390b937daa6b28c664b3aaa8609d"} Jul 02 15:32:43.919341 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:43.919300 2549 generic.go:356] "Generic (PLEG): container finished" podID="b5934564-60b2-4b98-bbde-244d910b43c5" containerID="6a8bca82cff3733502d503b4c7b6c27b471f390b937daa6b28c664b3aaa8609d" exitCode=0 Jul 02 15:32:43.919738 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:43.919383 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" event={"ID":"b5934564-60b2-4b98-bbde-244d910b43c5","Type":"ContainerDied","Data":"6a8bca82cff3733502d503b4c7b6c27b471f390b937daa6b28c664b3aaa8609d"} Jul 02 15:32:44.925719 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:44.925678 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" event={"ID":"b5934564-60b2-4b98-bbde-244d910b43c5","Type":"ContainerStarted","Data":"9869f7171d329b0a6d4fbc08c5266d5e14212ddf9bf97b1352f1e4db4f1df0f1"} Jul 02 15:32:44.926195 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:44.925840 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:45.030359 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:45.030282 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" podStartSLOduration=2.533201746 podStartE2EDuration="7.030256501s" totalImagesPullingTime="3.462618326s" totalInitContainerRuntime="1.034436429s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:45.027954111 +0000 UTC m=+318.892810308" watchObservedRunningTime="2026-07-02 15:32:45.030256501 +0000 UTC m=+318.895112699" Jul 02 15:32:55.932544 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:55.932513 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6555957f57-g8jfn" Jul 02 15:32:58.823723 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.823688 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fcd68765c-97bg6"] Jul 02 15:32:58.832848 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.832824 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:58.835422 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.835405 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 15:32:58.835604 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.835591 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gv62x\"" Jul 02 15:32:58.836123 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.836108 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 15:32:58.836240 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.836210 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 15:32:58.836307 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.836261 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 15:32:58.851923 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.851892 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fcd68765c-97bg6"] Jul 02 15:32:58.930715 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.930679 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6swnp\" (UniqueName: \"kubernetes.io/projected/b33ab9b2-7a8a-429e-95df-8233292e720a-kube-api-access-6swnp\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:58.930883 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.930733 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33ab9b2-7a8a-429e-95df-8233292e720a-tls-certs\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:58.930883 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.930819 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33ab9b2-7a8a-429e-95df-8233292e720a-tmp\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:58.937338 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.937304 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl88d"] Jul 02 15:32:58.940332 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.940304 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:58.943143 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.943120 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-g69zd\"" Jul 02 15:32:58.944945 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.944920 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 15:32:58.961332 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:58.961296 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl88d"] Jul 02 15:32:59.031807 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.031772 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33ab9b2-7a8a-429e-95df-8233292e720a-tls-certs\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:59.032001 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.031833 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33ab9b2-7a8a-429e-95df-8233292e720a-tmp\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:59.032001 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.031864 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qff\" (UniqueName: \"kubernetes.io/projected/90776f85-a799-4e33-bac7-67ad6e429e69-kube-api-access-27qff\") pod \"odh-model-controller-7998c67dc4-bl88d\" (UID: \"90776f85-a799-4e33-bac7-67ad6e429e69\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:59.032001 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.031902 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90776f85-a799-4e33-bac7-67ad6e429e69-cert\") pod \"odh-model-controller-7998c67dc4-bl88d\" (UID: \"90776f85-a799-4e33-bac7-67ad6e429e69\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:59.032164 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.032062 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6swnp\" (UniqueName: \"kubernetes.io/projected/b33ab9b2-7a8a-429e-95df-8233292e720a-kube-api-access-6swnp\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:59.034178 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.034148 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33ab9b2-7a8a-429e-95df-8233292e720a-tmp\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:59.034446 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.034427 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33ab9b2-7a8a-429e-95df-8233292e720a-tls-certs\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:59.042255 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.042227 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6swnp\" (UniqueName: \"kubernetes.io/projected/b33ab9b2-7a8a-429e-95df-8233292e720a-kube-api-access-6swnp\") pod \"kube-auth-proxy-fcd68765c-97bg6\" (UID: \"b33ab9b2-7a8a-429e-95df-8233292e720a\") " pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:59.132582 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.132491 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qff\" (UniqueName: \"kubernetes.io/projected/90776f85-a799-4e33-bac7-67ad6e429e69-kube-api-access-27qff\") pod \"odh-model-controller-7998c67dc4-bl88d\" (UID: \"90776f85-a799-4e33-bac7-67ad6e429e69\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:59.132582 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.132537 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90776f85-a799-4e33-bac7-67ad6e429e69-cert\") pod \"odh-model-controller-7998c67dc4-bl88d\" (UID: \"90776f85-a799-4e33-bac7-67ad6e429e69\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:59.135076 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.135041 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90776f85-a799-4e33-bac7-67ad6e429e69-cert\") pod \"odh-model-controller-7998c67dc4-bl88d\" (UID: \"90776f85-a799-4e33-bac7-67ad6e429e69\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:59.142287 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.142257 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qff\" (UniqueName: \"kubernetes.io/projected/90776f85-a799-4e33-bac7-67ad6e429e69-kube-api-access-27qff\") pod \"odh-model-controller-7998c67dc4-bl88d\" (UID: \"90776f85-a799-4e33-bac7-67ad6e429e69\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:59.143009 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.142991 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" Jul 02 15:32:59.253715 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.253684 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:32:59.321802 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.321679 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fcd68765c-97bg6"] Jul 02 15:32:59.324550 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:59.324518 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33ab9b2_7a8a_429e_95df_8233292e720a.slice/crio-9d8ce523250a5b811fa53c31696b77389b109ed867722ffcca15c4e35e85616a WatchSource:0}: Error finding container 9d8ce523250a5b811fa53c31696b77389b109ed867722ffcca15c4e35e85616a: Status 404 returned error can't find the container with id 9d8ce523250a5b811fa53c31696b77389b109ed867722ffcca15c4e35e85616a Jul 02 15:32:59.447549 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.447473 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl88d"] Jul 02 15:32:59.450197 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:32:59.450168 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90776f85_a799_4e33_bac7_67ad6e429e69.slice/crio-b3a0ecca50e028099055f93979ade0d311076ca38186bf14e3f32a5b8b4b7285 WatchSource:0}: Error finding container b3a0ecca50e028099055f93979ade0d311076ca38186bf14e3f32a5b8b4b7285: Status 404 returned error can't find the container with id b3a0ecca50e028099055f93979ade0d311076ca38186bf14e3f32a5b8b4b7285 Jul 02 15:32:59.997075 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.997039 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" event={"ID":"b33ab9b2-7a8a-429e-95df-8233292e720a","Type":"ContainerStarted","Data":"9d8ce523250a5b811fa53c31696b77389b109ed867722ffcca15c4e35e85616a"} Jul 02 15:32:59.998436 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:32:59.998403 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" event={"ID":"90776f85-a799-4e33-bac7-67ad6e429e69","Type":"ContainerStarted","Data":"b3a0ecca50e028099055f93979ade0d311076ca38186bf14e3f32a5b8b4b7285"} Jul 02 15:33:00.001550 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.001524 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nw5kx"] Jul 02 15:33:00.004768 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.004749 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.008609 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.008586 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 15:33:00.028085 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.028056 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nw5kx"] Jul 02 15:33:00.140915 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.140878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9cwb\" (UniqueName: \"kubernetes.io/projected/cefbe346-84b6-4123-8193-1522970e81d8-kube-api-access-s9cwb\") pod \"model-serving-api-54d89bd5fc-nw5kx\" (UID: \"cefbe346-84b6-4123-8193-1522970e81d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.141169 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.140938 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cefbe346-84b6-4123-8193-1522970e81d8-tls-certs\") pod \"model-serving-api-54d89bd5fc-nw5kx\" (UID: \"cefbe346-84b6-4123-8193-1522970e81d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.243536 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.243484 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9cwb\" (UniqueName: \"kubernetes.io/projected/cefbe346-84b6-4123-8193-1522970e81d8-kube-api-access-s9cwb\") pod \"model-serving-api-54d89bd5fc-nw5kx\" (UID: \"cefbe346-84b6-4123-8193-1522970e81d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.243746 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.243580 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cefbe346-84b6-4123-8193-1522970e81d8-tls-certs\") pod \"model-serving-api-54d89bd5fc-nw5kx\" (UID: \"cefbe346-84b6-4123-8193-1522970e81d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.248905 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.248835 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cefbe346-84b6-4123-8193-1522970e81d8-tls-certs\") pod \"model-serving-api-54d89bd5fc-nw5kx\" (UID: \"cefbe346-84b6-4123-8193-1522970e81d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.257121 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.257065 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9cwb\" (UniqueName: \"kubernetes.io/projected/cefbe346-84b6-4123-8193-1522970e81d8-kube-api-access-s9cwb\") pod \"model-serving-api-54d89bd5fc-nw5kx\" (UID: \"cefbe346-84b6-4123-8193-1522970e81d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.316760 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.316713 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:00.517182 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.517146 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nw5kx"] Jul 02 15:33:00.523051 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:33:00.523017 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcefbe346_84b6_4123_8193_1522970e81d8.slice/crio-584197b6f4c129c96e1698e07793ecd6cc3a92e8f6112015d027131c27fe2294 WatchSource:0}: Error finding container 584197b6f4c129c96e1698e07793ecd6cc3a92e8f6112015d027131c27fe2294: Status 404 returned error can't find the container with id 584197b6f4c129c96e1698e07793ecd6cc3a92e8f6112015d027131c27fe2294 Jul 02 15:33:00.949972 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.948822 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc"] Jul 02 15:33:00.952383 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.952362 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:00.955732 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.955104 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 15:33:00.955732 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.955455 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 15:33:00.955732 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.955466 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 15:33:00.956478 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.956273 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 15:33:00.956478 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.956438 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xvclz\"" Jul 02 15:33:00.967212 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:00.967146 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc"] Jul 02 15:33:01.007039 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.006958 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" event={"ID":"cefbe346-84b6-4123-8193-1522970e81d8","Type":"ContainerStarted","Data":"584197b6f4c129c96e1698e07793ecd6cc3a92e8f6112015d027131c27fe2294"} Jul 02 15:33:01.050879 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.050841 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-cacerts\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.051058 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.050897 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.051058 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.050975 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-istio-token\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.051058 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.050999 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltsgk\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-kube-api-access-ltsgk\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.051185 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.051094 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f459bd68-dd59-428f-89c3-414181ae78d5-local-certs\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.051185 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.051140 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.051185 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.051175 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.152341 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.152308 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-istio-token\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.152537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.152350 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsgk\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-kube-api-access-ltsgk\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.152537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.152399 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f459bd68-dd59-428f-89c3-414181ae78d5-local-certs\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.152537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.152436 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.152537 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.152484 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.152779 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.152549 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-cacerts\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.152779 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.152578 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.153163 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.153140 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.154849 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.154825 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f459bd68-dd59-428f-89c3-414181ae78d5-local-certs\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.155163 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.155139 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-cacerts\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.155291 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.155276 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.155409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.155388 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.159809 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.159783 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-istio-token\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.159986 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.159968 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltsgk\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-kube-api-access-ltsgk\") pod \"istiod-openshift-gateway-7574459656-s7xfc\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.268264 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.268227 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:01.456310 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:01.456277 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc"] Jul 02 15:33:01.459688 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:33:01.459655 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf459bd68_dd59_428f_89c3_414181ae78d5.slice/crio-4306402df0a4331762ec867c71a4d0fa2a6c0a28638c36355031552da61863b8 WatchSource:0}: Error finding container 4306402df0a4331762ec867c71a4d0fa2a6c0a28638c36355031552da61863b8: Status 404 returned error can't find the container with id 4306402df0a4331762ec867c71a4d0fa2a6c0a28638c36355031552da61863b8 Jul 02 15:33:02.018076 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:02.017961 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" event={"ID":"f459bd68-dd59-428f-89c3-414181ae78d5","Type":"ContainerStarted","Data":"4306402df0a4331762ec867c71a4d0fa2a6c0a28638c36355031552da61863b8"} Jul 02 15:33:05.045530 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.045434 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" event={"ID":"cefbe346-84b6-4123-8193-1522970e81d8","Type":"ContainerStarted","Data":"283916dcb8a87f395ca1e57d6f55f660a059ea937698e19279f6c1436922e156"} Jul 02 15:33:05.046046 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.045573 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:05.048068 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.048012 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" event={"ID":"b33ab9b2-7a8a-429e-95df-8233292e720a","Type":"ContainerStarted","Data":"fbdb5dbbfe3af8f995892f2950d8037e84b69b5866d4fac3dba80f007d1f959e"} Jul 02 15:33:05.049924 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.049888 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" event={"ID":"90776f85-a799-4e33-bac7-67ad6e429e69","Type":"ContainerStarted","Data":"536bd6b6ade84044e590e16df395ff5c978d58bb356d79844baa5bd16616ab3d"} Jul 02 15:33:05.050047 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.050038 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:33:05.071867 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.071800 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" podStartSLOduration=2.5923777980000002 podStartE2EDuration="6.071782605s" totalImagesPullingTime="3.479404807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:05.07119207 +0000 UTC m=+338.936048271" watchObservedRunningTime="2026-07-02 15:33:05.071782605 +0000 UTC m=+338.936638802" Jul 02 15:33:05.092584 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.092518 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fcd68765c-97bg6" podStartSLOduration=2.411801811 podStartE2EDuration="7.09249897s" totalImagesPullingTime="4.680697159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:05.088036116 +0000 UTC m=+338.952892314" watchObservedRunningTime="2026-07-02 15:33:05.09249897 +0000 UTC m=+338.957355168" Jul 02 15:33:05.107001 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:05.106940 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" podStartSLOduration=2.556207373 podStartE2EDuration="7.106919405s" totalImagesPullingTime="4.550712032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:05.105133989 +0000 UTC m=+338.969990186" watchObservedRunningTime="2026-07-02 15:33:05.106919405 +0000 UTC m=+338.971775605" Jul 02 15:33:06.395741 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:06.395687 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:33:06.396031 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:06.395776 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:33:07.062523 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.062486 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" event={"ID":"f459bd68-dd59-428f-89c3-414181ae78d5","Type":"ContainerStarted","Data":"ad5962fce25ad276bd0e54d4dc401521de0ca2f1943d02ae475cd0b7d90be39d"} Jul 02 15:33:07.062726 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.062639 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:07.064331 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.064295 2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-s7xfc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 15:33:07.064435 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.064346 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" podUID="f459bd68-dd59-428f-89c3-414181ae78d5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:33:07.089593 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.089543 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" podStartSLOduration=2.156359858 podStartE2EDuration="7.089529665s" totalImagesPullingTime="4.933169807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:07.088167477 +0000 UTC m=+340.953023688" watchObservedRunningTime="2026-07-02 15:33:07.089529665 +0000 UTC m=+340.954385861" Jul 02 15:33:07.670228 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.670185 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br"] Jul 02 15:33:07.672820 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.672799 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.675106 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.675084 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-92nsj\"" Jul 02 15:33:07.687322 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.687295 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br"] Jul 02 15:33:07.715756 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.715725 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/759f6d09-ed88-4d33-8545-3b61e211eb27-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.715901 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.715782 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.715901 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.715853 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.715977 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.715899 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.715977 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.715938 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.715977 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.715968 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-565xg\" (UniqueName: \"kubernetes.io/projected/759f6d09-ed88-4d33-8545-3b61e211eb27-kube-api-access-565xg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.716064 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.715990 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.716064 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.716018 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.716127 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.716075 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.802721 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.802685 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw"] Jul 02 15:33:07.805313 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.805286 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.816867 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.816777 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5chnh\" (UniqueName: \"kubernetes.io/projected/3975edd5-e217-4fcc-bddf-5eafef6e883e-kube-api-access-5chnh\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.817090 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817068 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-565xg\" (UniqueName: \"kubernetes.io/projected/759f6d09-ed88-4d33-8545-3b61e211eb27-kube-api-access-565xg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.817602 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817576 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.817735 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817635 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.817735 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817678 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.817735 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817714 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.817887 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817759 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.817887 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817803 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/759f6d09-ed88-4d33-8545-3b61e211eb27-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.817887 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817857 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.818032 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817912 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.818032 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817946 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.818032 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.817973 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3975edd5-e217-4fcc-bddf-5eafef6e883e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.818163 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.818058 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.818696 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.818665 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.818799 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.818717 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.818860 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.818808 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.818960 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.818935 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.819063 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.819035 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/759f6d09-ed88-4d33-8545-3b61e211eb27-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.819125 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.819095 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.819203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.819186 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.819363 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.819348 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.820826 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.820790 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.820937 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.820827 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.826717 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.826693 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw"] Jul 02 15:33:07.832829 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.832802 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/759f6d09-ed88-4d33-8545-3b61e211eb27-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.843465 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.843426 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-565xg\" (UniqueName: \"kubernetes.io/projected/759f6d09-ed88-4d33-8545-3b61e211eb27-kube-api-access-565xg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4479br\" (UID: \"759f6d09-ed88-4d33-8545-3b61e211eb27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:07.919786 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.919752 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5chnh\" (UniqueName: \"kubernetes.io/projected/3975edd5-e217-4fcc-bddf-5eafef6e883e-kube-api-access-5chnh\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.919941 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.919824 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.919941 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.919846 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.920019 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.919925 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.920019 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.919998 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.920124 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.920025 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3975edd5-e217-4fcc-bddf-5eafef6e883e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.920124 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.920069 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.920823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.920764 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.922527 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.922505 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.922788 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.922765 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3975edd5-e217-4fcc-bddf-5eafef6e883e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.922883 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.922837 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.922939 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.922918 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.936973 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.936951 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3975edd5-e217-4fcc-bddf-5eafef6e883e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.938943 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.938924 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5chnh\" (UniqueName: \"kubernetes.io/projected/3975edd5-e217-4fcc-bddf-5eafef6e883e-kube-api-access-5chnh\") pod \"istiod-openshift-gateway-94bb8fbfd-k87vw\" (UID: \"3975edd5-e217-4fcc-bddf-5eafef6e883e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:07.983832 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:07.983806 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:08.068917 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:08.068791 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:08.120170 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:08.120134 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:08.129921 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:08.129876 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br"] Jul 02 15:33:08.132299 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:33:08.132271 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759f6d09_ed88_4d33_8545_3b61e211eb27.slice/crio-8007a911719cd36b37a9803d0462362e8d183e2daeebdee3112ae5b64041d443 WatchSource:0}: Error finding container 8007a911719cd36b37a9803d0462362e8d183e2daeebdee3112ae5b64041d443: Status 404 returned error can't find the container with id 8007a911719cd36b37a9803d0462362e8d183e2daeebdee3112ae5b64041d443 Jul 02 15:33:08.269167 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:08.269141 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw"] Jul 02 15:33:08.271281 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:33:08.271258 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3975edd5_e217_4fcc_bddf_5eafef6e883e.slice/crio-536f4caa8234ad3a45fceb62784422b493a86125bf0631d13d97d6423e17ecc9 WatchSource:0}: Error finding container 536f4caa8234ad3a45fceb62784422b493a86125bf0631d13d97d6423e17ecc9: Status 404 returned error can't find the container with id 536f4caa8234ad3a45fceb62784422b493a86125bf0631d13d97d6423e17ecc9 Jul 02 15:33:08.274870 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:08.274839 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:33:08.274990 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:08.274900 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:33:09.074535 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:09.074493 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" event={"ID":"759f6d09-ed88-4d33-8545-3b61e211eb27","Type":"ContainerStarted","Data":"8007a911719cd36b37a9803d0462362e8d183e2daeebdee3112ae5b64041d443"} Jul 02 15:33:09.076342 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:09.076312 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" event={"ID":"3975edd5-e217-4fcc-bddf-5eafef6e883e","Type":"ContainerStarted","Data":"a7a84446bc1919a40bb73b8945795aa42f6f2a1d40a52b4fc9ca024d849507d3"} Jul 02 15:33:09.076469 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:09.076365 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" event={"ID":"3975edd5-e217-4fcc-bddf-5eafef6e883e","Type":"ContainerStarted","Data":"536f4caa8234ad3a45fceb62784422b493a86125bf0631d13d97d6423e17ecc9"} Jul 02 15:33:09.076628 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:09.076611 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:09.078379 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:09.078356 2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-k87vw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 15:33:09.078499 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:09.078405 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" podUID="3975edd5-e217-4fcc-bddf-5eafef6e883e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:33:09.119903 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:09.119819 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" podStartSLOduration=2.119800996 podStartE2EDuration="2.119800996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:09.117628094 +0000 UTC m=+342.982484293" watchObservedRunningTime="2026-07-02 15:33:09.119800996 +0000 UTC m=+342.984657193" Jul 02 15:33:10.084742 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:10.084703 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k87vw" Jul 02 15:33:10.165471 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:10.164782 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc"] Jul 02 15:33:10.165471 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:10.165110 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" podUID="f459bd68-dd59-428f-89c3-414181ae78d5" containerName="discovery" containerID="cri-o://ad5962fce25ad276bd0e54d4dc401521de0ca2f1943d02ae475cd0b7d90be39d" gracePeriod=30 Jul 02 15:33:11.068759 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.068718 2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-s7xfc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.26:8080/ready\": dial tcp 10.134.0.26:8080: connect: connection refused" start-of-body= Jul 02 15:33:11.068884 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.068796 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" podUID="f459bd68-dd59-428f-89c3-414181ae78d5" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.26:8080/ready\": dial tcp 10.134.0.26:8080: connect: connection refused" Jul 02 15:33:11.080453 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.080409 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:33:11.080582 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.080498 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:33:11.080582 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.080538 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:33:11.091578 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.091555 2549 generic.go:356] "Generic (PLEG): container finished" podID="f459bd68-dd59-428f-89c3-414181ae78d5" containerID="ad5962fce25ad276bd0e54d4dc401521de0ca2f1943d02ae475cd0b7d90be39d" exitCode=0 Jul 02 15:33:11.091997 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.091635 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" event={"ID":"f459bd68-dd59-428f-89c3-414181ae78d5","Type":"ContainerDied","Data":"ad5962fce25ad276bd0e54d4dc401521de0ca2f1943d02ae475cd0b7d90be39d"} Jul 02 15:33:11.184974 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.184954 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:11.258950 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.258915 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-istio-token\") pod \"f459bd68-dd59-428f-89c3-414181ae78d5\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " Jul 02 15:33:11.259109 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.258958 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-cacerts\") pod \"f459bd68-dd59-428f-89c3-414181ae78d5\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " Jul 02 15:33:11.259109 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.258981 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-kubeconfig\") pod \"f459bd68-dd59-428f-89c3-414181ae78d5\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " Jul 02 15:33:11.259109 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.259014 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-dns-cert\") pod \"f459bd68-dd59-428f-89c3-414181ae78d5\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " Jul 02 15:33:11.259275 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.259125 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltsgk\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-kube-api-access-ltsgk\") pod \"f459bd68-dd59-428f-89c3-414181ae78d5\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " Jul 02 15:33:11.259275 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.259160 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-ca-configmap\") pod \"f459bd68-dd59-428f-89c3-414181ae78d5\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " Jul 02 15:33:11.259275 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.259226 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f459bd68-dd59-428f-89c3-414181ae78d5-local-certs\") pod \"f459bd68-dd59-428f-89c3-414181ae78d5\" (UID: \"f459bd68-dd59-428f-89c3-414181ae78d5\") " Jul 02 15:33:11.259899 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.259821 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f459bd68-dd59-428f-89c3-414181ae78d5" (UID: "f459bd68-dd59-428f-89c3-414181ae78d5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:33:11.261915 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.261872 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f459bd68-dd59-428f-89c3-414181ae78d5" (UID: "f459bd68-dd59-428f-89c3-414181ae78d5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:33:11.262037 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.261938 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f459bd68-dd59-428f-89c3-414181ae78d5-local-certs" (OuterVolumeSpecName: "local-certs") pod "f459bd68-dd59-428f-89c3-414181ae78d5" (UID: "f459bd68-dd59-428f-89c3-414181ae78d5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:33:11.262037 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.261967 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "f459bd68-dd59-428f-89c3-414181ae78d5" (UID: "f459bd68-dd59-428f-89c3-414181ae78d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:33:11.262037 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.261998 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f459bd68-dd59-428f-89c3-414181ae78d5" (UID: "f459bd68-dd59-428f-89c3-414181ae78d5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:33:11.262711 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.262686 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-cacerts" (OuterVolumeSpecName: "cacerts") pod "f459bd68-dd59-428f-89c3-414181ae78d5" (UID: "f459bd68-dd59-428f-89c3-414181ae78d5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:33:11.262900 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.262871 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-kube-api-access-ltsgk" (OuterVolumeSpecName: "kube-api-access-ltsgk") pod "f459bd68-dd59-428f-89c3-414181ae78d5" (UID: "f459bd68-dd59-428f-89c3-414181ae78d5"). InnerVolumeSpecName "kube-api-access-ltsgk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:33:11.360834 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.360753 2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-istio-token\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:33:11.360834 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.360789 2549 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-cacerts\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:33:11.360834 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.360802 2549 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-kubeconfig\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:33:11.360834 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.360815 2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-dns-cert\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:33:11.360834 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.360832 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltsgk\" (UniqueName: \"kubernetes.io/projected/f459bd68-dd59-428f-89c3-414181ae78d5-kube-api-access-ltsgk\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:33:11.361103 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.360846 2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f459bd68-dd59-428f-89c3-414181ae78d5-istio-csr-ca-configmap\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:33:11.361103 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:11.360861 2549 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f459bd68-dd59-428f-89c3-414181ae78d5-local-certs\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:33:12.098284 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.098247 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" event={"ID":"759f6d09-ed88-4d33-8545-3b61e211eb27","Type":"ContainerStarted","Data":"04d4a0548e0bcfa7c9e17f09561fc389b1a6376a2111c945883c0530fdec9bf4"} Jul 02 15:33:12.099535 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.099517 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" Jul 02 15:33:12.099639 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.099559 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc" event={"ID":"f459bd68-dd59-428f-89c3-414181ae78d5","Type":"ContainerDied","Data":"4306402df0a4331762ec867c71a4d0fa2a6c0a28638c36355031552da61863b8"} Jul 02 15:33:12.099639 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.099619 2549 scope.go:117] "RemoveContainer" containerID="ad5962fce25ad276bd0e54d4dc401521de0ca2f1943d02ae475cd0b7d90be39d" Jul 02 15:33:12.128052 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.128012 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" podStartSLOduration=2.18242729 podStartE2EDuration="5.127995328s" totalImagesPullingTime="2.945568038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:12.126563361 +0000 UTC m=+345.991419559" watchObservedRunningTime="2026-07-02 15:33:12.127995328 +0000 UTC m=+345.992851525" Jul 02 15:33:12.144376 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.144342 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc"] Jul 02 15:33:12.151318 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.151294 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-s7xfc"] Jul 02 15:33:12.579148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.579114 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f459bd68-dd59-428f-89c3-414181ae78d5" path="/var/lib/kubelet/pods/f459bd68-dd59-428f-89c3-414181ae78d5/volumes" Jul 02 15:33:12.984749 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.984667 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:12.989137 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:12.989114 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:13.106083 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:13.106055 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:13.107235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:13.107217 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4479br" Jul 02 15:33:16.059957 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:16.059927 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nw5kx" Jul 02 15:33:16.078090 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:16.078057 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bl88d" Jul 02 15:33:59.848258 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.848222 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmxh5"] Jul 02 15:33:59.848812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.848548 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f459bd68-dd59-428f-89c3-414181ae78d5" containerName="discovery" Jul 02 15:33:59.848812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.848558 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f459bd68-dd59-428f-89c3-414181ae78d5" containerName="discovery" Jul 02 15:33:59.848812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.848626 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f459bd68-dd59-428f-89c3-414181ae78d5" containerName="discovery" Jul 02 15:33:59.850664 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.850627 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" Jul 02 15:33:59.853151 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.853126 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ggs94\"" Jul 02 15:33:59.853276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.853155 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 15:33:59.853276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.853176 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 15:33:59.870593 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.870567 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmxh5"] Jul 02 15:33:59.911966 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:33:59.911929 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7859l\" (UniqueName: \"kubernetes.io/projected/f00b552d-5c84-4cfc-be27-b57b81422483-kube-api-access-7859l\") pod \"kuadrant-operator-catalog-fmxh5\" (UID: \"f00b552d-5c84-4cfc-be27-b57b81422483\") " pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" Jul 02 15:34:00.012744 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.012706 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7859l\" (UniqueName: \"kubernetes.io/projected/f00b552d-5c84-4cfc-be27-b57b81422483-kube-api-access-7859l\") pod \"kuadrant-operator-catalog-fmxh5\" (UID: \"f00b552d-5c84-4cfc-be27-b57b81422483\") " pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" Jul 02 15:34:00.021290 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.021257 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7859l\" (UniqueName: \"kubernetes.io/projected/f00b552d-5c84-4cfc-be27-b57b81422483-kube-api-access-7859l\") pod \"kuadrant-operator-catalog-fmxh5\" (UID: \"f00b552d-5c84-4cfc-be27-b57b81422483\") " pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" Jul 02 15:34:00.161210 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.161127 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" Jul 02 15:34:00.198432 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.198406 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmxh5"] Jul 02 15:34:00.290758 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.290735 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmxh5"] Jul 02 15:34:00.292848 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:00.292820 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00b552d_5c84_4cfc_be27_b57b81422483.slice/crio-38b00ccf469968d964fef17132a041b3d2c594bcbf58e756afd4def7d0abf539 WatchSource:0}: Error finding container 38b00ccf469968d964fef17132a041b3d2c594bcbf58e756afd4def7d0abf539: Status 404 returned error can't find the container with id 38b00ccf469968d964fef17132a041b3d2c594bcbf58e756afd4def7d0abf539 Jul 02 15:34:00.322482 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.322451 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" event={"ID":"f00b552d-5c84-4cfc-be27-b57b81422483","Type":"ContainerStarted","Data":"38b00ccf469968d964fef17132a041b3d2c594bcbf58e756afd4def7d0abf539"} Jul 02 15:34:00.411348 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.411262 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nx78m"] Jul 02 15:34:00.415868 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.415841 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:00.432148 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.432121 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nx78m"] Jul 02 15:34:00.518327 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.518288 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2pcf\" (UniqueName: \"kubernetes.io/projected/a4fc5054-987c-41b3-b66a-a53faf10f7d9-kube-api-access-q2pcf\") pod \"kuadrant-operator-catalog-nx78m\" (UID: \"a4fc5054-987c-41b3-b66a-a53faf10f7d9\") " pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:00.619792 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.619752 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pcf\" (UniqueName: \"kubernetes.io/projected/a4fc5054-987c-41b3-b66a-a53faf10f7d9-kube-api-access-q2pcf\") pod \"kuadrant-operator-catalog-nx78m\" (UID: \"a4fc5054-987c-41b3-b66a-a53faf10f7d9\") " pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:00.646396 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.646359 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pcf\" (UniqueName: \"kubernetes.io/projected/a4fc5054-987c-41b3-b66a-a53faf10f7d9-kube-api-access-q2pcf\") pod \"kuadrant-operator-catalog-nx78m\" (UID: \"a4fc5054-987c-41b3-b66a-a53faf10f7d9\") " pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:00.726266 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.726181 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:00.861695 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:00.861625 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nx78m"] Jul 02 15:34:01.330144 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:01.330106 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" event={"ID":"a4fc5054-987c-41b3-b66a-a53faf10f7d9","Type":"ContainerStarted","Data":"10e3b58987e35ce31e86f8e3252c600267b8d13615aec03c46ef7a4f813c0053"} Jul 02 15:34:03.341797 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.341746 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" event={"ID":"f00b552d-5c84-4cfc-be27-b57b81422483","Type":"ContainerStarted","Data":"4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07"} Jul 02 15:34:03.341797 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.341775 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" podUID="f00b552d-5c84-4cfc-be27-b57b81422483" containerName="registry-server" containerID="cri-o://4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07" gracePeriod=2 Jul 02 15:34:03.343290 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.343268 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" event={"ID":"a4fc5054-987c-41b3-b66a-a53faf10f7d9","Type":"ContainerStarted","Data":"39b8455d6d931b19dbeec351de7e9bbedb7807b1f427ed7a6598af7fe1ea12ea"} Jul 02 15:34:03.357850 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.357805 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" podStartSLOduration=2.212479084 podStartE2EDuration="4.357788804s" totalImagesPullingTime="2.14530972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:03.356157959 +0000 UTC m=+397.221014155" watchObservedRunningTime="2026-07-02 15:34:03.357788804 +0000 UTC m=+397.222645001" Jul 02 15:34:03.370691 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.370620 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" podStartSLOduration=1.803422237 podStartE2EDuration="3.370604872s" totalImagesPullingTime="1.567182635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:03.369930789 +0000 UTC m=+397.234786989" watchObservedRunningTime="2026-07-02 15:34:03.370604872 +0000 UTC m=+397.235461067" Jul 02 15:34:03.586060 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.586037 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" Jul 02 15:34:03.647500 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.647412 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7859l\" (UniqueName: \"kubernetes.io/projected/f00b552d-5c84-4cfc-be27-b57b81422483-kube-api-access-7859l\") pod \"f00b552d-5c84-4cfc-be27-b57b81422483\" (UID: \"f00b552d-5c84-4cfc-be27-b57b81422483\") " Jul 02 15:34:03.649677 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.649637 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00b552d-5c84-4cfc-be27-b57b81422483-kube-api-access-7859l" (OuterVolumeSpecName: "kube-api-access-7859l") pod "f00b552d-5c84-4cfc-be27-b57b81422483" (UID: "f00b552d-5c84-4cfc-be27-b57b81422483"). InnerVolumeSpecName "kube-api-access-7859l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:34:03.749029 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:03.748988 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7859l\" (UniqueName: \"kubernetes.io/projected/f00b552d-5c84-4cfc-be27-b57b81422483-kube-api-access-7859l\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:04.350016 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.349981 2549 generic.go:356] "Generic (PLEG): container finished" podID="f00b552d-5c84-4cfc-be27-b57b81422483" containerID="4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07" exitCode=0 Jul 02 15:34:04.350461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.350023 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" Jul 02 15:34:04.350461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.350070 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" event={"ID":"f00b552d-5c84-4cfc-be27-b57b81422483","Type":"ContainerDied","Data":"4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07"} Jul 02 15:34:04.350461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.350118 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmxh5" event={"ID":"f00b552d-5c84-4cfc-be27-b57b81422483","Type":"ContainerDied","Data":"38b00ccf469968d964fef17132a041b3d2c594bcbf58e756afd4def7d0abf539"} Jul 02 15:34:04.350461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.350141 2549 scope.go:117] "RemoveContainer" containerID="4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07" Jul 02 15:34:04.358871 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.358852 2549 scope.go:117] "RemoveContainer" containerID="4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07" Jul 02 15:34:04.359130 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:34:04.359112 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07\": container with ID starting with 4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07 not found: ID does not exist" containerID="4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07" Jul 02 15:34:04.359174 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.359143 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07"} err="failed to get container status \"4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07\": rpc error: code = NotFound desc = could not find container \"4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07\": container with ID starting with 4824476f4840deafcbc1c7e4bdd5d30cac126bd00b13577bd123c4d840bbce07 not found: ID does not exist" Jul 02 15:34:04.370076 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.370053 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmxh5"] Jul 02 15:34:04.376471 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.376451 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmxh5"] Jul 02 15:34:04.578467 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:04.578436 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f00b552d-5c84-4cfc-be27-b57b81422483" path="/var/lib/kubelet/pods/f00b552d-5c84-4cfc-be27-b57b81422483/volumes" Jul 02 15:34:10.727024 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:10.726992 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:10.727588 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:10.727045 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:10.750205 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:10.750175 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:11.407153 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:11.407128 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nx78m" Jul 02 15:34:15.846510 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.846471 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w"] Jul 02 15:34:15.846897 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.846853 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00b552d-5c84-4cfc-be27-b57b81422483" containerName="registry-server" Jul 02 15:34:15.846897 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.846865 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00b552d-5c84-4cfc-be27-b57b81422483" containerName="registry-server" Jul 02 15:34:15.846971 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.846945 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00b552d-5c84-4cfc-be27-b57b81422483" containerName="registry-server" Jul 02 15:34:15.850239 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.850220 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:15.852742 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.852720 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8ld4d\"" Jul 02 15:34:15.858556 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.858535 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w"] Jul 02 15:34:15.959570 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.959539 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:15.959760 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.959591 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:15.959760 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:15.959694 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nnzs\" (UniqueName: \"kubernetes.io/projected/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-kube-api-access-9nnzs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.061198 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.061168 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.061368 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.061215 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.061368 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.061241 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nnzs\" (UniqueName: \"kubernetes.io/projected/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-kube-api-access-9nnzs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.061527 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.061507 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.061564 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.061546 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.069785 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.069761 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nnzs\" (UniqueName: \"kubernetes.io/projected/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-kube-api-access-9nnzs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.160487 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.160399 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:16.289553 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.289531 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w"] Jul 02 15:34:16.291593 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:16.291562 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36dbf53e_ea2d_4881_b6a8_a1ab6dbbd2ae.slice/crio-97d6767c3a45a4fafc4c689fe95f52a59742c5ab9f208501abf63cfd800e1efb WatchSource:0}: Error finding container 97d6767c3a45a4fafc4c689fe95f52a59742c5ab9f208501abf63cfd800e1efb: Status 404 returned error can't find the container with id 97d6767c3a45a4fafc4c689fe95f52a59742c5ab9f208501abf63cfd800e1efb Jul 02 15:34:16.412767 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.412696 2549 generic.go:356] "Generic (PLEG): container finished" podID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerID="f241b35befddb5d5e8a867d19ab11836f8478e5330bf030950db99e1fdcface8" exitCode=0 Jul 02 15:34:16.412891 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.412777 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" event={"ID":"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae","Type":"ContainerDied","Data":"f241b35befddb5d5e8a867d19ab11836f8478e5330bf030950db99e1fdcface8"} Jul 02 15:34:16.412891 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.412834 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" event={"ID":"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae","Type":"ContainerStarted","Data":"97d6767c3a45a4fafc4c689fe95f52a59742c5ab9f208501abf63cfd800e1efb"} Jul 02 15:34:16.450118 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.450087 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22"] Jul 02 15:34:16.452849 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.452833 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.461125 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.461102 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22"] Jul 02 15:34:16.565010 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.564977 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.565212 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.565046 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv7xk\" (UniqueName: \"kubernetes.io/projected/9a9a14d6-8567-4c38-b21b-93f18441adbe-kube-api-access-nv7xk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.565212 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.565163 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.665721 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.665602 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.665721 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.665694 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.666014 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.665990 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv7xk\" (UniqueName: \"kubernetes.io/projected/9a9a14d6-8567-4c38-b21b-93f18441adbe-kube-api-access-nv7xk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.666182 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.666055 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.666259 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.666088 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.674240 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.674212 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv7xk\" (UniqueName: \"kubernetes.io/projected/9a9a14d6-8567-4c38-b21b-93f18441adbe-kube-api-access-nv7xk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.762285 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.762245 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:16.846091 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.846058 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm"] Jul 02 15:34:16.849177 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.849162 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:16.860400 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.860370 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm"] Jul 02 15:34:16.894911 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.894878 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22"] Jul 02 15:34:16.897478 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:16.897453 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9a14d6_8567_4c38_b21b_93f18441adbe.slice/crio-dfa4683562228bca12580c19facc40c0da3260efb684af4887621676412e65bc WatchSource:0}: Error finding container dfa4683562228bca12580c19facc40c0da3260efb684af4887621676412e65bc: Status 404 returned error can't find the container with id dfa4683562228bca12580c19facc40c0da3260efb684af4887621676412e65bc Jul 02 15:34:16.968124 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.968089 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:16.968267 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.968204 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:16.968267 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:16.968225 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2h9v\" (UniqueName: \"kubernetes.io/projected/b56356e9-dff6-4718-aa37-8493a209112a-kube-api-access-q2h9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.069613 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.069583 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.069613 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.069617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2h9v\" (UniqueName: \"kubernetes.io/projected/b56356e9-dff6-4718-aa37-8493a209112a-kube-api-access-q2h9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.069873 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.069669 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.070030 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.070010 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.070089 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.070018 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.079317 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.079278 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2h9v\" (UniqueName: \"kubernetes.io/projected/b56356e9-dff6-4718-aa37-8493a209112a-kube-api-access-q2h9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.161318 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.161284 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:17.249045 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.248967 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp"] Jul 02 15:34:17.251638 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.251613 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.262504 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.262474 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp"] Jul 02 15:34:17.371894 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.371873 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.372025 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.371957 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4hxh\" (UniqueName: \"kubernetes.io/projected/8d7b952b-9980-4dcb-99f5-5928d89d4948-kube-api-access-b4hxh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.372025 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.371989 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.410910 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.410879 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm"] Jul 02 15:34:17.419579 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.419556 2549 generic.go:356] "Generic (PLEG): container finished" podID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerID="82b17ab3b8d5f84403d4861f53f7f1ad5898cc8fcc3d977e29c49dd5ba64d421" exitCode=0 Jul 02 15:34:17.419707 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.419626 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" event={"ID":"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae","Type":"ContainerDied","Data":"82b17ab3b8d5f84403d4861f53f7f1ad5898cc8fcc3d977e29c49dd5ba64d421"} Jul 02 15:34:17.421097 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.421072 2549 generic.go:356] "Generic (PLEG): container finished" podID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerID="2ced54bf604020117800c3aa392a8d536acc268b9dab8e37246dd4e7c8ea6872" exitCode=0 Jul 02 15:34:17.421145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.421130 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" event={"ID":"9a9a14d6-8567-4c38-b21b-93f18441adbe","Type":"ContainerDied","Data":"2ced54bf604020117800c3aa392a8d536acc268b9dab8e37246dd4e7c8ea6872"} Jul 02 15:34:17.421186 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.421169 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" event={"ID":"9a9a14d6-8567-4c38-b21b-93f18441adbe","Type":"ContainerStarted","Data":"dfa4683562228bca12580c19facc40c0da3260efb684af4887621676412e65bc"} Jul 02 15:34:17.434452 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:17.434427 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56356e9_dff6_4718_aa37_8493a209112a.slice/crio-a0fd249c9aa2bf0e7e70d705c2d94a88130459411b7bd15bf59a69aae38b6b74 WatchSource:0}: Error finding container a0fd249c9aa2bf0e7e70d705c2d94a88130459411b7bd15bf59a69aae38b6b74: Status 404 returned error can't find the container with id a0fd249c9aa2bf0e7e70d705c2d94a88130459411b7bd15bf59a69aae38b6b74 Jul 02 15:34:17.473269 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.473244 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.473392 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.473302 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4hxh\" (UniqueName: \"kubernetes.io/projected/8d7b952b-9980-4dcb-99f5-5928d89d4948-kube-api-access-b4hxh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.473392 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.473327 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.473681 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.473634 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.473781 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.473715 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.481730 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.481700 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4hxh\" (UniqueName: \"kubernetes.io/projected/8d7b952b-9980-4dcb-99f5-5928d89d4948-kube-api-access-b4hxh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.564091 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.564053 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:17.692697 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:17.692671 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp"] Jul 02 15:34:17.696202 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:17.696173 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7b952b_9980_4dcb_99f5_5928d89d4948.slice/crio-6fcaeaaa60d44800ecd84aad6f2b187a3361146c6e53bf7f15fbc053f1f2121a WatchSource:0}: Error finding container 6fcaeaaa60d44800ecd84aad6f2b187a3361146c6e53bf7f15fbc053f1f2121a: Status 404 returned error can't find the container with id 6fcaeaaa60d44800ecd84aad6f2b187a3361146c6e53bf7f15fbc053f1f2121a Jul 02 15:34:18.437159 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.437130 2549 generic.go:356] "Generic (PLEG): container finished" podID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerID="ed8132f4eea7683c48429d5e9cbdc390bff1f4e47039e9545f0efaa75364b8d4" exitCode=0 Jul 02 15:34:18.437530 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.437212 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" event={"ID":"8d7b952b-9980-4dcb-99f5-5928d89d4948","Type":"ContainerDied","Data":"ed8132f4eea7683c48429d5e9cbdc390bff1f4e47039e9545f0efaa75364b8d4"} Jul 02 15:34:18.437530 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.437301 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" event={"ID":"8d7b952b-9980-4dcb-99f5-5928d89d4948","Type":"ContainerStarted","Data":"6fcaeaaa60d44800ecd84aad6f2b187a3361146c6e53bf7f15fbc053f1f2121a"} Jul 02 15:34:18.439634 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.439611 2549 generic.go:356] "Generic (PLEG): container finished" podID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerID="020be6deebf74508ee60757b2bc13f75f22d63a1dc3844b61e328fd514b17ecf" exitCode=0 Jul 02 15:34:18.439790 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.439690 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" event={"ID":"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae","Type":"ContainerDied","Data":"020be6deebf74508ee60757b2bc13f75f22d63a1dc3844b61e328fd514b17ecf"} Jul 02 15:34:18.443132 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.443111 2549 generic.go:356] "Generic (PLEG): container finished" podID="b56356e9-dff6-4718-aa37-8493a209112a" containerID="109ae484ac8c285f7083622134e28a5f66fb6b5eb125c2faed6fc6ce495c3691" exitCode=0 Jul 02 15:34:18.443219 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.443168 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" event={"ID":"b56356e9-dff6-4718-aa37-8493a209112a","Type":"ContainerDied","Data":"109ae484ac8c285f7083622134e28a5f66fb6b5eb125c2faed6fc6ce495c3691"} Jul 02 15:34:18.443219 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:18.443203 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" event={"ID":"b56356e9-dff6-4718-aa37-8493a209112a","Type":"ContainerStarted","Data":"a0fd249c9aa2bf0e7e70d705c2d94a88130459411b7bd15bf59a69aae38b6b74"} Jul 02 15:34:19.450978 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.450887 2549 generic.go:356] "Generic (PLEG): container finished" podID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerID="410a9fec5d715386da84db9743f50ba2f46006dfb9ba4c44da13838c43ab9d57" exitCode=0 Jul 02 15:34:19.450978 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.450967 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" event={"ID":"8d7b952b-9980-4dcb-99f5-5928d89d4948","Type":"ContainerDied","Data":"410a9fec5d715386da84db9743f50ba2f46006dfb9ba4c44da13838c43ab9d57"} Jul 02 15:34:19.452934 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.452915 2549 generic.go:356] "Generic (PLEG): container finished" podID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerID="955a710b4025553d9f030dd2c561332744c3133d6007d46ed1798e595e38c9b2" exitCode=0 Jul 02 15:34:19.453054 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.452997 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" event={"ID":"9a9a14d6-8567-4c38-b21b-93f18441adbe","Type":"ContainerDied","Data":"955a710b4025553d9f030dd2c561332744c3133d6007d46ed1798e595e38c9b2"} Jul 02 15:34:19.598834 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.598807 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:19.693065 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.693039 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-bundle\") pod \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " Jul 02 15:34:19.693065 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.693071 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nnzs\" (UniqueName: \"kubernetes.io/projected/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-kube-api-access-9nnzs\") pod \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " Jul 02 15:34:19.693245 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.693218 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-util\") pod \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\" (UID: \"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae\") " Jul 02 15:34:19.693515 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.693493 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-bundle" (OuterVolumeSpecName: "bundle") pod "36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" (UID: "36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:19.695061 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.695041 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-kube-api-access-9nnzs" (OuterVolumeSpecName: "kube-api-access-9nnzs") pod "36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" (UID: "36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae"). InnerVolumeSpecName "kube-api-access-9nnzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:34:19.698694 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.698671 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-util" (OuterVolumeSpecName: "util") pod "36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" (UID: "36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:19.794749 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.794712 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:19.794749 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.794745 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:19.794749 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:19.794755 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nnzs\" (UniqueName: \"kubernetes.io/projected/36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae-kube-api-access-9nnzs\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:20.460247 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.460160 2549 generic.go:356] "Generic (PLEG): container finished" podID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerID="f95a9ede93c653236c1a49419b12f22e63e405baf5ffe7d1e835886c1e86613a" exitCode=0 Jul 02 15:34:20.460247 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.460221 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" event={"ID":"8d7b952b-9980-4dcb-99f5-5928d89d4948","Type":"ContainerDied","Data":"f95a9ede93c653236c1a49419b12f22e63e405baf5ffe7d1e835886c1e86613a"} Jul 02 15:34:20.462250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.462227 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" Jul 02 15:34:20.462250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.462235 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w" event={"ID":"36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae","Type":"ContainerDied","Data":"97d6767c3a45a4fafc4c689fe95f52a59742c5ab9f208501abf63cfd800e1efb"} Jul 02 15:34:20.462461 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.462277 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97d6767c3a45a4fafc4c689fe95f52a59742c5ab9f208501abf63cfd800e1efb" Jul 02 15:34:20.464473 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.464450 2549 generic.go:356] "Generic (PLEG): container finished" podID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerID="c12257ff68cda2f30b83d63251dc901d70af07d545090c0fe94fec74615fede6" exitCode=0 Jul 02 15:34:20.464627 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.464527 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" event={"ID":"9a9a14d6-8567-4c38-b21b-93f18441adbe","Type":"ContainerDied","Data":"c12257ff68cda2f30b83d63251dc901d70af07d545090c0fe94fec74615fede6"} Jul 02 15:34:20.466215 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.466194 2549 generic.go:356] "Generic (PLEG): container finished" podID="b56356e9-dff6-4718-aa37-8493a209112a" containerID="d83622f8e1409c2d365d01d48a8b081c2dfea0436266afe6788b9d3aa89d2e6e" exitCode=0 Jul 02 15:34:20.466346 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:20.466222 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" event={"ID":"b56356e9-dff6-4718-aa37-8493a209112a","Type":"ContainerDied","Data":"d83622f8e1409c2d365d01d48a8b081c2dfea0436266afe6788b9d3aa89d2e6e"} Jul 02 15:34:21.473795 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.473760 2549 generic.go:356] "Generic (PLEG): container finished" podID="b56356e9-dff6-4718-aa37-8493a209112a" containerID="bb96e638f964ce6ee1bf2aa5933cc0ad5f8606443e096dfbb0885483ac55c849" exitCode=0 Jul 02 15:34:21.474158 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.473842 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" event={"ID":"b56356e9-dff6-4718-aa37-8493a209112a","Type":"ContainerDied","Data":"bb96e638f964ce6ee1bf2aa5933cc0ad5f8606443e096dfbb0885483ac55c849"} Jul 02 15:34:21.630846 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.630819 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:21.633579 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.633561 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:21.815384 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.815351 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-util\") pod \"9a9a14d6-8567-4c38-b21b-93f18441adbe\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " Jul 02 15:34:21.815555 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.815447 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-util\") pod \"8d7b952b-9980-4dcb-99f5-5928d89d4948\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " Jul 02 15:34:21.815555 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.815494 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4hxh\" (UniqueName: \"kubernetes.io/projected/8d7b952b-9980-4dcb-99f5-5928d89d4948-kube-api-access-b4hxh\") pod \"8d7b952b-9980-4dcb-99f5-5928d89d4948\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " Jul 02 15:34:21.815555 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.815521 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-bundle\") pod \"9a9a14d6-8567-4c38-b21b-93f18441adbe\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " Jul 02 15:34:21.815555 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.815550 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-bundle\") pod \"8d7b952b-9980-4dcb-99f5-5928d89d4948\" (UID: \"8d7b952b-9980-4dcb-99f5-5928d89d4948\") " Jul 02 15:34:21.815781 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.815582 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv7xk\" (UniqueName: \"kubernetes.io/projected/9a9a14d6-8567-4c38-b21b-93f18441adbe-kube-api-access-nv7xk\") pod \"9a9a14d6-8567-4c38-b21b-93f18441adbe\" (UID: \"9a9a14d6-8567-4c38-b21b-93f18441adbe\") " Jul 02 15:34:21.816191 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.816160 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-bundle" (OuterVolumeSpecName: "bundle") pod "8d7b952b-9980-4dcb-99f5-5928d89d4948" (UID: "8d7b952b-9980-4dcb-99f5-5928d89d4948"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:21.816323 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.816266 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-bundle" (OuterVolumeSpecName: "bundle") pod "9a9a14d6-8567-4c38-b21b-93f18441adbe" (UID: "9a9a14d6-8567-4c38-b21b-93f18441adbe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:21.817772 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.817734 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7b952b-9980-4dcb-99f5-5928d89d4948-kube-api-access-b4hxh" (OuterVolumeSpecName: "kube-api-access-b4hxh") pod "8d7b952b-9980-4dcb-99f5-5928d89d4948" (UID: "8d7b952b-9980-4dcb-99f5-5928d89d4948"). InnerVolumeSpecName "kube-api-access-b4hxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:34:21.818100 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.818074 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9a14d6-8567-4c38-b21b-93f18441adbe-kube-api-access-nv7xk" (OuterVolumeSpecName: "kube-api-access-nv7xk") pod "9a9a14d6-8567-4c38-b21b-93f18441adbe" (UID: "9a9a14d6-8567-4c38-b21b-93f18441adbe"). InnerVolumeSpecName "kube-api-access-nv7xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:34:21.821326 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.821288 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-util" (OuterVolumeSpecName: "util") pod "9a9a14d6-8567-4c38-b21b-93f18441adbe" (UID: "9a9a14d6-8567-4c38-b21b-93f18441adbe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:21.822067 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.822048 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-util" (OuterVolumeSpecName: "util") pod "8d7b952b-9980-4dcb-99f5-5928d89d4948" (UID: "8d7b952b-9980-4dcb-99f5-5928d89d4948"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:21.916295 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.916260 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:21.916295 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.916294 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4hxh\" (UniqueName: \"kubernetes.io/projected/8d7b952b-9980-4dcb-99f5-5928d89d4948-kube-api-access-b4hxh\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:21.916524 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.916310 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:21.916524 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.916328 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d7b952b-9980-4dcb-99f5-5928d89d4948-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:21.916524 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.916340 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv7xk\" (UniqueName: \"kubernetes.io/projected/9a9a14d6-8567-4c38-b21b-93f18441adbe-kube-api-access-nv7xk\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:21.916524 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:21.916350 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9a14d6-8567-4c38-b21b-93f18441adbe-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:22.480130 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.480103 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" Jul 02 15:34:22.480568 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.480138 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp" event={"ID":"8d7b952b-9980-4dcb-99f5-5928d89d4948","Type":"ContainerDied","Data":"6fcaeaaa60d44800ecd84aad6f2b187a3361146c6e53bf7f15fbc053f1f2121a"} Jul 02 15:34:22.480568 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.480190 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fcaeaaa60d44800ecd84aad6f2b187a3361146c6e53bf7f15fbc053f1f2121a" Jul 02 15:34:22.482214 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.482196 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" Jul 02 15:34:22.482214 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.482194 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22" event={"ID":"9a9a14d6-8567-4c38-b21b-93f18441adbe","Type":"ContainerDied","Data":"dfa4683562228bca12580c19facc40c0da3260efb684af4887621676412e65bc"} Jul 02 15:34:22.482364 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.482240 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfa4683562228bca12580c19facc40c0da3260efb684af4887621676412e65bc" Jul 02 15:34:22.609066 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.609041 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:22.622893 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.622868 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-bundle\") pod \"b56356e9-dff6-4718-aa37-8493a209112a\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " Jul 02 15:34:22.623038 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.622902 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-util\") pod \"b56356e9-dff6-4718-aa37-8493a209112a\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " Jul 02 15:34:22.623038 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.622957 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2h9v\" (UniqueName: \"kubernetes.io/projected/b56356e9-dff6-4718-aa37-8493a209112a-kube-api-access-q2h9v\") pod \"b56356e9-dff6-4718-aa37-8493a209112a\" (UID: \"b56356e9-dff6-4718-aa37-8493a209112a\") " Jul 02 15:34:22.623381 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.623358 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-bundle" (OuterVolumeSpecName: "bundle") pod "b56356e9-dff6-4718-aa37-8493a209112a" (UID: "b56356e9-dff6-4718-aa37-8493a209112a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:22.625088 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.625066 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56356e9-dff6-4718-aa37-8493a209112a-kube-api-access-q2h9v" (OuterVolumeSpecName: "kube-api-access-q2h9v") pod "b56356e9-dff6-4718-aa37-8493a209112a" (UID: "b56356e9-dff6-4718-aa37-8493a209112a"). InnerVolumeSpecName "kube-api-access-q2h9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:34:22.628241 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.628219 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-util" (OuterVolumeSpecName: "util") pod "b56356e9-dff6-4718-aa37-8493a209112a" (UID: "b56356e9-dff6-4718-aa37-8493a209112a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:34:22.724063 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.724026 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:22.724063 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.724054 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56356e9-dff6-4718-aa37-8493a209112a-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:22.724063 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:22.724063 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2h9v\" (UniqueName: \"kubernetes.io/projected/b56356e9-dff6-4718-aa37-8493a209112a-kube-api-access-q2h9v\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:34:23.489235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:23.489201 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" Jul 02 15:34:23.489235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:23.489226 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm" event={"ID":"b56356e9-dff6-4718-aa37-8493a209112a","Type":"ContainerDied","Data":"a0fd249c9aa2bf0e7e70d705c2d94a88130459411b7bd15bf59a69aae38b6b74"} Jul 02 15:34:23.489636 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:23.489311 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0fd249c9aa2bf0e7e70d705c2d94a88130459411b7bd15bf59a69aae38b6b74" Jul 02 15:34:31.859874 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.859834 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld"] Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860192 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerName="extract" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860205 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerName="extract" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860220 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerName="extract" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860225 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerName="extract" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860234 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56356e9-dff6-4718-aa37-8493a209112a" containerName="util" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860242 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56356e9-dff6-4718-aa37-8493a209112a" containerName="util" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860250 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerName="pull" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860256 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerName="pull" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860262 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerName="extract" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860267 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerName="extract" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860277 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerName="util" Jul 02 15:34:31.860276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860282 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerName="util" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860293 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerName="util" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860298 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerName="util" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860304 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerName="pull" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860309 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerName="pull" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860318 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerName="util" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860328 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerName="util" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860334 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerName="pull" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860339 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerName="pull" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860346 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56356e9-dff6-4718-aa37-8493a209112a" containerName="pull" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860351 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56356e9-dff6-4718-aa37-8493a209112a" containerName="pull" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860357 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56356e9-dff6-4718-aa37-8493a209112a" containerName="extract" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860362 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56356e9-dff6-4718-aa37-8493a209112a" containerName="extract" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860423 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae" containerName="extract" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860430 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b56356e9-dff6-4718-aa37-8493a209112a" containerName="extract" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860436 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9a14d6-8567-4c38-b21b-93f18441adbe" containerName="extract" Jul 02 15:34:31.860622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.860442 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d7b952b-9980-4dcb-99f5-5928d89d4948" containerName="extract" Jul 02 15:34:31.864694 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.864634 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" Jul 02 15:34:31.867012 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.866992 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tzdjh\"" Jul 02 15:34:31.867128 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.867116 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 15:34:31.875589 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.875562 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld"] Jul 02 15:34:31.897898 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.897863 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2q2n\" (UniqueName: \"kubernetes.io/projected/e7cff717-c651-4b1e-a69b-420f38af16d0-kube-api-access-s2q2n\") pod \"dns-operator-controller-manager-864dd78c4c-7r8ld\" (UID: \"e7cff717-c651-4b1e-a69b-420f38af16d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" Jul 02 15:34:31.998797 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:31.998767 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2q2n\" (UniqueName: \"kubernetes.io/projected/e7cff717-c651-4b1e-a69b-420f38af16d0-kube-api-access-s2q2n\") pod \"dns-operator-controller-manager-864dd78c4c-7r8ld\" (UID: \"e7cff717-c651-4b1e-a69b-420f38af16d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" Jul 02 15:34:32.007138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:32.007108 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2q2n\" (UniqueName: \"kubernetes.io/projected/e7cff717-c651-4b1e-a69b-420f38af16d0-kube-api-access-s2q2n\") pod \"dns-operator-controller-manager-864dd78c4c-7r8ld\" (UID: \"e7cff717-c651-4b1e-a69b-420f38af16d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" Jul 02 15:34:32.176929 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:32.176839 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" Jul 02 15:34:32.317630 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:32.317606 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld"] Jul 02 15:34:32.319474 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:32.319448 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cff717_c651_4b1e_a69b_420f38af16d0.slice/crio-a39c6e6d8d3e03002a5d863206df84787dc1cd630119456d7b7e592f991fbe68 WatchSource:0}: Error finding container a39c6e6d8d3e03002a5d863206df84787dc1cd630119456d7b7e592f991fbe68: Status 404 returned error can't find the container with id a39c6e6d8d3e03002a5d863206df84787dc1cd630119456d7b7e592f991fbe68 Jul 02 15:34:32.538812 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:32.538774 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" event={"ID":"e7cff717-c651-4b1e-a69b-420f38af16d0","Type":"ContainerStarted","Data":"a39c6e6d8d3e03002a5d863206df84787dc1cd630119456d7b7e592f991fbe68"} Jul 02 15:34:35.264584 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.264549 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9"] Jul 02 15:34:35.268046 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.268029 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:34:35.270409 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.270389 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rzr2v\"" Jul 02 15:34:35.279622 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.279598 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9"] Jul 02 15:34:35.330035 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.329943 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/f03f6917-1a2c-441a-abcd-38b57eae4d81-kube-api-access-8lnbn\") pod \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" (UID: \"f03f6917-1a2c-441a-abcd-38b57eae4d81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:34:35.430543 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.430507 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/f03f6917-1a2c-441a-abcd-38b57eae4d81-kube-api-access-8lnbn\") pod \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" (UID: \"f03f6917-1a2c-441a-abcd-38b57eae4d81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:34:35.456605 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.456573 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/f03f6917-1a2c-441a-abcd-38b57eae4d81-kube-api-access-8lnbn\") pod \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" (UID: \"f03f6917-1a2c-441a-abcd-38b57eae4d81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:34:35.554737 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.554701 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" event={"ID":"e7cff717-c651-4b1e-a69b-420f38af16d0","Type":"ContainerStarted","Data":"2696aa5fab6626c6d940ff781fdd197a41cf83928d125446862b7067c50656db"} Jul 02 15:34:35.554929 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.554814 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" Jul 02 15:34:35.576796 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.576751 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" podStartSLOduration=1.818559956 podStartE2EDuration="4.576736724s" totalImagesPullingTime="2.758176768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:35.57478609 +0000 UTC m=+429.439642287" watchObservedRunningTime="2026-07-02 15:34:35.576736724 +0000 UTC m=+429.441592921" Jul 02 15:34:35.578903 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.578885 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:34:35.735602 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:35.735577 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9"] Jul 02 15:34:35.737285 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:35.737251 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03f6917_1a2c_441a_abcd_38b57eae4d81.slice/crio-48947286c6e9f6556f059f40c628f8ec04cdaf1aadfb151404779937c911b04f WatchSource:0}: Error finding container 48947286c6e9f6556f059f40c628f8ec04cdaf1aadfb151404779937c911b04f: Status 404 returned error can't find the container with id 48947286c6e9f6556f059f40c628f8ec04cdaf1aadfb151404779937c911b04f Jul 02 15:34:36.562010 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:36.561977 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" event={"ID":"f03f6917-1a2c-441a-abcd-38b57eae4d81","Type":"ContainerStarted","Data":"48947286c6e9f6556f059f40c628f8ec04cdaf1aadfb151404779937c911b04f"} Jul 02 15:34:38.579238 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:38.579206 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" event={"ID":"f03f6917-1a2c-441a-abcd-38b57eae4d81","Type":"ContainerStarted","Data":"7a1b9f3637dd4e4856e5f5390fec0f21c33317d8fc729022d71fd77b7829dbcc"} Jul 02 15:34:38.579637 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:38.579260 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:34:38.595555 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:38.595506 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" podStartSLOduration=1.639513016 podStartE2EDuration="3.595488485s" totalImagesPullingTime="1.955975469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:38.593237691 +0000 UTC m=+432.458093888" watchObservedRunningTime="2026-07-02 15:34:38.595488485 +0000 UTC m=+432.460344682" Jul 02 15:34:40.479716 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.479680 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96"] Jul 02 15:34:40.484081 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.484046 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.489139 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.489116 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z42px\"" Jul 02 15:34:40.503554 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.503523 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96"] Jul 02 15:34:40.586012 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.585983 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnqmm\" (UniqueName: \"kubernetes.io/projected/d648c9f0-91e2-4274-8ed2-939c82c89075-kube-api-access-cnqmm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.586012 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.586016 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d648c9f0-91e2-4274-8ed2-939c82c89075-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.687442 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.687393 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnqmm\" (UniqueName: \"kubernetes.io/projected/d648c9f0-91e2-4274-8ed2-939c82c89075-kube-api-access-cnqmm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.687442 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.687446 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d648c9f0-91e2-4274-8ed2-939c82c89075-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.687838 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.687819 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d648c9f0-91e2-4274-8ed2-939c82c89075-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.698725 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.698694 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnqmm\" (UniqueName: \"kubernetes.io/projected/d648c9f0-91e2-4274-8ed2-939c82c89075-kube-api-access-cnqmm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.794588 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.794556 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:40.950610 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:34:40.950583 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd648c9f0_91e2_4274_8ed2_939c82c89075.slice/crio-412567fef55b445ef128f1bead741f6972de3dca9251e7fe1012ca5757f0a9de WatchSource:0}: Error finding container 412567fef55b445ef128f1bead741f6972de3dca9251e7fe1012ca5757f0a9de: Status 404 returned error can't find the container with id 412567fef55b445ef128f1bead741f6972de3dca9251e7fe1012ca5757f0a9de Jul 02 15:34:40.952520 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:40.952494 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96"] Jul 02 15:34:41.591092 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:41.591059 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" event={"ID":"d648c9f0-91e2-4274-8ed2-939c82c89075","Type":"ContainerStarted","Data":"412567fef55b445ef128f1bead741f6972de3dca9251e7fe1012ca5757f0a9de"} Jul 02 15:34:46.564921 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:46.564884 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7r8ld" Jul 02 15:34:48.637898 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:48.637859 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" event={"ID":"d648c9f0-91e2-4274-8ed2-939c82c89075","Type":"ContainerStarted","Data":"e64c2b3c9d254d324eb78f45eb33199de2defbc095b1a123c67daaf3eb8f5069"} Jul 02 15:34:48.638351 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:48.638003 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:34:48.659399 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:48.658801 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" podStartSLOduration=1.185753 podStartE2EDuration="8.658781665s" totalImagesPullingTime="7.473028665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:48.656731435 +0000 UTC m=+442.521587632" watchObservedRunningTime="2026-07-02 15:34:48.658781665 +0000 UTC m=+442.523637864" Jul 02 15:34:49.583122 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:49.583088 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:34:59.645803 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:34:59.645771 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.456053 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.456018 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96"] Jul 02 15:35:01.456442 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.456238 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" containerName="manager" containerID="cri-o://e64c2b3c9d254d324eb78f45eb33199de2defbc095b1a123c67daaf3eb8f5069" gracePeriod=2 Jul 02 15:35:01.476159 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.476132 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96"] Jul 02 15:35:01.505442 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.505407 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9"] Jul 02 15:35:01.505638 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.505601 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" containerName="manager" containerID="cri-o://7a1b9f3637dd4e4856e5f5390fec0f21c33317d8fc729022d71fd77b7829dbcc" gracePeriod=2 Jul 02 15:35:01.509540 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.509505 2549 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d648c9f0-91e2-4274-8ed2-939c82c89075\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-jvn96\": pods \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.511898 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.511860 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.516634 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.516612 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt"] Jul 02 15:35:01.516977 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.516964 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" containerName="manager" Jul 02 15:35:01.517019 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.516979 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" containerName="manager" Jul 02 15:35:01.517053 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.517045 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" containerName="manager" Jul 02 15:35:01.518943 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.518927 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.535903 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.535879 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9"] Jul 02 15:35:01.547978 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.547946 2549 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f03f6917-1a2c-441a-abcd-38b57eae4d81\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-2w2c9\": pods \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:35:01.566664 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.566614 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp"] Jul 02 15:35:01.567479 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.567454 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" containerName="manager" Jul 02 15:35:01.567479 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.567481 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" containerName="manager" Jul 02 15:35:01.567675 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.567574 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" containerName="manager" Jul 02 15:35:01.570030 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.570013 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" Jul 02 15:35:01.570134 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.570112 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt"] Jul 02 15:35:01.590203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.590172 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp"] Jul 02 15:35:01.617506 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.617465 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.619496 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.619449 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:35:01.621566 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.621535 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:35:01.659377 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.658170 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.678737 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.678621 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w29pq\" (UniqueName: \"kubernetes.io/projected/91e9a41c-2535-4f94-bda9-696bdd64edf5-kube-api-access-w29pq\") pod \"limitador-operator-controller-manager-859d7b78bd-zxrgp\" (UID: \"91e9a41c-2535-4f94-bda9-696bdd64edf5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" Jul 02 15:35:01.678737 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.678710 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg7qg\" (UniqueName: \"kubernetes.io/projected/9d1915c4-6f04-46c4-b640-8b38ae82008d-kube-api-access-hg7qg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq2dt\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.678976 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.678840 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d1915c4-6f04-46c4-b640-8b38ae82008d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq2dt\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.709135 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.709055 2549 generic.go:356] "Generic (PLEG): container finished" podID="d648c9f0-91e2-4274-8ed2-939c82c89075" containerID="e64c2b3c9d254d324eb78f45eb33199de2defbc095b1a123c67daaf3eb8f5069" exitCode=0 Jul 02 15:35:01.710962 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.710938 2549 generic.go:356] "Generic (PLEG): container finished" podID="f03f6917-1a2c-441a-abcd-38b57eae4d81" containerID="7a1b9f3637dd4e4856e5f5390fec0f21c33317d8fc729022d71fd77b7829dbcc" exitCode=0 Jul 02 15:35:01.756569 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.756545 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.760236 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.760214 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:35:01.766903 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.766872 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.770832 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.770809 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:35:01.775445 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.775422 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvn96\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:01.777260 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:01.777235 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2w2c9\" is forbidden: User \"system:node:ip-10-0-129-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-25.ec2.internal' and this object" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:35:01.779683 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.779635 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d1915c4-6f04-46c4-b640-8b38ae82008d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq2dt\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.779777 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.779720 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w29pq\" (UniqueName: \"kubernetes.io/projected/91e9a41c-2535-4f94-bda9-696bdd64edf5-kube-api-access-w29pq\") pod \"limitador-operator-controller-manager-859d7b78bd-zxrgp\" (UID: \"91e9a41c-2535-4f94-bda9-696bdd64edf5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" Jul 02 15:35:01.779777 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.779743 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg7qg\" (UniqueName: \"kubernetes.io/projected/9d1915c4-6f04-46c4-b640-8b38ae82008d-kube-api-access-hg7qg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq2dt\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.780024 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.780004 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d1915c4-6f04-46c4-b640-8b38ae82008d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq2dt\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.798870 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.798837 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg7qg\" (UniqueName: \"kubernetes.io/projected/9d1915c4-6f04-46c4-b640-8b38ae82008d-kube-api-access-hg7qg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq2dt\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.799071 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.799050 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w29pq\" (UniqueName: \"kubernetes.io/projected/91e9a41c-2535-4f94-bda9-696bdd64edf5-kube-api-access-w29pq\") pod \"limitador-operator-controller-manager-859d7b78bd-zxrgp\" (UID: \"91e9a41c-2535-4f94-bda9-696bdd64edf5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" Jul 02 15:35:01.888871 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.888828 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:01.889074 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.888850 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/f03f6917-1a2c-441a-abcd-38b57eae4d81-kube-api-access-8lnbn\") pod \"f03f6917-1a2c-441a-abcd-38b57eae4d81\" (UID: \"f03f6917-1a2c-441a-abcd-38b57eae4d81\") " Jul 02 15:35:01.889074 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.889005 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnqmm\" (UniqueName: \"kubernetes.io/projected/d648c9f0-91e2-4274-8ed2-939c82c89075-kube-api-access-cnqmm\") pod \"d648c9f0-91e2-4274-8ed2-939c82c89075\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " Jul 02 15:35:01.889185 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.889092 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d648c9f0-91e2-4274-8ed2-939c82c89075-extensions-socket-volume\") pod \"d648c9f0-91e2-4274-8ed2-939c82c89075\" (UID: \"d648c9f0-91e2-4274-8ed2-939c82c89075\") " Jul 02 15:35:01.889845 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.889810 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d648c9f0-91e2-4274-8ed2-939c82c89075-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d648c9f0-91e2-4274-8ed2-939c82c89075" (UID: "d648c9f0-91e2-4274-8ed2-939c82c89075"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:35:01.890359 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.890204 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" Jul 02 15:35:01.891405 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.891335 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03f6917-1a2c-441a-abcd-38b57eae4d81-kube-api-access-8lnbn" (OuterVolumeSpecName: "kube-api-access-8lnbn") pod "f03f6917-1a2c-441a-abcd-38b57eae4d81" (UID: "f03f6917-1a2c-441a-abcd-38b57eae4d81"). InnerVolumeSpecName "kube-api-access-8lnbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:01.891490 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.891429 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d648c9f0-91e2-4274-8ed2-939c82c89075-kube-api-access-cnqmm" (OuterVolumeSpecName: "kube-api-access-cnqmm") pod "d648c9f0-91e2-4274-8ed2-939c82c89075" (UID: "d648c9f0-91e2-4274-8ed2-939c82c89075"). InnerVolumeSpecName "kube-api-access-cnqmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:01.990233 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.990160 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d648c9f0-91e2-4274-8ed2-939c82c89075-extensions-socket-volume\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:35:01.990233 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.990193 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/f03f6917-1a2c-441a-abcd-38b57eae4d81-kube-api-access-8lnbn\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:35:01.990233 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:01.990209 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnqmm\" (UniqueName: \"kubernetes.io/projected/d648c9f0-91e2-4274-8ed2-939c82c89075-kube-api-access-cnqmm\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:35:02.075145 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.075119 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt"] Jul 02 15:35:02.077459 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:35:02.077435 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1915c4_6f04_46c4_b640_8b38ae82008d.slice/crio-15bb973a5625bf43ba6641c2f752e080b3518d4ac8bdb15c078e366023335716 WatchSource:0}: Error finding container 15bb973a5625bf43ba6641c2f752e080b3518d4ac8bdb15c078e366023335716: Status 404 returned error can't find the container with id 15bb973a5625bf43ba6641c2f752e080b3518d4ac8bdb15c078e366023335716 Jul 02 15:35:02.092288 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:35:02.092264 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e9a41c_2535_4f94_bda9_696bdd64edf5.slice/crio-a4f3288fd1bfb3bdd419a1139f9616e81c74258c3b8475d088580aabed033f1e WatchSource:0}: Error finding container a4f3288fd1bfb3bdd419a1139f9616e81c74258c3b8475d088580aabed033f1e: Status 404 returned error can't find the container with id a4f3288fd1bfb3bdd419a1139f9616e81c74258c3b8475d088580aabed033f1e Jul 02 15:35:02.094747 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.094727 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp"] Jul 02 15:35:02.579208 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.579166 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d648c9f0-91e2-4274-8ed2-939c82c89075" path="/var/lib/kubelet/pods/d648c9f0-91e2-4274-8ed2-939c82c89075/volumes" Jul 02 15:35:02.579727 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.579483 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03f6917-1a2c-441a-abcd-38b57eae4d81" path="/var/lib/kubelet/pods/f03f6917-1a2c-441a-abcd-38b57eae4d81/volumes" Jul 02 15:35:02.717392 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.717368 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2w2c9" Jul 02 15:35:02.717600 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.717407 2549 scope.go:117] "RemoveContainer" containerID="7a1b9f3637dd4e4856e5f5390fec0f21c33317d8fc729022d71fd77b7829dbcc" Jul 02 15:35:02.718987 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.718954 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvn96" Jul 02 15:35:02.721091 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.721024 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" event={"ID":"9d1915c4-6f04-46c4-b640-8b38ae82008d","Type":"ContainerStarted","Data":"372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4"} Jul 02 15:35:02.721215 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.721123 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" event={"ID":"9d1915c4-6f04-46c4-b640-8b38ae82008d","Type":"ContainerStarted","Data":"15bb973a5625bf43ba6641c2f752e080b3518d4ac8bdb15c078e366023335716"} Jul 02 15:35:02.721215 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.721183 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:02.722802 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.722782 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" event={"ID":"91e9a41c-2535-4f94-bda9-696bdd64edf5","Type":"ContainerStarted","Data":"caa99959d671a9e35610dbf43cd0685dc4afa1122dba7d5fa4a36aed52f0c261"} Jul 02 15:35:02.722889 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.722814 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" event={"ID":"91e9a41c-2535-4f94-bda9-696bdd64edf5","Type":"ContainerStarted","Data":"a4f3288fd1bfb3bdd419a1139f9616e81c74258c3b8475d088580aabed033f1e"} Jul 02 15:35:02.722950 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.722896 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" Jul 02 15:35:02.726639 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.726622 2549 scope.go:117] "RemoveContainer" containerID="e64c2b3c9d254d324eb78f45eb33199de2defbc095b1a123c67daaf3eb8f5069" Jul 02 15:35:02.751969 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.751924 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" podStartSLOduration=1.751903459 podStartE2EDuration="1.751903459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:02.751125045 +0000 UTC m=+456.615981245" watchObservedRunningTime="2026-07-02 15:35:02.751903459 +0000 UTC m=+456.616759656" Jul 02 15:35:02.776637 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:02.776588 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" podStartSLOduration=1.776573016 podStartE2EDuration="1.776573016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:02.773040358 +0000 UTC m=+456.637896555" watchObservedRunningTime="2026-07-02 15:35:02.776573016 +0000 UTC m=+456.641429277" Jul 02 15:35:03.485876 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.485841 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb"] Jul 02 15:35:03.489365 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.489344 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.503545 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.503518 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57vh7\" (UniqueName: \"kubernetes.io/projected/6644a23c-575d-4c9b-ad44-d6a10a06c6e9-kube-api-access-57vh7\") pod \"kuadrant-operator-controller-manager-86878c769f-b92zb\" (UID: \"6644a23c-575d-4c9b-ad44-d6a10a06c6e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.503701 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.503574 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6644a23c-575d-4c9b-ad44-d6a10a06c6e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b92zb\" (UID: \"6644a23c-575d-4c9b-ad44-d6a10a06c6e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.511519 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.511492 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb"] Jul 02 15:35:03.604304 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.604268 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57vh7\" (UniqueName: \"kubernetes.io/projected/6644a23c-575d-4c9b-ad44-d6a10a06c6e9-kube-api-access-57vh7\") pod \"kuadrant-operator-controller-manager-86878c769f-b92zb\" (UID: \"6644a23c-575d-4c9b-ad44-d6a10a06c6e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.604722 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.604314 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6644a23c-575d-4c9b-ad44-d6a10a06c6e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b92zb\" (UID: \"6644a23c-575d-4c9b-ad44-d6a10a06c6e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.604779 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.604764 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6644a23c-575d-4c9b-ad44-d6a10a06c6e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b92zb\" (UID: \"6644a23c-575d-4c9b-ad44-d6a10a06c6e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.632738 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.632704 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57vh7\" (UniqueName: \"kubernetes.io/projected/6644a23c-575d-4c9b-ad44-d6a10a06c6e9-kube-api-access-57vh7\") pod \"kuadrant-operator-controller-manager-86878c769f-b92zb\" (UID: \"6644a23c-575d-4c9b-ad44-d6a10a06c6e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.799474 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.799443 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:03.939386 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:03.939355 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb"] Jul 02 15:35:03.942632 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:35:03.942605 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6644a23c_575d_4c9b_ad44_d6a10a06c6e9.slice/crio-81ff7dc892a4edb171e09b15830b2d6667c66c1d0021cd795f8ad1d72d527ddd WatchSource:0}: Error finding container 81ff7dc892a4edb171e09b15830b2d6667c66c1d0021cd795f8ad1d72d527ddd: Status 404 returned error can't find the container with id 81ff7dc892a4edb171e09b15830b2d6667c66c1d0021cd795f8ad1d72d527ddd Jul 02 15:35:04.737599 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:04.737560 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" event={"ID":"6644a23c-575d-4c9b-ad44-d6a10a06c6e9","Type":"ContainerStarted","Data":"553f7e466fd5c39047fb89f9e39af26758d9d1d46f934b54510af8c39a273b5f"} Jul 02 15:35:04.738049 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:04.737628 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" event={"ID":"6644a23c-575d-4c9b-ad44-d6a10a06c6e9","Type":"ContainerStarted","Data":"81ff7dc892a4edb171e09b15830b2d6667c66c1d0021cd795f8ad1d72d527ddd"} Jul 02 15:35:04.738049 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:04.737735 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:04.759158 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:04.759092 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" podStartSLOduration=1.759074167 podStartE2EDuration="1.759074167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:04.756515092 +0000 UTC m=+458.621371289" watchObservedRunningTime="2026-07-02 15:35:04.759074167 +0000 UTC m=+458.623930364" Jul 02 15:35:13.732952 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:13.732920 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:13.733417 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:13.732995 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zxrgp" Jul 02 15:35:15.745593 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:15.745560 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b92zb" Jul 02 15:35:15.800331 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:15.800300 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt"] Jul 02 15:35:15.800563 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:15.800538 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" podUID="9d1915c4-6f04-46c4-b640-8b38ae82008d" containerName="manager" containerID="cri-o://372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4" gracePeriod=10 Jul 02 15:35:16.052986 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.052959 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:16.110370 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.110337 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d1915c4-6f04-46c4-b640-8b38ae82008d-extensions-socket-volume\") pod \"9d1915c4-6f04-46c4-b640-8b38ae82008d\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " Jul 02 15:35:16.110546 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.110379 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg7qg\" (UniqueName: \"kubernetes.io/projected/9d1915c4-6f04-46c4-b640-8b38ae82008d-kube-api-access-hg7qg\") pod \"9d1915c4-6f04-46c4-b640-8b38ae82008d\" (UID: \"9d1915c4-6f04-46c4-b640-8b38ae82008d\") " Jul 02 15:35:16.110727 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.110704 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d1915c4-6f04-46c4-b640-8b38ae82008d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9d1915c4-6f04-46c4-b640-8b38ae82008d" (UID: "9d1915c4-6f04-46c4-b640-8b38ae82008d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:35:16.112420 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.112384 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d1915c4-6f04-46c4-b640-8b38ae82008d-kube-api-access-hg7qg" (OuterVolumeSpecName: "kube-api-access-hg7qg") pod "9d1915c4-6f04-46c4-b640-8b38ae82008d" (UID: "9d1915c4-6f04-46c4-b640-8b38ae82008d"). InnerVolumeSpecName "kube-api-access-hg7qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:16.211548 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.211512 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d1915c4-6f04-46c4-b640-8b38ae82008d-extensions-socket-volume\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:35:16.211548 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.211541 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg7qg\" (UniqueName: \"kubernetes.io/projected/9d1915c4-6f04-46c4-b640-8b38ae82008d-kube-api-access-hg7qg\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:35:16.807434 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.807399 2549 generic.go:356] "Generic (PLEG): container finished" podID="9d1915c4-6f04-46c4-b640-8b38ae82008d" containerID="372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4" exitCode=0 Jul 02 15:35:16.807899 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.807452 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" Jul 02 15:35:16.807899 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.807476 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" event={"ID":"9d1915c4-6f04-46c4-b640-8b38ae82008d","Type":"ContainerDied","Data":"372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4"} Jul 02 15:35:16.807899 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.807524 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt" event={"ID":"9d1915c4-6f04-46c4-b640-8b38ae82008d","Type":"ContainerDied","Data":"15bb973a5625bf43ba6641c2f752e080b3518d4ac8bdb15c078e366023335716"} Jul 02 15:35:16.807899 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.807547 2549 scope.go:117] "RemoveContainer" containerID="372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4" Jul 02 15:35:16.816501 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.816486 2549 scope.go:117] "RemoveContainer" containerID="372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4" Jul 02 15:35:16.816854 ip-10-0-129-25 kubenswrapper[2549]: E0702 15:35:16.816827 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4\": container with ID starting with 372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4 not found: ID does not exist" containerID="372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4" Jul 02 15:35:16.816945 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.816860 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4"} err="failed to get container status \"372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4\": rpc error: code = NotFound desc = could not find container \"372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4\": container with ID starting with 372ecb27b062f88b5921fecc541ac121ba90279d31ee4b235ddfe122c2b55bc4 not found: ID does not exist" Jul 02 15:35:16.825542 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.825518 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt"] Jul 02 15:35:16.829630 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:16.829608 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq2dt"] Jul 02 15:35:18.580302 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:18.580269 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d1915c4-6f04-46c4-b640-8b38ae82008d" path="/var/lib/kubelet/pods/9d1915c4-6f04-46c4-b640-8b38ae82008d/volumes" Jul 02 15:35:32.177847 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.177814 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q"] Jul 02 15:35:32.178347 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.178266 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d1915c4-6f04-46c4-b640-8b38ae82008d" containerName="manager" Jul 02 15:35:32.178347 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.178280 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d1915c4-6f04-46c4-b640-8b38ae82008d" containerName="manager" Jul 02 15:35:32.178458 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.178351 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d1915c4-6f04-46c4-b640-8b38ae82008d" containerName="manager" Jul 02 15:35:32.181305 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.181287 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.184734 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.184713 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r75kw\"" Jul 02 15:35:32.196080 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.196056 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q"] Jul 02 15:35:32.252334 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252298 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252358 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252393 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252534 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252423 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252699 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252541 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252699 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252578 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252699 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252595 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h64mc\" (UniqueName: \"kubernetes.io/projected/a6c83d10-0127-4149-b297-c9c4e0c00273-kube-api-access-h64mc\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252699 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252620 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.252699 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.252657 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6c83d10-0127-4149-b297-c9c4e0c00273-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354040 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354000 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354049 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354068 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h64mc\" (UniqueName: \"kubernetes.io/projected/a6c83d10-0127-4149-b297-c9c4e0c00273-kube-api-access-h64mc\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354095 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354111 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6c83d10-0127-4149-b297-c9c4e0c00273-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354134 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354180 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354216 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354604 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354262 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354604 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354463 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354604 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354572 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354748 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354672 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354748 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354700 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.354966 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.354943 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6c83d10-0127-4149-b297-c9c4e0c00273-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.356612 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.356584 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.356877 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.356861 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.361800 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.361779 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6c83d10-0127-4149-b297-c9c4e0c00273-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.362484 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.362463 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h64mc\" (UniqueName: \"kubernetes.io/projected/a6c83d10-0127-4149-b297-c9c4e0c00273-kube-api-access-h64mc\") pod \"maas-default-gateway-openshift-default-56654dcf7-9ds5q\" (UID: \"a6c83d10-0127-4149-b297-c9c4e0c00273\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.492302 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.492216 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:32.636209 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.636176 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q"] Jul 02 15:35:32.637159 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:35:32.637136 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c83d10_0127_4149_b297_c9c4e0c00273.slice/crio-060bc07bdbd3be99598d41be1ff40b9c61902c22efe59e49d178f8ff2314bdbd WatchSource:0}: Error finding container 060bc07bdbd3be99598d41be1ff40b9c61902c22efe59e49d178f8ff2314bdbd: Status 404 returned error can't find the container with id 060bc07bdbd3be99598d41be1ff40b9c61902c22efe59e49d178f8ff2314bdbd Jul 02 15:35:32.639184 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.639151 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:35:32.639258 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.639220 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:35:32.639258 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.639249 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 15:35:32.895562 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.895516 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" event={"ID":"a6c83d10-0127-4149-b297-c9c4e0c00273","Type":"ContainerStarted","Data":"cbdc2f2c288816710cfa79d7f84bc77985c5324f9395e56c6922d861530957b1"} Jul 02 15:35:32.895781 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.895618 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" event={"ID":"a6c83d10-0127-4149-b297-c9c4e0c00273","Type":"ContainerStarted","Data":"060bc07bdbd3be99598d41be1ff40b9c61902c22efe59e49d178f8ff2314bdbd"} Jul 02 15:35:32.914563 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:32.914518 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" podStartSLOduration=0.914503791 podStartE2EDuration="914.503791ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:32.913082954 +0000 UTC m=+486.777939144" watchObservedRunningTime="2026-07-02 15:35:32.914503791 +0000 UTC m=+486.779359987" Jul 02 15:35:33.492742 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:33.492707 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:33.497521 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:33.497497 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:33.900832 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:33.900801 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:33.901743 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:33.901725 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9ds5q" Jul 02 15:35:34.328253 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.328219 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l4zpj"] Jul 02 15:35:34.330867 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.330845 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.333185 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.333163 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8ld4d\"" Jul 02 15:35:34.333315 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.333197 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 15:35:34.339499 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.339477 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l4zpj"] Jul 02 15:35:34.372071 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.372041 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l4zpj"] Jul 02 15:35:34.473937 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.473905 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/abfd2b90-aeec-4c5e-9585-6d879d7eff9f-config-file\") pod \"limitador-limitador-54d6d988d5-l4zpj\" (UID: \"abfd2b90-aeec-4c5e-9585-6d879d7eff9f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.474107 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.473967 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcglq\" (UniqueName: \"kubernetes.io/projected/abfd2b90-aeec-4c5e-9585-6d879d7eff9f-kube-api-access-mcglq\") pod \"limitador-limitador-54d6d988d5-l4zpj\" (UID: \"abfd2b90-aeec-4c5e-9585-6d879d7eff9f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.574527 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.574490 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/abfd2b90-aeec-4c5e-9585-6d879d7eff9f-config-file\") pod \"limitador-limitador-54d6d988d5-l4zpj\" (UID: \"abfd2b90-aeec-4c5e-9585-6d879d7eff9f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.574914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.574546 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcglq\" (UniqueName: \"kubernetes.io/projected/abfd2b90-aeec-4c5e-9585-6d879d7eff9f-kube-api-access-mcglq\") pod \"limitador-limitador-54d6d988d5-l4zpj\" (UID: \"abfd2b90-aeec-4c5e-9585-6d879d7eff9f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.575106 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.575089 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/abfd2b90-aeec-4c5e-9585-6d879d7eff9f-config-file\") pod \"limitador-limitador-54d6d988d5-l4zpj\" (UID: \"abfd2b90-aeec-4c5e-9585-6d879d7eff9f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.582229 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.582168 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcglq\" (UniqueName: \"kubernetes.io/projected/abfd2b90-aeec-4c5e-9585-6d879d7eff9f-kube-api-access-mcglq\") pod \"limitador-limitador-54d6d988d5-l4zpj\" (UID: \"abfd2b90-aeec-4c5e-9585-6d879d7eff9f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.642317 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.642287 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:34.781773 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.781750 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l4zpj"] Jul 02 15:35:34.783841 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:35:34.783806 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfd2b90_aeec_4c5e_9585_6d879d7eff9f.slice/crio-1bf18b61a036dc4c7d78a1b5e282164f55727463a643b0280261ed80819bf191 WatchSource:0}: Error finding container 1bf18b61a036dc4c7d78a1b5e282164f55727463a643b0280261ed80819bf191: Status 404 returned error can't find the container with id 1bf18b61a036dc4c7d78a1b5e282164f55727463a643b0280261ed80819bf191 Jul 02 15:35:34.907298 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:34.907218 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" event={"ID":"abfd2b90-aeec-4c5e-9585-6d879d7eff9f","Type":"ContainerStarted","Data":"1bf18b61a036dc4c7d78a1b5e282164f55727463a643b0280261ed80819bf191"} Jul 02 15:35:37.926823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:37.926784 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" event={"ID":"abfd2b90-aeec-4c5e-9585-6d879d7eff9f","Type":"ContainerStarted","Data":"7c4d4aad8d1b66141fa1ca2dbd76bac78f158deca51aa259834532181f31970f"} Jul 02 15:35:37.927251 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:37.926921 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:35:37.944370 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:37.944319 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" podStartSLOduration=1.47515496 podStartE2EDuration="3.944303918s" totalImagesPullingTime="2.469148958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:37.942253234 +0000 UTC m=+491.807109431" watchObservedRunningTime="2026-07-02 15:35:37.944303918 +0000 UTC m=+491.809160115" Jul 02 15:35:48.933261 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:35:48.933227 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-l4zpj" Jul 02 15:36:04.018529 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.018492 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn"] Jul 02 15:36:04.021620 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.021602 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.024165 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.024143 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 15:36:04.024789 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.024768 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 15:36:04.024914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.024784 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gtdfj\"" Jul 02 15:36:04.036672 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.036633 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn"] Jul 02 15:36:04.126824 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.126788 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.127004 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.126850 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpqcz\" (UniqueName: \"kubernetes.io/projected/6a15333b-059c-47a3-8ace-bf778a40a4fc-kube-api-access-jpqcz\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.127004 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.126898 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.227784 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.227742 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpqcz\" (UniqueName: \"kubernetes.io/projected/6a15333b-059c-47a3-8ace-bf778a40a4fc-kube-api-access-jpqcz\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.227784 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.227786 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.228050 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.227843 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.228180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.228164 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.228229 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.228213 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.244156 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.244121 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpqcz\" (UniqueName: \"kubernetes.io/projected/6a15333b-059c-47a3-8ace-bf778a40a4fc-kube-api-access-jpqcz\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.331446 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.331363 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:04.474142 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:04.474109 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn"] Jul 02 15:36:04.476548 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:36:04.476518 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a15333b_059c_47a3_8ace_bf778a40a4fc.slice/crio-c5b12f0316b410ddb81175233b96bbffd0bbbbffdc77da30782ed5086131d2e0 WatchSource:0}: Error finding container c5b12f0316b410ddb81175233b96bbffd0bbbbffdc77da30782ed5086131d2e0: Status 404 returned error can't find the container with id c5b12f0316b410ddb81175233b96bbffd0bbbbffdc77da30782ed5086131d2e0 Jul 02 15:36:05.075045 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:05.075010 2549 generic.go:356] "Generic (PLEG): container finished" podID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerID="46b86be1ffe6b716e84ccdda0b78b6210c0801308ec7bfa2d79f1ec1a2cf0143" exitCode=0 Jul 02 15:36:05.075506 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:05.075107 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" event={"ID":"6a15333b-059c-47a3-8ace-bf778a40a4fc","Type":"ContainerDied","Data":"46b86be1ffe6b716e84ccdda0b78b6210c0801308ec7bfa2d79f1ec1a2cf0143"} Jul 02 15:36:05.075506 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:05.075160 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" event={"ID":"6a15333b-059c-47a3-8ace-bf778a40a4fc","Type":"ContainerStarted","Data":"c5b12f0316b410ddb81175233b96bbffd0bbbbffdc77da30782ed5086131d2e0"} Jul 02 15:36:06.082371 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:06.082336 2549 generic.go:356] "Generic (PLEG): container finished" podID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerID="3ada0e370d84e51a5289c8001b0384d59176449c5eb952cd5084a20b2622f500" exitCode=0 Jul 02 15:36:06.082784 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:06.082414 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" event={"ID":"6a15333b-059c-47a3-8ace-bf778a40a4fc","Type":"ContainerDied","Data":"3ada0e370d84e51a5289c8001b0384d59176449c5eb952cd5084a20b2622f500"} Jul 02 15:36:07.089439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:07.089407 2549 generic.go:356] "Generic (PLEG): container finished" podID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerID="7ea97a2b86a958240b9c22414524dfe0a9582d0573ee80484d26bb469fb7d35f" exitCode=0 Jul 02 15:36:07.089823 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:07.089454 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" event={"ID":"6a15333b-059c-47a3-8ace-bf778a40a4fc","Type":"ContainerDied","Data":"7ea97a2b86a958240b9c22414524dfe0a9582d0573ee80484d26bb469fb7d35f"} Jul 02 15:36:08.242465 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.242441 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:08.263322 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.263296 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpqcz\" (UniqueName: \"kubernetes.io/projected/6a15333b-059c-47a3-8ace-bf778a40a4fc-kube-api-access-jpqcz\") pod \"6a15333b-059c-47a3-8ace-bf778a40a4fc\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " Jul 02 15:36:08.263476 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.263333 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-util\") pod \"6a15333b-059c-47a3-8ace-bf778a40a4fc\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " Jul 02 15:36:08.263476 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.263359 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-bundle\") pod \"6a15333b-059c-47a3-8ace-bf778a40a4fc\" (UID: \"6a15333b-059c-47a3-8ace-bf778a40a4fc\") " Jul 02 15:36:08.263977 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.263936 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-bundle" (OuterVolumeSpecName: "bundle") pod "6a15333b-059c-47a3-8ace-bf778a40a4fc" (UID: "6a15333b-059c-47a3-8ace-bf778a40a4fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:36:08.265779 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.265750 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a15333b-059c-47a3-8ace-bf778a40a4fc-kube-api-access-jpqcz" (OuterVolumeSpecName: "kube-api-access-jpqcz") pod "6a15333b-059c-47a3-8ace-bf778a40a4fc" (UID: "6a15333b-059c-47a3-8ace-bf778a40a4fc"). InnerVolumeSpecName "kube-api-access-jpqcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:36:08.271855 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.271827 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-util" (OuterVolumeSpecName: "util") pod "6a15333b-059c-47a3-8ace-bf778a40a4fc" (UID: "6a15333b-059c-47a3-8ace-bf778a40a4fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:36:08.364250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.364165 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpqcz\" (UniqueName: \"kubernetes.io/projected/6a15333b-059c-47a3-8ace-bf778a40a4fc-kube-api-access-jpqcz\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:36:08.364250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.364196 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-util\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:36:08.364250 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:08.364206 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a15333b-059c-47a3-8ace-bf778a40a4fc-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 02 15:36:09.101464 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:09.101436 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" Jul 02 15:36:09.101464 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:09.101458 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8hbkcn" event={"ID":"6a15333b-059c-47a3-8ace-bf778a40a4fc","Type":"ContainerDied","Data":"c5b12f0316b410ddb81175233b96bbffd0bbbbffdc77da30782ed5086131d2e0"} Jul 02 15:36:09.101715 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:36:09.101505 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5b12f0316b410ddb81175233b96bbffd0bbbbffdc77da30782ed5086131d2e0" Jul 02 15:37:26.564868 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:37:26.564838 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:37:26.568749 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:37:26.568722 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9wwd4_eb17ecef-a11c-4858-9e47-b65838828f9b/ovn-acl-logging/0.log" Jul 02 15:39:08.447768 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:08.447733 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nw5kx_cefbe346-84b6-4123-8193-1522970e81d8/server/0.log" Jul 02 15:39:08.566711 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:08.566673 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bl88d_90776f85-a799-4e33-bac7-67ad6e429e69/manager/0.log" Jul 02 15:39:08.686336 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:08.686298 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-g8jfn_b5934564-60b2-4b98-bbde-244d910b43c5/manager/0.log" Jul 02 15:39:08.693695 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:08.693673 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-g8jfn_b5934564-60b2-4b98-bbde-244d910b43c5/copy-manifests/0.log" Jul 02 15:39:09.711910 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.711877 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w_36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae/util/0.log" Jul 02 15:39:09.719013 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.718990 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w_36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae/pull/0.log" Jul 02 15:39:09.725586 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.725566 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w_36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae/extract/0.log" Jul 02 15:39:09.831355 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.831324 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp_8d7b952b-9980-4dcb-99f5-5928d89d4948/util/0.log" Jul 02 15:39:09.837687 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.837662 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp_8d7b952b-9980-4dcb-99f5-5928d89d4948/pull/0.log" Jul 02 15:39:09.843947 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.843927 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp_8d7b952b-9980-4dcb-99f5-5928d89d4948/extract/0.log" Jul 02 15:39:09.959144 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.959115 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22_9a9a14d6-8567-4c38-b21b-93f18441adbe/util/0.log" Jul 02 15:39:09.965657 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.965583 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22_9a9a14d6-8567-4c38-b21b-93f18441adbe/pull/0.log" Jul 02 15:39:09.972235 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:09.972207 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22_9a9a14d6-8567-4c38-b21b-93f18441adbe/extract/0.log" Jul 02 15:39:10.093270 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:10.093243 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm_b56356e9-dff6-4718-aa37-8493a209112a/util/0.log" Jul 02 15:39:10.099276 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:10.099250 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm_b56356e9-dff6-4718-aa37-8493a209112a/pull/0.log" Jul 02 15:39:10.105134 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:10.105114 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm_b56356e9-dff6-4718-aa37-8493a209112a/extract/0.log" Jul 02 15:39:10.475625 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:10.475600 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7r8ld_e7cff717-c651-4b1e-a69b-420f38af16d0/manager/0.log" Jul 02 15:39:10.703702 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:10.703675 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nx78m_a4fc5054-987c-41b3-b66a-a53faf10f7d9/registry-server/0.log" Jul 02 15:39:10.830612 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:10.830583 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b92zb_6644a23c-575d-4c9b-ad44-d6a10a06c6e9/manager/0.log" Jul 02 15:39:10.951739 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:10.951710 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-l4zpj_abfd2b90-aeec-4c5e-9585-6d879d7eff9f/limitador/0.log" Jul 02 15:39:11.067562 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:11.067538 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zxrgp_91e9a41c-2535-4f94-bda9-696bdd64edf5/manager/0.log" Jul 02 15:39:11.439419 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:11.439395 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4479br_759f6d09-ed88-4d33-8545-3b61e211eb27/istio-proxy/0.log" Jul 02 15:39:11.586053 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:11.586023 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k87vw_3975edd5-e217-4fcc-bddf-5eafef6e883e/discovery/0.log" Jul 02 15:39:11.813447 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:11.813420 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-97bg6_b33ab9b2-7a8a-429e-95df-8233292e720a/kube-auth-proxy/0.log" Jul 02 15:39:11.923840 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:11.923808 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9ds5q_a6c83d10-0127-4149-b297-c9c4e0c00273/istio-proxy/0.log" Jul 02 15:39:16.055936 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.055896 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c2vxp/must-gather-9rmh5"] Jul 02 15:39:16.056451 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.056432 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerName="extract" Jul 02 15:39:16.056510 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.056456 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerName="extract" Jul 02 15:39:16.056510 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.056479 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerName="pull" Jul 02 15:39:16.056510 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.056488 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerName="pull" Jul 02 15:39:16.056510 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.056505 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerName="util" Jul 02 15:39:16.056672 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.056512 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerName="util" Jul 02 15:39:16.056672 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.056600 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a15333b-059c-47a3-8ace-bf778a40a4fc" containerName="extract" Jul 02 15:39:16.059659 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.059628 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.061899 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.061876 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2vxp\"/\"kube-root-ca.crt\"" Jul 02 15:39:16.062031 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.062012 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c2vxp\"/\"default-dockercfg-w7gxd\"" Jul 02 15:39:16.062085 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.062036 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2vxp\"/\"openshift-service-ca.crt\"" Jul 02 15:39:16.070759 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.070735 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2vxp/must-gather-9rmh5"] Jul 02 15:39:16.198083 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.198049 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62-must-gather-output\") pod \"must-gather-9rmh5\" (UID: \"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62\") " pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.198274 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.198109 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tvmx\" (UniqueName: \"kubernetes.io/projected/ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62-kube-api-access-6tvmx\") pod \"must-gather-9rmh5\" (UID: \"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62\") " pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.298978 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.298937 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62-must-gather-output\") pod \"must-gather-9rmh5\" (UID: \"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62\") " pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.299180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.299002 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tvmx\" (UniqueName: \"kubernetes.io/projected/ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62-kube-api-access-6tvmx\") pod \"must-gather-9rmh5\" (UID: \"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62\") " pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.299361 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.299339 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62-must-gather-output\") pod \"must-gather-9rmh5\" (UID: \"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62\") " pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.311346 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.311228 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tvmx\" (UniqueName: \"kubernetes.io/projected/ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62-kube-api-access-6tvmx\") pod \"must-gather-9rmh5\" (UID: \"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62\") " pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.369405 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.369364 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2vxp/must-gather-9rmh5" Jul 02 15:39:16.506261 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.506223 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2vxp/must-gather-9rmh5"] Jul 02 15:39:16.507634 ip-10-0-129-25 kubenswrapper[2549]: W0702 15:39:16.507594 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae5c6346_2ab7_4f68_a1e4_4cc3ba4c8f62.slice/crio-783c5bd3620a28b1966c03a439cd44eeab53049746827176b5bc4398e5d5709f WatchSource:0}: Error finding container 783c5bd3620a28b1966c03a439cd44eeab53049746827176b5bc4398e5d5709f: Status 404 returned error can't find the container with id 783c5bd3620a28b1966c03a439cd44eeab53049746827176b5bc4398e5d5709f Jul 02 15:39:16.509515 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:16.509501 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:39:17.135180 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:17.135149 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2vxp/must-gather-9rmh5" event={"ID":"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62","Type":"ContainerStarted","Data":"783c5bd3620a28b1966c03a439cd44eeab53049746827176b5bc4398e5d5709f"} Jul 02 15:39:18.142855 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:18.142823 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2vxp/must-gather-9rmh5" event={"ID":"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62","Type":"ContainerStarted","Data":"de7439d0f32c5fa1f64d24e89b7ad66138f8e7e843d81f6758fb715aee1835d8"} Jul 02 15:39:18.143237 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:18.142867 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2vxp/must-gather-9rmh5" event={"ID":"ae5c6346-2ab7-4f68-a1e4-4cc3ba4c8f62","Type":"ContainerStarted","Data":"7fd970ec4f4e769bf3ac51f3a13ca7846da471b3a8dede1a765d221eb5c36ddd"} Jul 02 15:39:18.161139 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:18.161071 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c2vxp/must-gather-9rmh5" podStartSLOduration=1.379938549 podStartE2EDuration="2.161051295s" totalImagesPullingTime="781.112746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:39:18.156999833 +0000 UTC m=+712.021856031" watchObservedRunningTime="2026-07-02 15:39:18.161051295 +0000 UTC m=+712.025907494" Jul 02 15:39:18.993865 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:18.993833 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8b2vb_14a03165-9d9b-47ee-91cf-d074540c4b19/global-pull-secret-syncer/0.log" Jul 02 15:39:19.138613 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:19.138577 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zsz8n_56ee9c6b-baa2-4da2-a5f6-db977253977b/konnectivity-agent/0.log" Jul 02 15:39:19.162195 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:19.162164 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-25.ec2.internal_8e1ab4c0d6465e7f5a7a74878f3504c3/haproxy/0.log" Jul 02 15:39:23.862777 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:23.862738 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w_36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae/extract/0.log" Jul 02 15:39:23.888088 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:23.888062 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w_36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae/util/0.log" Jul 02 15:39:23.913850 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:23.913826 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759spf7w_36dbf53e-ea2d-4881-b6a8-a1ab6dbbd2ae/pull/0.log" Jul 02 15:39:23.944327 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:23.944297 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp_8d7b952b-9980-4dcb-99f5-5928d89d4948/extract/0.log" Jul 02 15:39:23.967914 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:23.967891 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp_8d7b952b-9980-4dcb-99f5-5928d89d4948/util/0.log" Jul 02 15:39:23.991742 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:23.991713 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcgjp_8d7b952b-9980-4dcb-99f5-5928d89d4948/pull/0.log" Jul 02 15:39:24.023393 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.023344 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22_9a9a14d6-8567-4c38-b21b-93f18441adbe/extract/0.log" Jul 02 15:39:24.063292 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.063264 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22_9a9a14d6-8567-4c38-b21b-93f18441adbe/util/0.log" Jul 02 15:39:24.087207 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.087157 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5x22_9a9a14d6-8567-4c38-b21b-93f18441adbe/pull/0.log" Jul 02 15:39:24.118721 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.118591 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm_b56356e9-dff6-4718-aa37-8493a209112a/extract/0.log" Jul 02 15:39:24.144287 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.144252 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm_b56356e9-dff6-4718-aa37-8493a209112a/util/0.log" Jul 02 15:39:24.170094 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.170066 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rvlqm_b56356e9-dff6-4718-aa37-8493a209112a/pull/0.log" Jul 02 15:39:24.265139 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.265103 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7r8ld_e7cff717-c651-4b1e-a69b-420f38af16d0/manager/0.log" Jul 02 15:39:24.328462 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.328431 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nx78m_a4fc5054-987c-41b3-b66a-a53faf10f7d9/registry-server/0.log" Jul 02 15:39:24.366465 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.366434 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b92zb_6644a23c-575d-4c9b-ad44-d6a10a06c6e9/manager/0.log" Jul 02 15:39:24.393006 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.392878 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-l4zpj_abfd2b90-aeec-4c5e-9585-6d879d7eff9f/limitador/0.log" Jul 02 15:39:24.429230 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:24.429197 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zxrgp_91e9a41c-2535-4f94-bda9-696bdd64edf5/manager/0.log" Jul 02 15:39:26.228200 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.228163 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb8ee045-8826-4401-b786-97f5704bcfd8/alertmanager/0.log" Jul 02 15:39:26.254876 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.254852 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb8ee045-8826-4401-b786-97f5704bcfd8/config-reloader/0.log" Jul 02 15:39:26.280793 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.280762 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb8ee045-8826-4401-b786-97f5704bcfd8/kube-rbac-proxy-web/0.log" Jul 02 15:39:26.305293 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.305256 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb8ee045-8826-4401-b786-97f5704bcfd8/kube-rbac-proxy/0.log" Jul 02 15:39:26.342106 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.342000 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb8ee045-8826-4401-b786-97f5704bcfd8/kube-rbac-proxy-metric/0.log" Jul 02 15:39:26.381683 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.381631 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb8ee045-8826-4401-b786-97f5704bcfd8/prom-label-proxy/0.log" Jul 02 15:39:26.416246 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.416183 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb8ee045-8826-4401-b786-97f5704bcfd8/init-config-reloader/0.log" Jul 02 15:39:26.492128 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.492106 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-nvqnj_780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3/kube-state-metrics/0.log" Jul 02 15:39:26.515049 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.515010 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-nvqnj_780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3/kube-rbac-proxy-main/0.log" Jul 02 15:39:26.543958 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.543925 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-nvqnj_780f8b87-18bc-4ad9-b4ba-2ee1c8682ac3/kube-rbac-proxy-self/0.log" Jul 02 15:39:26.586680 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.586604 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dd4f8f6bf-sq8s6_68ca24e0-48a7-4012-af21-e4a6126d1382/metrics-server/0.log" Jul 02 15:39:26.617674 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.617575 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-b7b7s_7ef41008-57d4-419a-b26a-cce074fb02d6/monitoring-plugin/0.log" Jul 02 15:39:26.801150 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.801124 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdb6m_e3053afe-e695-41ab-b130-372f7d13de2e/node-exporter/0.log" Jul 02 15:39:26.828691 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.828612 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdb6m_e3053afe-e695-41ab-b130-372f7d13de2e/kube-rbac-proxy/0.log" Jul 02 15:39:26.855293 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:26.855254 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdb6m_e3053afe-e695-41ab-b130-372f7d13de2e/init-textfile/0.log" Jul 02 15:39:27.192621 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:27.192594 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-hpvxm_cc21a31e-965f-420d-bdc9-e395ec961b8a/prometheus-operator-admission-webhook/0.log" Jul 02 15:39:27.237312 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:27.237278 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8586c58954-6957l_ad5acf78-e84f-4a73-8b5d-c5132e0000f1/telemeter-client/0.log" Jul 02 15:39:27.268110 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:27.268069 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8586c58954-6957l_ad5acf78-e84f-4a73-8b5d-c5132e0000f1/reload/0.log" Jul 02 15:39:27.297270 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:27.297226 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8586c58954-6957l_ad5acf78-e84f-4a73-8b5d-c5132e0000f1/kube-rbac-proxy/0.log" Jul 02 15:39:28.991033 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:28.990994 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9"] Jul 02 15:39:28.997386 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:28.997358 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.013287 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.013251 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9"] Jul 02 15:39:29.146015 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.145971 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-proc\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.146203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.146053 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5zc\" (UniqueName: \"kubernetes.io/projected/82bb5ed9-494c-474e-9a81-4796ddd9b42b-kube-api-access-th5zc\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.146203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.146102 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-sys\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.146203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.146129 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-lib-modules\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.146203 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.146167 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-podres\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247246 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247157 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-proc\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247413 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th5zc\" (UniqueName: \"kubernetes.io/projected/82bb5ed9-494c-474e-9a81-4796ddd9b42b-kube-api-access-th5zc\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247413 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247270 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-proc\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247413 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247306 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-sys\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247413 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247336 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-lib-modules\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247617 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247453 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-sys\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247617 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247526 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-lib-modules\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247617 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247567 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-podres\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.247802 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.247669 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82bb5ed9-494c-474e-9a81-4796ddd9b42b-podres\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.255725 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.255695 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5zc\" (UniqueName: \"kubernetes.io/projected/82bb5ed9-494c-474e-9a81-4796ddd9b42b-kube-api-access-th5zc\") pod \"perf-node-gather-daemonset-47mt9\" (UID: \"82bb5ed9-494c-474e-9a81-4796ddd9b42b\") " pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.317484 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.317445 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:29.507204 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:29.506065 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9"] Jul 02 15:39:30.243680 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:30.243598 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" event={"ID":"82bb5ed9-494c-474e-9a81-4796ddd9b42b","Type":"ContainerStarted","Data":"d6b8857cad8ac591fc3b94e8ce47ef24bdf510373313972a7da5143c08a2860c"} Jul 02 15:39:30.244185 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:30.243743 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" event={"ID":"82bb5ed9-494c-474e-9a81-4796ddd9b42b","Type":"ContainerStarted","Data":"175365341d5f94e68622aea597219aa248f1b27a17479cef3abb6b00f7ed1a19"} Jul 02 15:39:30.260898 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:30.260834 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" podStartSLOduration=2.26081349 podStartE2EDuration="2.26081349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:39:30.258484565 +0000 UTC m=+724.123340766" watchObservedRunningTime="2026-07-02 15:39:30.26081349 +0000 UTC m=+724.125669688" Jul 02 15:39:31.251379 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:31.251342 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:31.589271 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:31.589245 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xc9vv_82d9b801-8075-4c2d-a0b4-b3837aea7458/dns/0.log" Jul 02 15:39:31.642493 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:31.642335 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xc9vv_82d9b801-8075-4c2d-a0b4-b3837aea7458/kube-rbac-proxy/0.log" Jul 02 15:39:31.744287 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:31.744256 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tpczq_b224e118-ed34-4948-8a59-db55276adaad/dns-node-resolver/0.log" Jul 02 15:39:32.282984 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:32.282954 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-97559659f-bv7n7_63bc4173-bcb7-4be1-8d9d-f173298e3c5a/registry/0.log" Jul 02 15:39:32.307142 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:32.307117 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6lgzk_a496d1d4-a398-481d-82ca-9a1f72745d53/node-ca/0.log" Jul 02 15:39:33.321454 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:33.321425 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4479br_759f6d09-ed88-4d33-8545-3b61e211eb27/istio-proxy/0.log" Jul 02 15:39:33.372138 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:33.372107 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k87vw_3975edd5-e217-4fcc-bddf-5eafef6e883e/discovery/0.log" Jul 02 15:39:33.443597 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:33.443568 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-97bg6_b33ab9b2-7a8a-429e-95df-8233292e720a/kube-auth-proxy/0.log" Jul 02 15:39:33.492239 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:33.492202 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9ds5q_a6c83d10-0127-4149-b297-c9c4e0c00273/istio-proxy/0.log" Jul 02 15:39:34.262729 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:34.262705 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zvwwb_ff147a57-69b7-47b9-81fe-5acb01b98613/serve-healthcheck-canary/0.log" Jul 02 15:39:34.787822 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:34.787790 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kngp_ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f/kube-rbac-proxy/0.log" Jul 02 15:39:34.812847 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:34.812813 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kngp_ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f/exporter/0.log" Jul 02 15:39:34.836089 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:34.836055 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kngp_ba8f48a0-c03e-43dc-ae4e-b60e7dd4c24f/extractor/0.log" Jul 02 15:39:37.271299 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:37.271268 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c2vxp/perf-node-gather-daemonset-47mt9" Jul 02 15:39:37.320791 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:37.320765 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nw5kx_cefbe346-84b6-4123-8193-1522970e81d8/server/0.log" Jul 02 15:39:37.379296 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:37.379264 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bl88d_90776f85-a799-4e33-bac7-67ad6e429e69/manager/0.log" Jul 02 15:39:37.428407 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:37.428371 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-g8jfn_b5934564-60b2-4b98-bbde-244d910b43c5/manager/0.log" Jul 02 15:39:37.451583 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:37.451555 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6555957f57-g8jfn_b5934564-60b2-4b98-bbde-244d910b43c5/copy-manifests/0.log" Jul 02 15:39:40.109693 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:40.109639 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4479br_759f6d09-ed88-4d33-8545-3b61e211eb27/istio-proxy/0.log" Jul 02 15:39:40.153416 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:40.153363 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k87vw_3975edd5-e217-4fcc-bddf-5eafef6e883e/discovery/0.log" Jul 02 15:39:40.183354 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:40.183330 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-97bg6_b33ab9b2-7a8a-429e-95df-8233292e720a/kube-auth-proxy/0.log" Jul 02 15:39:40.201633 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:40.201599 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9ds5q_a6c83d10-0127-4149-b297-c9c4e0c00273/istio-proxy/0.log" Jul 02 15:39:41.298619 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:41.298547 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4479br_759f6d09-ed88-4d33-8545-3b61e211eb27/istio-proxy/0.log" Jul 02 15:39:41.352272 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:41.352242 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k87vw_3975edd5-e217-4fcc-bddf-5eafef6e883e/discovery/0.log" Jul 02 15:39:41.389439 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:41.389406 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcd68765c-97bg6_b33ab9b2-7a8a-429e-95df-8233292e720a/kube-auth-proxy/0.log" Jul 02 15:39:41.420191 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:41.419713 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9ds5q_a6c83d10-0127-4149-b297-c9c4e0c00273/istio-proxy/0.log" Jul 02 15:39:46.484795 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.484758 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bwb8_3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8/kube-multus-additional-cni-plugins/0.log" Jul 02 15:39:46.526528 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.526504 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bwb8_3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8/egress-router-binary-copy/0.log" Jul 02 15:39:46.564587 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.564554 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bwb8_3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8/cni-plugins/0.log" Jul 02 15:39:46.595946 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.595921 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bwb8_3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8/bond-cni-plugin/0.log" Jul 02 15:39:46.628161 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.628133 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bwb8_3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8/routeoverride-cni/0.log" Jul 02 15:39:46.652046 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.652020 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bwb8_3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8/whereabouts-cni-bincopy/0.log" Jul 02 15:39:46.677864 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.677840 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bwb8_3f55abed-fdbb-4d2b-a2a3-05607c9a9ab8/whereabouts-cni/0.log" Jul 02 15:39:46.718535 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.718496 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gw2pv_7e41d4f5-bd22-441c-82e2-69b68080db60/kube-multus/0.log" Jul 02 15:39:46.872713 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.872682 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tm2v8_5e28d45a-fd9a-44be-8366-927ee969e3fd/network-metrics-daemon/0.log" Jul 02 15:39:46.900084 ip-10-0-129-25 kubenswrapper[2549]: I0702 15:39:46.900058 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tm2v8_5e28d45a-fd9a-44be-8366-927ee969e3fd/kube-rbac-proxy/0.log"