Jul 01 18:27:37.427567 ip-10-0-133-114 systemd[1]: Starting Kubernetes Kubelet... Jul 01 18:27:37.846944 ip-10-0-133-114 kubenswrapper[2528]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:37.846944 ip-10-0-133-114 kubenswrapper[2528]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 18:27:37.846944 ip-10-0-133-114 kubenswrapper[2528]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:37.846944 ip-10-0-133-114 kubenswrapper[2528]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 18:27:37.846944 ip-10-0-133-114 kubenswrapper[2528]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:37.847587 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.846994 2528 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 18:27:37.850589 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850571 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:37.850589 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850588 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850592 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850595 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850598 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850601 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850604 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850607 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850609 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850612 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850615 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850618 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850620 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850623 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850626 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850628 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850631 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850634 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850636 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850644 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:37.850650 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850646 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850649 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850652 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850654 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850657 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850660 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850662 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850665 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850668 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850670 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850672 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850675 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850677 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850679 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850682 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850684 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850688 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850692 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850694 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:37.851123 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850697 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850700 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850702 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850706 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850709 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850712 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850714 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850717 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850720 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850722 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850724 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850727 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850729 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850731 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850734 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850737 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850740 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850742 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850745 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850747 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:37.851598 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850751 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850754 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850756 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850758 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850761 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850764 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850766 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850769 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850771 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850774 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850776 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850778 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850783 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850787 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850790 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850793 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850795 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850797 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850800 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:37.852105 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850802 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850805 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850807 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850810 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850812 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850815 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850817 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850820 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850824 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850826 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850829 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850831 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850834 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850836 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850839 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850842 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850844 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850847 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850849 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850851 2528 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:37.852584 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.850854 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851575 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851583 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851586 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851588 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851591 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851594 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851599 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851604 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851607 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851610 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851612 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851615 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851618 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851621 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851623 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851627 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851630 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851634 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:37.853077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851636 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851640 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851642 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851645 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851648 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851650 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851653 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851655 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851657 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851660 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851662 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851665 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851667 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851670 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851672 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851675 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851677 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851680 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851682 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:37.853564 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851684 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851687 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851690 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851692 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851695 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851697 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851699 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851702 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851704 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851707 2528 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851709 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851712 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851714 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851716 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851719 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851722 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851724 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851727 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851730 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851732 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:37.854019 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851735 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851737 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851740 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851742 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851745 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851747 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851750 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851752 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851754 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851757 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851759 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851761 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851764 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851766 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851769 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851772 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851775 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851778 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851780 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:37.854520 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851782 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851785 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851787 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851789 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851792 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851794 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851798 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851803 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851807 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851810 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851812 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851815 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851817 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851820 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851822 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851824 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851827 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851829 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851832 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851834 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:37.855092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851837 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851839 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.851841 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852222 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852227 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852230 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852233 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852236 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852239 2528 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852242 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852266 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852271 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852277 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852281 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852284 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852287 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852290 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852294 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852296 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852299 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:37.855595 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852302 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852305 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852307 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852310 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852313 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852315 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852318 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852320 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852323 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852326 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852328 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852330 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852333 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852335 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852337 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852340 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852342 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852344 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852347 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:37.856077 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852349 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852352 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852355 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852358 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852360 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852363 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852365 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852367 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852370 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852372 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852377 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852380 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852383 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852385 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852388 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852390 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852393 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852395 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852398 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852400 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:37.856592 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852406 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852409 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852412 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852415 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852417 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852419 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852422 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852424 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852427 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852429 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852432 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852434 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852436 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852439 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852442 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852444 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852447 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852450 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852452 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852455 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:37.857078 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852457 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852460 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852463 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852466 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852468 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852471 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852473 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852477 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852480 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852482 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852485 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852488 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852492 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852494 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852497 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852500 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852502 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852504 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852507 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:37.857566 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852509 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852511 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852514 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.852516 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852587 2528 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852596 2528 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852607 2528 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852614 2528 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852621 2528 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852626 2528 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852633 2528 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852640 2528 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852644 2528 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852646 2528 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852649 2528 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852653 2528 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852656 2528 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852659 2528 flags.go:64] FLAG: --cgroup-root="" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852661 2528 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852664 2528 flags.go:64] FLAG: --client-ca-file="" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852667 2528 flags.go:64] FLAG: --cloud-provider="external" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852670 2528 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852674 2528 flags.go:64] FLAG: --cluster-domain="" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852676 2528 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 18:27:37.858050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852679 2528 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852682 2528 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852686 2528 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852689 2528 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852692 2528 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852694 2528 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852697 2528 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852700 2528 flags.go:64] FLAG: --contention-profiling="false" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852703 2528 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852705 2528 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852708 2528 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852711 2528 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852715 2528 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852717 2528 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852720 2528 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852723 2528 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852725 2528 flags.go:64] FLAG: --enable-server="true" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852729 2528 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852733 2528 flags.go:64] FLAG: --event-burst="100" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852736 2528 flags.go:64] FLAG: --event-qps="50" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852739 2528 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852741 2528 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852744 2528 flags.go:64] FLAG: --eviction-hard="" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852748 2528 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 18:27:37.858648 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852751 2528 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852754 2528 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852756 2528 flags.go:64] FLAG: --eviction-soft="" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852759 2528 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852762 2528 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852765 2528 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852768 2528 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852770 2528 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852773 2528 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852776 2528 flags.go:64] FLAG: --feature-gates="" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852780 2528 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852783 2528 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852786 2528 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852789 2528 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852792 2528 flags.go:64] FLAG: --healthz-port="10248" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852794 2528 flags.go:64] FLAG: --help="false" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852797 2528 flags.go:64] FLAG: --hostname-override="ip-10-0-133-114.ec2.internal" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852800 2528 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852802 2528 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852805 2528 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852808 2528 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852812 2528 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852814 2528 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 18:27:37.859341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852817 2528 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852820 2528 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852822 2528 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852826 2528 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852829 2528 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852831 2528 flags.go:64] FLAG: --kube-reserved="" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852834 2528 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852837 2528 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852840 2528 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852843 2528 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852846 2528 flags.go:64] FLAG: --lock-file="" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852849 2528 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852851 2528 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852854 2528 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852859 2528 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852862 2528 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852864 2528 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852867 2528 flags.go:64] FLAG: --logging-format="text" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852870 2528 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852873 2528 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852877 2528 flags.go:64] FLAG: --manifest-url="" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852879 2528 flags.go:64] FLAG: --manifest-url-header="" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852883 2528 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852886 2528 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852890 2528 flags.go:64] FLAG: --max-pods="110" Jul 01 18:27:37.859920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852893 2528 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852895 2528 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852898 2528 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852901 2528 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852904 2528 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852907 2528 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852910 2528 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852916 2528 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852919 2528 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852922 2528 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852925 2528 flags.go:64] FLAG: --pod-cidr="" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852928 2528 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852933 2528 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852936 2528 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852939 2528 flags.go:64] FLAG: --pods-per-core="0" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852942 2528 flags.go:64] FLAG: --port="10250" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852945 2528 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852947 2528 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-008c52ac8f7571287" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852950 2528 flags.go:64] FLAG: --qos-reserved="" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852953 2528 flags.go:64] FLAG: --read-only-port="10255" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852956 2528 flags.go:64] FLAG: --register-node="true" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852958 2528 flags.go:64] FLAG: --register-with-taints="" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852962 2528 flags.go:64] FLAG: --registry-burst="10" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852964 2528 flags.go:64] FLAG: --registry-qps="5" Jul 01 18:27:37.860590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852967 2528 flags.go:64] FLAG: --reserved-cpus="" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852970 2528 flags.go:64] FLAG: --reserved-memory="" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852973 2528 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852976 2528 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852978 2528 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852981 2528 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852984 2528 flags.go:64] FLAG: --runonce="false" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852987 2528 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852989 2528 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852992 2528 flags.go:64] FLAG: --seccomp-default="false" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852995 2528 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.852997 2528 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853000 2528 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853003 2528 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853005 2528 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853008 2528 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853010 2528 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853013 2528 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853016 2528 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853019 2528 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853022 2528 flags.go:64] FLAG: --system-cgroups="" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853025 2528 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853029 2528 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853032 2528 flags.go:64] FLAG: --tls-cert-file="" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853047 2528 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 18:27:37.861178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853052 2528 flags.go:64] FLAG: --tls-min-version="" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853055 2528 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853058 2528 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853060 2528 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853063 2528 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853066 2528 flags.go:64] FLAG: --v="2" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853070 2528 flags.go:64] FLAG: --version="false" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853074 2528 flags.go:64] FLAG: --vmodule="" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853079 2528 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853082 2528 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853195 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853199 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853202 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853205 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853208 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853210 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853213 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853215 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853218 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853220 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853223 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853225 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:37.861789 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853228 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853230 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853233 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853235 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853238 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853240 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853243 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853259 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853262 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853269 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853271 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853274 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853276 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853278 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853281 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853284 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853286 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853289 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853293 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:37.862332 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853296 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853298 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853301 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853303 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853306 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853308 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853311 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853313 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853315 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853318 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853320 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853322 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853325 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853327 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853330 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853332 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853335 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853337 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853339 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853341 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:37.862836 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853344 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853347 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853350 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853353 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853370 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853374 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853377 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853380 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853382 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853385 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853387 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853392 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853396 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853399 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853401 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853404 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853407 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853409 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853412 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853415 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:37.863360 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853417 2528 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853419 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853422 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853424 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853427 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853429 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853432 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853434 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853436 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853440 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853443 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853446 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853449 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853452 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853456 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853459 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853461 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853464 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853466 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:37.863868 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853469 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853471 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853474 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853476 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853479 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853482 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853484 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853486 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.853490 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.853495 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.860311 2528 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.860325 2528 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.860337 2528 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.860343 2528 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860397 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:37.864365 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860401 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860405 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860408 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860411 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860414 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860417 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860420 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860423 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860425 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860428 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860430 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860434 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860436 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860439 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860442 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860445 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860447 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860450 2528 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860453 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860455 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:37.864852 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860458 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860460 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860463 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860465 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860468 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860470 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860473 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860475 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860478 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860480 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860483 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860485 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860488 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860490 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860493 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860495 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860498 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860500 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860503 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860505 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:37.865385 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860507 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860510 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860512 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860515 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860518 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860520 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860523 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860525 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860528 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860530 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860532 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860535 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860537 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860540 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860542 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860544 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860547 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860550 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860552 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860554 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:37.865938 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860557 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860559 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860562 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860566 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860569 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860572 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860575 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860578 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860580 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860582 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860585 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860587 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860589 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860593 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860596 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860600 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860603 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860607 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:37.866501 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860609 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860613 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860617 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860619 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860622 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860624 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860627 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860630 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860632 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860634 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860637 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860639 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860642 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860644 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860646 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860648 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860651 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860653 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860655 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:37.866954 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860658 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.860662 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860770 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860775 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860779 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860783 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860786 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860788 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860791 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860794 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860797 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860799 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860802 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860805 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:37.867506 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860807 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860810 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860812 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860814 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860817 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860834 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860837 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860841 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860843 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860846 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860849 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860852 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860854 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860856 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860859 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860861 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860863 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860866 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860869 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860871 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:37.867888 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860873 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860876 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860878 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860881 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860883 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860885 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860888 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860890 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860893 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860895 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860898 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860900 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860903 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860905 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860908 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860910 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860912 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860914 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860917 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860920 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:37.868624 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860922 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860924 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860927 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860929 2528 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860932 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860934 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860936 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860938 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860941 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860943 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860945 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860948 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860950 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860952 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860955 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860957 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860959 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860962 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860964 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860966 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860969 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:37.869204 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860974 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860976 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860978 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860981 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860984 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860986 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860989 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860991 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860994 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.860997 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861001 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861004 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861007 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861011 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861014 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861016 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861019 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861022 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:37.869843 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861024 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861027 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861030 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861032 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861034 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861046 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861050 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:37.861053 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.861057 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.861152 2528 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.863123 2528 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.864446 2528 server.go:1019] "Starting client certificate rotation" Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.864555 2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:27:37.870287 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.864625 2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:27:37.870606 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.869689 2528 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:27:37.872904 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.872875 2528 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:27:37.880014 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.879997 2528 log.go:25] "Validated CRI v1 runtime API" Jul 01 18:27:37.882094 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.882080 2528 log.go:25] "Validated CRI v1 image API" Jul 01 18:27:37.883668 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.883645 2528 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 18:27:37.888391 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.888374 2528 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8552e970-3d7a-41a3-89e5-e7d8f1bb1259:/dev/nvme0n1p3 8e3d8d18-6afd-4c10-8b85-25a30e529d30:/dev/nvme0n1p4] Jul 01 18:27:37.888459 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.888391 2528 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 18:27:37.894284 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.894161 2528 manager.go:216] Machine: {Timestamp:2026-07-01 18:27:37.892797181 +0000 UTC m=+0.346928224 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101874 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b4071f807044d8dbd74ccf91990f9 SystemUUID:ec2b4071-f807-044d-8dbd-74ccf91990f9 BootID:6ab227e7-646b-40f3-8488-937b43db02ad Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:54:c8:45:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:54:c8:45:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:09:76:2f:b0:ae Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 18:27:37.894284 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.894280 2528 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 18:27:37.894393 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.894375 2528 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 18:27:37.896581 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.896559 2528 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 18:27:37.896700 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.896583 2528 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 18:27:37.897306 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.897293 2528 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 18:27:37.897354 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.897312 2528 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 18:27:37.897354 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.897331 2528 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:27:37.898074 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.898063 2528 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:27:37.898824 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.898815 2528 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 18:27:37.900033 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.900010 2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:27:37.901732 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.901719 2528 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:27:37.901836 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.901826 2528 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 18:27:37.901887 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.901863 2528 kubelet.go:486] "Attempting to sync node with API server" Jul 01 18:27:37.901887 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.901881 2528 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 18:27:37.901971 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.901894 2528 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 18:27:37.901971 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.901903 2528 kubelet.go:398] "Adding apiserver pod source" Jul 01 18:27:37.901971 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.901922 2528 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 18:27:37.902434 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.902422 2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:27:37.902480 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.902442 2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:27:37.906760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.906740 2528 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 18:27:37.908040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908027 2528 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 18:27:37.908087 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908058 2528 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 18:27:37.908597 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908587 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 18:27:37.908638 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908603 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 18:27:37.908638 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908609 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 18:27:37.908638 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908614 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 18:27:37.908638 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908626 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 18:27:37.908638 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908634 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 18:27:37.908837 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908829 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 18:27:37.908869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908838 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 18:27:37.908869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908845 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 18:27:37.908869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908850 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 18:27:37.908869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908858 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 18:27:37.908869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.908865 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 18:27:37.909642 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.909630 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 18:27:37.909681 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.909645 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 18:27:37.913004 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.912848 2528 server.go:1268] "Started kubelet" Jul 01 18:27:37.913094 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.912930 2528 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 18:27:37.913152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.913100 2528 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 18:27:37.913211 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.912935 2528 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 18:27:37.913806 ip-10-0-133-114 systemd[1]: Started Kubernetes Kubelet. Jul 01 18:27:37.914487 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.914434 2528 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 18:27:37.914630 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.914596 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 18:27:37.914792 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.914710 2528 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 18:27:37.914843 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.914795 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 18:27:37.915452 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.915434 2528 server.go:310] "Adding debug handlers to kubelet server" Jul 01 18:27:37.918849 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.917782 2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-114.ec2.internal.18be3dce1b1e50b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-114.ec2.internal,UID:ip-10-0-133-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-114.ec2.internal,},FirstTimestamp:2026-07-01 18:27:37.912823989 +0000 UTC m=+0.366955030,LastTimestamp:2026-07-01 18:27:37.912823989 +0000 UTC m=+0.366955030,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-114.ec2.internal,}" Jul 01 18:27:37.919005 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.918974 2528 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 18:27:37.921052 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921021 2528 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 18:27:37.921052 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921033 2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 18:27:37.921215 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.921193 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:37.921706 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921664 2528 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 18:27:37.921706 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921678 2528 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 18:27:37.921706 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921696 2528 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 18:27:37.921874 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921779 2528 reconstruct.go:97] "Volume reconstruction finished" Jul 01 18:27:37.921874 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921789 2528 reconciler.go:29] "Reconciler: start to sync state" Jul 01 18:27:37.921947 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921921 2528 factory.go:55] Registering systemd factory Jul 01 18:27:37.921947 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.921934 2528 factory.go:223] Registration of the systemd container factory successfully Jul 01 18:27:37.922189 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.922173 2528 factory.go:153] Registering CRI-O factory Jul 01 18:27:37.922189 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.922190 2528 factory.go:223] Registration of the crio container factory successfully Jul 01 18:27:37.922347 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.922238 2528 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 18:27:37.922347 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.922277 2528 factory.go:103] Registering Raw factory Jul 01 18:27:37.922347 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.922306 2528 manager.go:1196] Started watching for new ooms in manager Jul 01 18:27:37.923188 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.923174 2528 manager.go:349] Starting recovery of all containers Jul 01 18:27:37.923510 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.923481 2528 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 18:27:37.923816 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.923798 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 18:27:37.926389 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.926367 2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lt7tj" Jul 01 18:27:37.933803 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.933778 2528 manager.go:354] Recovery completed Jul 01 18:27:37.934630 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.934611 2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lt7tj" Jul 01 18:27:37.939500 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.939486 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:37.941322 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.941304 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:37.941386 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.941333 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:37.941386 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.941344 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:37.941856 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.941842 2528 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 18:27:37.941856 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.941855 2528 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 18:27:37.941946 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.941872 2528 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:27:37.941946 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.941856 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:37.942598 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.942575 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:37.942671 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.942611 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:37.942671 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.942624 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:37.943006 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.942991 2528 policy_none.go:49] "None policy: Start" Jul 01 18:27:37.943060 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.943013 2528 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 18:27:37.943060 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.943023 2528 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 18:27:37.943962 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.943951 2528 policy_none.go:47] "Start" Jul 01 18:27:37.976851 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.976836 2528 manager.go:337] "Starting Device Plugin manager" Jul 01 18:27:37.976942 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.976906 2528 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 18:27:37.976942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.976918 2528 server.go:87] "Starting device plugin registration server" Jul 01 18:27:37.977195 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.977184 2528 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 18:27:37.977239 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.977197 2528 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 18:27:37.977443 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.977430 2528 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 18:27:37.977514 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.977507 2528 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 18:27:37.977562 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.977515 2528 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 18:27:37.978017 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.977996 2528 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 18:27:37.978103 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.978051 2528 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:37.994401 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.994372 2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 18:27:37.997067 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.995774 2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 18:27:37.997067 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.995805 2528 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 18:27:37.997067 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.995823 2528 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 18:27:37.997067 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:37.995855 2528 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 18:27:37.997771 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:37.997713 2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:38.078099 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.078077 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:38.079857 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.079844 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:38.079932 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.079871 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:38.079932 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.079880 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:38.079932 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.079901 2528 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.089864 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.089849 2528 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.089942 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.089868 2528 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-114.ec2.internal\": node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.096298 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.096281 2528 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal"] Jul 01 18:27:38.096354 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.096342 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:38.097106 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.097055 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:38.097106 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.097081 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:38.097106 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.097090 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:38.098410 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.098398 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:38.098547 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.098534 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.098580 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.098561 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:38.099052 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.099031 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:38.099109 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.099059 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:38.099109 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.099073 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:38.099194 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.099113 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:38.099194 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.099133 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:38.099194 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.099142 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:38.101468 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.101454 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.101509 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.101477 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:38.102105 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.102092 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:38.102147 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.102115 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:38.102147 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.102125 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:38.104459 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.104445 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.132799 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.132780 2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-114.ec2.internal\" not found" node="ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.136108 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.136093 2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-114.ec2.internal\" not found" node="ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.204555 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.204533 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.223244 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.223225 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5f7124e72f8c62bb57c9280d2e3d70f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal\" (UID: \"b5f7124e72f8c62bb57c9280d2e3d70f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.223321 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.223263 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5f7124e72f8c62bb57c9280d2e3d70f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal\" (UID: \"b5f7124e72f8c62bb57c9280d2e3d70f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.223321 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.223280 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77380cf742ba9e9737750d6db3ca67d0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-114.ec2.internal\" (UID: \"77380cf742ba9e9737750d6db3ca67d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.305229 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.305210 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.323732 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.323712 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5f7124e72f8c62bb57c9280d2e3d70f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal\" (UID: \"b5f7124e72f8c62bb57c9280d2e3d70f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.323806 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.323743 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77380cf742ba9e9737750d6db3ca67d0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-114.ec2.internal\" (UID: \"77380cf742ba9e9737750d6db3ca67d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.323806 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.323767 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5f7124e72f8c62bb57c9280d2e3d70f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal\" (UID: \"b5f7124e72f8c62bb57c9280d2e3d70f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.323905 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.323805 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77380cf742ba9e9737750d6db3ca67d0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-114.ec2.internal\" (UID: \"77380cf742ba9e9737750d6db3ca67d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.323905 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.323808 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5f7124e72f8c62bb57c9280d2e3d70f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal\" (UID: \"b5f7124e72f8c62bb57c9280d2e3d70f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.323905 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.323862 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5f7124e72f8c62bb57c9280d2e3d70f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal\" (UID: \"b5f7124e72f8c62bb57c9280d2e3d70f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.406141 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.406085 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.436592 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.436572 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.439673 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:38.439649 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" Jul 01 18:27:38.506945 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.506915 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.607417 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.607377 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.708014 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.707936 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:38.808704 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:38.808673 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:40.327695 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.327677 2528 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:40.338572 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.338553 2528 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 18:27:40.338692 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.338672 2528 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 18:27:40.338740 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.338695 2528 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 18:27:40.384032 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:40.384003 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:40.414109 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.414079 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 18:22:39 +0000 UTC" deadline="2028-02-15 02:49:02.902231871 +0000 UTC" Jul 01 18:27:40.414109 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.414107 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14240h21m22.488128921s" Jul 01 18:27:40.420244 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:40.420206 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f7124e72f8c62bb57c9280d2e3d70f.slice/crio-dd8702f0af594aac49e7cc9b68f5814711ede8929e248b4b11d05103cd9d5727 WatchSource:0}: Error finding container dd8702f0af594aac49e7cc9b68f5814711ede8929e248b4b11d05103cd9d5727: Status 404 returned error can't find the container with id dd8702f0af594aac49e7cc9b68f5814711ede8929e248b4b11d05103cd9d5727 Jul 01 18:27:40.420863 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:40.420841 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77380cf742ba9e9737750d6db3ca67d0.slice/crio-e52a41123de1d3f9de501a395a8b11d99dee408d82c69acb79f67c9a902d159c WatchSource:0}: Error finding container e52a41123de1d3f9de501a395a8b11d99dee408d82c69acb79f67c9a902d159c: Status 404 returned error can't find the container with id e52a41123de1d3f9de501a395a8b11d99dee408d82c69acb79f67c9a902d159c Jul 01 18:27:40.425589 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.425572 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:27:40.475258 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.475176 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" event={"ID":"77380cf742ba9e9737750d6db3ca67d0","Type":"ContainerStarted","Data":"e52a41123de1d3f9de501a395a8b11d99dee408d82c69acb79f67c9a902d159c"} Jul 01 18:27:40.476267 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.476244 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" event={"ID":"b5f7124e72f8c62bb57c9280d2e3d70f","Type":"ContainerStarted","Data":"dd8702f0af594aac49e7cc9b68f5814711ede8929e248b4b11d05103cd9d5727"} Jul 01 18:27:40.484404 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:40.484371 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-114.ec2.internal\" not found" Jul 01 18:27:40.526676 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.526657 2528 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:40.597288 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.597265 2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" Jul 01 18:27:40.610310 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.610290 2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:27:40.611323 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.611312 2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" Jul 01 18:27:40.621162 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.621140 2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:27:40.910552 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:40.910460 2528 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:41.206021 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.205938 2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:41.378022 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.377991 2528 apiserver.go:52] "Watching apiserver" Jul 01 18:27:41.387471 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.387448 2528 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 18:27:41.387892 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.387857 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-8gmwz","kube-system/global-pull-secret-syncer-zl55s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn","openshift-cluster-node-tuning-operator/tuned-qrkjt","openshift-dns/node-resolver-8zgz4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal","openshift-multus/multus-64mdz","openshift-multus/network-metrics-daemon-5j9jb","openshift-network-diagnostics/network-check-target-mznv5","kube-system/konnectivity-agent-996n2","kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal","openshift-image-registry/node-ca-jzlrj","openshift-multus/multus-additional-cni-plugins-5g9cg","openshift-network-operator/iptables-alerter-zg4hl"] Jul 01 18:27:41.389633 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.389609 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.391088 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.390853 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.391976 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.391951 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.392614 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.392596 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 18:27:41.392743 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.392596 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 18:27:41.392810 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.392764 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hxfb5\"" Jul 01 18:27:41.392983 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.392958 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 18:27:41.393065 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.392983 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 18:27:41.393503 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.393321 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.394847 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.394540 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.395104 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395087 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pfxfn\"" Jul 01 18:27:41.395294 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395278 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 18:27:41.395371 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395282 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 18:27:41.395452 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395420 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xvt8c\"" Jul 01 18:27:41.395562 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395541 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 18:27:41.395660 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395636 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 18:27:41.395919 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395764 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 18:27:41.395919 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.395845 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:27:41.396104 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.396078 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.396220 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.396207 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m8ztt\"" Jul 01 18:27:41.396427 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.396409 2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 18:27:41.396514 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.396466 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 18:27:41.396994 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.396976 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 18:27:41.397225 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.397201 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z5chw\"" Jul 01 18:27:41.397693 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.397675 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 18:27:41.399760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.399744 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:41.399886 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.399864 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:41.400457 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.400418 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:27:41.400528 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.400482 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 18:27:41.400615 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.400593 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-znz9s\"" Jul 01 18:27:41.400693 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.400616 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 18:27:41.400745 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.400724 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.401805 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.401784 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.402643 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.403131 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.405121 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.405355 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.405531 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.405588 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.405619 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.405765 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-98v95\"" Jul 01 18:27:41.406155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.405895 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 18:27:41.406620 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.406443 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 18:27:41.407258 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.406940 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6l8dk\"" Jul 01 18:27:41.407258 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.407055 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 18:27:41.408983 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.408963 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-system-cni-dir\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.409064 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.408998 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cnibin\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.409064 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409025 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.409064 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409049 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46552\" (UniqueName: \"kubernetes.io/projected/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-kube-api-access-46552\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.409230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409075 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-sys-fs\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.409230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409099 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-k8s-cni-cncf-io\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.409230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409122 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-netns\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.409230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409144 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.409230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409167 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-registration-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.409230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409188 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-lib-modules\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409226 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbx6f\" (UniqueName: \"kubernetes.io/projected/301e4bc3-328a-443a-9f1d-d1d17c5b251e-kube-api-access-cbx6f\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409250 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-socket-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409278 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-conf-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409302 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-multus-certs\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409365 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysconfig\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409406 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-kubernetes\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409431 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwsk\" (UniqueName: \"kubernetes.io/projected/5adae018-0587-4082-af6e-83942a076cb7-kube-api-access-rtwsk\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409466 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409489 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-socket-dir-parent\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.409513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409512 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-cni-bin\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409547 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a223020-b30b-4c4d-a467-91cd848a0944-multus-daemon-config\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409556 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409567 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-modprobe-d\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409582 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysctl-conf\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.409647 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409675 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-run\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409708 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-tuned\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409732 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-tmp-dir\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409759 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6tzg\" (UniqueName: \"kubernetes.io/projected/7e8bd3f8-02b3-42ad-af51-d3b41977d678-kube-api-access-s6tzg\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409783 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-os-release\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409806 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-systemd\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409829 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-var-lib-kubelet\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409858 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-hosts-file\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.409885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409879 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5adae018-0587-4082-af6e-83942a076cb7-host-slash\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409899 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-cnibin\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409924 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a223020-b30b-4c4d-a467-91cd848a0944-cni-binary-copy\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409945 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-etc-kubernetes\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409969 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.409993 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysctl-d\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410022 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5adae018-0587-4082-af6e-83942a076cb7-iptables-alerter-script\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410045 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-system-cni-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410068 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-cni-multus\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410090 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-hostroot\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410112 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5gdh\" (UniqueName: \"kubernetes.io/projected/3a223020-b30b-4c4d-a467-91cd848a0944-kube-api-access-w5gdh\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410135 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410159 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410179 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-host\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410203 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-kubelet\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410228 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.410517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410252 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx75w\" (UniqueName: \"kubernetes.io/projected/31b2e3bc-3f08-47a7-ac4a-361b7749430d-kube-api-access-bx75w\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.411127 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410272 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-sys\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.411127 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410294 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/301e4bc3-328a-443a-9f1d-d1d17c5b251e-tmp\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.411127 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410315 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-cni-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.411127 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410337 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-os-release\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.411127 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.410359 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-device-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.411525 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.411509 2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:27:41.412333 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.412314 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.414910 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.414890 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 18:27:41.415584 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.415566 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 18:27:41.415779 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.415754 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 18:27:41.416039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.416022 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gf7xc\"" Jul 01 18:27:41.431921 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.431900 2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4m25f" Jul 01 18:27:41.440666 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.440646 2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4m25f" Jul 01 18:27:41.497915 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.497888 2528 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 18:27:41.510985 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.510957 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-netns\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.510985 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.510995 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511020 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-conf-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511043 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysconfig\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511065 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-systemd\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511080 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-netns\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511086 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-socket-dir-parent\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511108 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysconfig\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511111 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-conf-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511126 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a223020-b30b-4c4d-a467-91cd848a0944-multus-daemon-config\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.511215 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511129 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-socket-dir-parent\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511410 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-modprobe-d\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511181 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-modprobe-d\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511679 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-tuned\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511712 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6tzg\" (UniqueName: \"kubernetes.io/projected/7e8bd3f8-02b3-42ad-af51-d3b41977d678-kube-api-access-s6tzg\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511718 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a223020-b30b-4c4d-a467-91cd848a0944-multus-daemon-config\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511737 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-systemd\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511768 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-hosts-file\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511796 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5adae018-0587-4082-af6e-83942a076cb7-host-slash\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511824 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-cni-bin\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.511862 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511852 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a223020-b30b-4c4d-a467-91cd848a0944-cni-binary-copy\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511875 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-etc-kubernetes\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511901 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/555d68e5-e953-48a7-92fe-abd2fc0ca36d-agent-certs\") pod \"konnectivity-agent-996n2\" (UID: \"555d68e5-e953-48a7-92fe-abd2fc0ca36d\") " pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511925 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/301e4bc3-328a-443a-9f1d-d1d17c5b251e-tmp\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511952 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5gdh\" (UniqueName: \"kubernetes.io/projected/3a223020-b30b-4c4d-a467-91cd848a0944-kube-api-access-w5gdh\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.511981 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512007 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-host\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512026 2528 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512031 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x5bk\" (UniqueName: \"kubernetes.io/projected/353fcc95-ba74-4841-b484-60d98f3971aa-kube-api-access-5x5bk\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512061 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-kubelet\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512087 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512114 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa514adf-5a6e-4c8e-85be-661f9c10de48-kubelet-config\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512144 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512179 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-node-log\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512203 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-cni-netd\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512230 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-device-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512255 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-system-cni-dir\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.512337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512283 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cnibin\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512310 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-var-lib-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512336 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/555d68e5-e953-48a7-92fe-abd2fc0ca36d-konnectivity-ca\") pod \"konnectivity-agent-996n2\" (UID: \"555d68e5-e953-48a7-92fe-abd2fc0ca36d\") " pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512361 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-sys-fs\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512407 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512432 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-registration-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512458 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-lib-modules\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512482 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbx6f\" (UniqueName: \"kubernetes.io/projected/301e4bc3-328a-443a-9f1d-d1d17c5b251e-kube-api-access-cbx6f\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512511 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-systemd-units\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512520 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-systemd\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512536 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-log-socket\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512579 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-hosts-file\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512608 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-socket-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512637 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-multus-certs\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512662 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-kubernetes\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512719 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512782 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-host\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512798 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwsk\" (UniqueName: \"kubernetes.io/projected/5adae018-0587-4082-af6e-83942a076cb7-kube-api-access-rtwsk\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.512843 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-kubelet\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513168 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-socket-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513218 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-multus-certs\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513265 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-kubernetes\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513405 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513454 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513562 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-etc-kubernetes\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513570 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-device-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513619 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-system-cni-dir\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513662 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cnibin\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513688 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-lib-modules\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513688 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-ovnkube-config\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513713 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-cni-bin\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513740 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5adae018-0587-4082-af6e-83942a076cb7-host-slash\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513782 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysctl-conf\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513809 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-run\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.513952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513814 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-cni-bin\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513780 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513842 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-tmp-dir\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513869 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-kubelet\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513871 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-sys-fs\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513893 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-ovn\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513910 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-run\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513945 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-ovnkube-script-lib\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513973 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-os-release\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.513997 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-var-lib-kubelet\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514022 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514031 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysctl-conf\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514061 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/730c0b6a-43db-46dc-8734-a13b46596717-serviceca\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514083 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-cnibin\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514090 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-registration-dir\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514098 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514118 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a223020-b30b-4c4d-a467-91cd848a0944-cni-binary-copy\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.514764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514160 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e8bd3f8-02b3-42ad-af51-d3b41977d678-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514181 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-cnibin\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514325 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysctl-d\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514350 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5adae018-0587-4082-af6e-83942a076cb7-iptables-alerter-script\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514362 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-var-lib-kubelet\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514370 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31b2e3bc-3f08-47a7-ac4a-361b7749430d-os-release\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514413 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-tmp-dir\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514392 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa514adf-5a6e-4c8e-85be-661f9c10de48-dbus\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514489 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-system-cni-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514518 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-cni-multus\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514524 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-sysctl-d\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514542 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-hostroot\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514569 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514581 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-system-cni-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514598 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/730c0b6a-43db-46dc-8734-a13b46596717-host\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514620 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-hostroot\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514623 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-run-netns\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514651 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-etc-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.515532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514678 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514729 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx75w\" (UniqueName: \"kubernetes.io/projected/31b2e3bc-3f08-47a7-ac4a-361b7749430d-kube-api-access-bx75w\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514755 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-sys\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514778 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514803 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-env-overrides\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514829 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/353fcc95-ba74-4841-b484-60d98f3971aa-ovn-node-metrics-cert\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514853 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88g4v\" (UniqueName: \"kubernetes.io/projected/2811d697-4951-498a-9f2a-9b24db3d320d-kube-api-access-88g4v\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514912 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-cni-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514939 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-os-release\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514966 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514991 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46552\" (UniqueName: \"kubernetes.io/projected/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-kube-api-access-46552\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515018 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lbvb\" (UniqueName: \"kubernetes.io/projected/730c0b6a-43db-46dc-8734-a13b46596717-kube-api-access-5lbvb\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515041 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-slash\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515048 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5adae018-0587-4082-af6e-83942a076cb7-iptables-alerter-script\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515066 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-k8s-cni-cncf-io\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515089 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515113 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-run-k8s-cni-cncf-io\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.516326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.514653 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-host-var-lib-cni-multus\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.517097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515175 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-os-release\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.517097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515284 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/301e4bc3-328a-443a-9f1d-d1d17c5b251e-sys\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.517097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.515943 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a223020-b30b-4c4d-a467-91cd848a0944-multus-cni-dir\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.517097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.516132 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/301e4bc3-328a-443a-9f1d-d1d17c5b251e-etc-tuned\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.517097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.516580 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31b2e3bc-3f08-47a7-ac4a-361b7749430d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.519824 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.519800 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/301e4bc3-328a-443a-9f1d-d1d17c5b251e-tmp\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.520645 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.520622 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:41.520645 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.520648 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:41.520786 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.520659 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bv7k2 for pod openshift-network-diagnostics/network-check-target-mznv5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:41.520786 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.520730 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2 podName:2ca26a65-0c70-48df-a83e-e6be1ad19492 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:42.020714135 +0000 UTC m=+2.999716485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bv7k2" (UniqueName: "kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2") pod "network-check-target-mznv5" (UID: "2ca26a65-0c70-48df-a83e-e6be1ad19492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:41.523305 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.523283 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbx6f\" (UniqueName: \"kubernetes.io/projected/301e4bc3-328a-443a-9f1d-d1d17c5b251e-kube-api-access-cbx6f\") pod \"tuned-qrkjt\" (UID: \"301e4bc3-328a-443a-9f1d-d1d17c5b251e\") " pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.523944 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.523922 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwsk\" (UniqueName: \"kubernetes.io/projected/5adae018-0587-4082-af6e-83942a076cb7-kube-api-access-rtwsk\") pod \"iptables-alerter-zg4hl\" (UID: \"5adae018-0587-4082-af6e-83942a076cb7\") " pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.524139 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.524122 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5gdh\" (UniqueName: \"kubernetes.io/projected/3a223020-b30b-4c4d-a467-91cd848a0944-kube-api-access-w5gdh\") pod \"multus-64mdz\" (UID: \"3a223020-b30b-4c4d-a467-91cd848a0944\") " pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.525681 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.525655 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6tzg\" (UniqueName: \"kubernetes.io/projected/7e8bd3f8-02b3-42ad-af51-d3b41977d678-kube-api-access-s6tzg\") pod \"aws-ebs-csi-driver-node-xrdhn\" (UID: \"7e8bd3f8-02b3-42ad-af51-d3b41977d678\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.527238 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.527217 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx75w\" (UniqueName: \"kubernetes.io/projected/31b2e3bc-3f08-47a7-ac4a-361b7749430d-kube-api-access-bx75w\") pod \"multus-additional-cni-plugins-5g9cg\" (UID: \"31b2e3bc-3f08-47a7-ac4a-361b7749430d\") " pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.527690 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.527671 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46552\" (UniqueName: \"kubernetes.io/projected/73bf0e9b-9b1b-4c6e-af6b-291cd8440054-kube-api-access-46552\") pod \"node-resolver-8zgz4\" (UID: \"73bf0e9b-9b1b-4c6e-af6b-291cd8440054\") " pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.616140 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616106 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa514adf-5a6e-4c8e-85be-661f9c10de48-dbus\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.616326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616148 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/730c0b6a-43db-46dc-8734-a13b46596717-host\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.616326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616175 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-run-netns\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616226 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/730c0b6a-43db-46dc-8734-a13b46596717-host\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.616326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616258 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-etc-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616292 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:41.616326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616319 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616331 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa514adf-5a6e-4c8e-85be-661f9c10de48-dbus\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616345 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-env-overrides\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616351 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-run-netns\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616367 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/353fcc95-ba74-4841-b484-60d98f3971aa-ovn-node-metrics-cert\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616419 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616318 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-etc-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.616455 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616460 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88g4v\" (UniqueName: \"kubernetes.io/projected/2811d697-4951-498a-9f2a-9b24db3d320d-kube-api-access-88g4v\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616492 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lbvb\" (UniqueName: \"kubernetes.io/projected/730c0b6a-43db-46dc-8734-a13b46596717-kube-api-access-5lbvb\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.616524 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs podName:2811d697-4951-498a-9f2a-9b24db3d320d nodeName:}" failed. No retries permitted until 2026-07-01 18:27:42.116505029 +0000 UTC m=+3.095507376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs") pod "network-metrics-daemon-5j9jb" (UID: "2811d697-4951-498a-9f2a-9b24db3d320d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616541 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-slash\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616569 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616597 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-systemd\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.616627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616628 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-cni-bin\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616653 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/555d68e5-e953-48a7-92fe-abd2fc0ca36d-agent-certs\") pod \"konnectivity-agent-996n2\" (UID: \"555d68e5-e953-48a7-92fe-abd2fc0ca36d\") " pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616680 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x5bk\" (UniqueName: \"kubernetes.io/projected/353fcc95-ba74-4841-b484-60d98f3971aa-kube-api-access-5x5bk\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616707 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa514adf-5a6e-4c8e-85be-661f9c10de48-kubelet-config\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616730 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616751 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-node-log\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616760 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-env-overrides\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616774 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-cni-netd\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616804 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-cni-bin\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616804 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-var-lib-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616830 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/555d68e5-e953-48a7-92fe-abd2fc0ca36d-konnectivity-ca\") pod \"konnectivity-agent-996n2\" (UID: \"555d68e5-e953-48a7-92fe-abd2fc0ca36d\") " pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616839 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-var-lib-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616852 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-systemd-units\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616859 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa514adf-5a6e-4c8e-85be-661f9c10de48-kubelet-config\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616883 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-node-log\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616896 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-systemd\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616902 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.617132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616906 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-log-socket\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616955 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-openvswitch\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.616956 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-slash\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617042 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-cni-netd\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617095 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-ovnkube-config\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617140 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-log-socket\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617175 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-kubelet\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617199 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-ovn\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617214 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-ovnkube-script-lib\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617239 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-host-kubelet\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617260 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-run-ovn\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617260 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/353fcc95-ba74-4841-b484-60d98f3971aa-systemd-units\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617442 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.617527 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:41.617570 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret podName:fa514adf-5a6e-4c8e-85be-661f9c10de48 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:42.117555655 +0000 UTC m=+3.096557986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret") pod "global-pull-secret-syncer-zl55s" (UID: "fa514adf-5a6e-4c8e-85be-661f9c10de48") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617600 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/730c0b6a-43db-46dc-8734-a13b46596717-serviceca\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617614 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-ovnkube-config\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617763 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/555d68e5-e953-48a7-92fe-abd2fc0ca36d-konnectivity-ca\") pod \"konnectivity-agent-996n2\" (UID: \"555d68e5-e953-48a7-92fe-abd2fc0ca36d\") " pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.618897 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617774 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/353fcc95-ba74-4841-b484-60d98f3971aa-ovnkube-script-lib\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.618897 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.617896 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/730c0b6a-43db-46dc-8734-a13b46596717-serviceca\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.619257 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.619199 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/353fcc95-ba74-4841-b484-60d98f3971aa-ovn-node-metrics-cert\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.619550 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.619523 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/555d68e5-e953-48a7-92fe-abd2fc0ca36d-agent-certs\") pod \"konnectivity-agent-996n2\" (UID: \"555d68e5-e953-48a7-92fe-abd2fc0ca36d\") " pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.627661 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.627637 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88g4v\" (UniqueName: \"kubernetes.io/projected/2811d697-4951-498a-9f2a-9b24db3d320d-kube-api-access-88g4v\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:41.628102 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.628084 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x5bk\" (UniqueName: \"kubernetes.io/projected/353fcc95-ba74-4841-b484-60d98f3971aa-kube-api-access-5x5bk\") pod \"ovnkube-node-8gmwz\" (UID: \"353fcc95-ba74-4841-b484-60d98f3971aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.628446 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.628430 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lbvb\" (UniqueName: \"kubernetes.io/projected/730c0b6a-43db-46dc-8734-a13b46596717-kube-api-access-5lbvb\") pod \"node-ca-jzlrj\" (UID: \"730c0b6a-43db-46dc-8734-a13b46596717\") " pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:41.707155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.707108 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64mdz" Jul 01 18:27:41.713051 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.713024 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" Jul 01 18:27:41.723122 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.723100 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" Jul 01 18:27:41.728801 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.728782 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" Jul 01 18:27:41.737436 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.737415 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8zgz4" Jul 01 18:27:41.744049 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.744032 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zg4hl" Jul 01 18:27:41.749795 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.749775 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:27:41.755447 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.755428 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-996n2" Jul 01 18:27:41.760858 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:41.760839 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jzlrj" Jul 01 18:27:42.120793 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.120677 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:42.120793 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.120728 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:42.120793 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.120763 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120857 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120868 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120876 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120899 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120911 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bv7k2 for pod openshift-network-diagnostics/network-check-target-mznv5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120916 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret podName:fa514adf-5a6e-4c8e-85be-661f9c10de48 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:43.120901831 +0000 UTC m=+4.099904180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret") pod "global-pull-secret-syncer-zl55s" (UID: "fa514adf-5a6e-4c8e-85be-661f9c10de48") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120932 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs podName:2811d697-4951-498a-9f2a-9b24db3d320d nodeName:}" failed. No retries permitted until 2026-07-01 18:27:43.120924618 +0000 UTC m=+4.099926948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs") pod "network-metrics-daemon-5j9jb" (UID: "2811d697-4951-498a-9f2a-9b24db3d320d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:42.121051 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.120958 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2 podName:2ca26a65-0c70-48df-a83e-e6be1ad19492 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:43.120942603 +0000 UTC m=+4.099944934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bv7k2" (UniqueName: "kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2") pod "network-check-target-mznv5" (UID: "2ca26a65-0c70-48df-a83e-e6be1ad19492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:42.400744 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:42.400690 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a223020_b30b_4c4d_a467_91cd848a0944.slice/crio-b658eaff1330911edcdbae294869b9dab58cad8adb3324e0a0bf0cf247c2155f WatchSource:0}: Error finding container b658eaff1330911edcdbae294869b9dab58cad8adb3324e0a0bf0cf247c2155f: Status 404 returned error can't find the container with id b658eaff1330911edcdbae294869b9dab58cad8adb3324e0a0bf0cf247c2155f Jul 01 18:27:42.403631 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:42.403608 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8bd3f8_02b3_42ad_af51_d3b41977d678.slice/crio-1d6b705e4a988299dbffabc539825f22e6cfb30dcc235ae033dae166ac5ff5e4 WatchSource:0}: Error finding container 1d6b705e4a988299dbffabc539825f22e6cfb30dcc235ae033dae166ac5ff5e4: Status 404 returned error can't find the container with id 1d6b705e4a988299dbffabc539825f22e6cfb30dcc235ae033dae166ac5ff5e4 Jul 01 18:27:42.405611 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:42.405520 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b2e3bc_3f08_47a7_ac4a_361b7749430d.slice/crio-33b6086db4f7cb7c3b85d75b0b0db80c6c77bba495fc402921e4e769973b883b WatchSource:0}: Error finding container 33b6086db4f7cb7c3b85d75b0b0db80c6c77bba495fc402921e4e769973b883b: Status 404 returned error can't find the container with id 33b6086db4f7cb7c3b85d75b0b0db80c6c77bba495fc402921e4e769973b883b Jul 01 18:27:42.409719 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:42.409695 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301e4bc3_328a_443a_9f1d_d1d17c5b251e.slice/crio-4e641a713bc6f4ffd6a311fc929ccb914226e62a785ba037d60d3706a0efc5a4 WatchSource:0}: Error finding container 4e641a713bc6f4ffd6a311fc929ccb914226e62a785ba037d60d3706a0efc5a4: Status 404 returned error can't find the container with id 4e641a713bc6f4ffd6a311fc929ccb914226e62a785ba037d60d3706a0efc5a4 Jul 01 18:27:42.411472 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:42.411439 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353fcc95_ba74_4841_b484_60d98f3971aa.slice/crio-fb3505d4444f0d6043f59abd9b5cf257a078f5e1f7eb85719ca37151c3c492de WatchSource:0}: Error finding container fb3505d4444f0d6043f59abd9b5cf257a078f5e1f7eb85719ca37151c3c492de: Status 404 returned error can't find the container with id fb3505d4444f0d6043f59abd9b5cf257a078f5e1f7eb85719ca37151c3c492de Jul 01 18:27:42.412464 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:42.412445 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5adae018_0587_4082_af6e_83942a076cb7.slice/crio-02a4b8ecb7228569f2e4d7fe0827fcb55c7d475ccee961acb1350a6cfe29bf32 WatchSource:0}: Error finding container 02a4b8ecb7228569f2e4d7fe0827fcb55c7d475ccee961acb1350a6cfe29bf32: Status 404 returned error can't find the container with id 02a4b8ecb7228569f2e4d7fe0827fcb55c7d475ccee961acb1350a6cfe29bf32 Jul 01 18:27:42.414095 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:27:42.414031 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555d68e5_e953_48a7_92fe_abd2fc0ca36d.slice/crio-c1f0e4bf57176b1ec5e1cd6703dfa63fd7b0b1de226235e51b25bd80cafa98e4 WatchSource:0}: Error finding container c1f0e4bf57176b1ec5e1cd6703dfa63fd7b0b1de226235e51b25bd80cafa98e4: Status 404 returned error can't find the container with id c1f0e4bf57176b1ec5e1cd6703dfa63fd7b0b1de226235e51b25bd80cafa98e4 Jul 01 18:27:42.442721 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.442684 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:22:41 +0000 UTC" deadline="2028-02-16 01:37:31.474156979 +0000 UTC" Jul 01 18:27:42.442721 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.442720 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14263h9m49.0314391s" Jul 01 18:27:42.471259 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.471240 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:42.471362 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:42.471344 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:42.479924 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.479898 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jzlrj" event={"ID":"730c0b6a-43db-46dc-8734-a13b46596717","Type":"ContainerStarted","Data":"1be1035e619f9444a8ddc2f053eaef543a4864c39242f1b512f6ad5913615bc9"} Jul 01 18:27:42.480912 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.480893 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-996n2" event={"ID":"555d68e5-e953-48a7-92fe-abd2fc0ca36d","Type":"ContainerStarted","Data":"c1f0e4bf57176b1ec5e1cd6703dfa63fd7b0b1de226235e51b25bd80cafa98e4"} Jul 01 18:27:42.481876 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.481857 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zg4hl" event={"ID":"5adae018-0587-4082-af6e-83942a076cb7","Type":"ContainerStarted","Data":"02a4b8ecb7228569f2e4d7fe0827fcb55c7d475ccee961acb1350a6cfe29bf32"} Jul 01 18:27:42.482882 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.482848 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"fb3505d4444f0d6043f59abd9b5cf257a078f5e1f7eb85719ca37151c3c492de"} Jul 01 18:27:42.483930 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.483906 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" event={"ID":"301e4bc3-328a-443a-9f1d-d1d17c5b251e","Type":"ContainerStarted","Data":"4e641a713bc6f4ffd6a311fc929ccb914226e62a785ba037d60d3706a0efc5a4"} Jul 01 18:27:42.485045 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.485027 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8zgz4" event={"ID":"73bf0e9b-9b1b-4c6e-af6b-291cd8440054","Type":"ContainerStarted","Data":"3d66aade7780ca5aacf0e35ee13569d39fa5583f91795876c116cc1c3587d5c9"} Jul 01 18:27:42.486075 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.486056 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerStarted","Data":"33b6086db4f7cb7c3b85d75b0b0db80c6c77bba495fc402921e4e769973b883b"} Jul 01 18:27:42.487239 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.487218 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" event={"ID":"7e8bd3f8-02b3-42ad-af51-d3b41977d678","Type":"ContainerStarted","Data":"1d6b705e4a988299dbffabc539825f22e6cfb30dcc235ae033dae166ac5ff5e4"} Jul 01 18:27:42.488234 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:42.488215 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64mdz" event={"ID":"3a223020-b30b-4c4d-a467-91cd848a0944","Type":"ContainerStarted","Data":"b658eaff1330911edcdbae294869b9dab58cad8adb3324e0a0bf0cf247c2155f"} Jul 01 18:27:43.099092 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.098737 2528 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.128758 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.128813 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.128874 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129013 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129034 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129048 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bv7k2 for pod openshift-network-diagnostics/network-check-target-mznv5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129105 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2 podName:2ca26a65-0c70-48df-a83e-e6be1ad19492 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:45.129086163 +0000 UTC m=+6.108088520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bv7k2" (UniqueName: "kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2") pod "network-check-target-mznv5" (UID: "2ca26a65-0c70-48df-a83e-e6be1ad19492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129183 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129219 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret podName:fa514adf-5a6e-4c8e-85be-661f9c10de48 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:45.129207865 +0000 UTC m=+6.108210199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret") pod "global-pull-secret-syncer-zl55s" (UID: "fa514adf-5a6e-4c8e-85be-661f9c10de48") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129284 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:43.129695 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.129318 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs podName:2811d697-4951-498a-9f2a-9b24db3d320d nodeName:}" failed. No retries permitted until 2026-07-01 18:27:45.129305855 +0000 UTC m=+6.108308190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs") pod "network-metrics-daemon-5j9jb" (UID: "2811d697-4951-498a-9f2a-9b24db3d320d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:43.443724 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.443630 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:22:41 +0000 UTC" deadline="2028-04-17 15:25:50.582404384 +0000 UTC" Jul 01 18:27:43.443724 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.443673 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15740h58m7.138735899s" Jul 01 18:27:43.475465 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.474747 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:43.475465 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.474878 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:43.475465 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.475261 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:43.475465 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:43.475360 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:43.499590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.498956 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" event={"ID":"77380cf742ba9e9737750d6db3ca67d0","Type":"ContainerStarted","Data":"4b304d6acad88e692c82971f814308e0ccd27681ddabff9a3ac348315faba404"} Jul 01 18:27:43.508475 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.508446 2528 generic.go:356] "Generic (PLEG): container finished" podID="b5f7124e72f8c62bb57c9280d2e3d70f" containerID="69f41b41faa30b6bdaca8ed93d94b84dd600b6c22286031170f07ee75bcd2f2c" exitCode=0 Jul 01 18:27:43.508616 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.508493 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" event={"ID":"b5f7124e72f8c62bb57c9280d2e3d70f","Type":"ContainerDied","Data":"69f41b41faa30b6bdaca8ed93d94b84dd600b6c22286031170f07ee75bcd2f2c"} Jul 01 18:27:43.514819 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:43.514770 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-114.ec2.internal" podStartSLOduration=3.514753549 podStartE2EDuration="3.514753549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:43.514731492 +0000 UTC m=+4.493733843" watchObservedRunningTime="2026-07-01 18:27:43.514753549 +0000 UTC m=+4.493755899" Jul 01 18:27:44.472595 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:44.472115 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:44.472595 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:44.472249 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:44.521616 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:44.521555 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" event={"ID":"b5f7124e72f8c62bb57c9280d2e3d70f","Type":"ContainerStarted","Data":"35303c7ef9b8519f16499ba2418831f2baf2ca667f12e99712d0f8c5733e99d1"} Jul 01 18:27:45.147654 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:45.147619 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:45.147825 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:45.147667 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:45.147825 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:45.147698 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:45.147825 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.147820 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:45.147993 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.147875 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs podName:2811d697-4951-498a-9f2a-9b24db3d320d nodeName:}" failed. No retries permitted until 2026-07-01 18:27:49.147859377 +0000 UTC m=+10.126861727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs") pod "network-metrics-daemon-5j9jb" (UID: "2811d697-4951-498a-9f2a-9b24db3d320d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:45.148268 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.148248 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:45.148341 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.148274 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:45.148341 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.148290 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bv7k2 for pod openshift-network-diagnostics/network-check-target-mznv5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:45.148341 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.148327 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2 podName:2ca26a65-0c70-48df-a83e-e6be1ad19492 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:49.148316575 +0000 UTC m=+10.127318918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bv7k2" (UniqueName: "kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2") pod "network-check-target-mznv5" (UID: "2ca26a65-0c70-48df-a83e-e6be1ad19492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:45.148534 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.148402 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:45.148534 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.148438 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret podName:fa514adf-5a6e-4c8e-85be-661f9c10de48 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:49.148426119 +0000 UTC m=+10.127428453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret") pod "global-pull-secret-syncer-zl55s" (UID: "fa514adf-5a6e-4c8e-85be-661f9c10de48") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:45.471863 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:45.471789 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:45.472034 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.471957 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:45.472362 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:45.471787 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:45.472496 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:45.472473 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:46.471822 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:46.471782 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:46.472184 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:46.471899 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:47.471370 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:47.471321 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:47.471532 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:47.471410 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:47.471532 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:47.471519 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:47.473605 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:47.473542 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:48.471647 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:48.471612 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:48.471803 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:48.471763 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:49.183641 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:49.183590 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:49.184115 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:49.183666 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:49.184115 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:49.183694 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:49.184115 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.183823 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:49.184115 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.183925 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret podName:fa514adf-5a6e-4c8e-85be-661f9c10de48 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:57.183906314 +0000 UTC m=+18.162908650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret") pod "global-pull-secret-syncer-zl55s" (UID: "fa514adf-5a6e-4c8e-85be-661f9c10de48") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:49.184359 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.184312 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:49.184447 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.184392 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs podName:2811d697-4951-498a-9f2a-9b24db3d320d nodeName:}" failed. No retries permitted until 2026-07-01 18:27:57.184349525 +0000 UTC m=+18.163351861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs") pod "network-metrics-daemon-5j9jb" (UID: "2811d697-4951-498a-9f2a-9b24db3d320d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:49.184507 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.184471 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:49.184507 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.184488 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:49.184507 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.184499 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bv7k2 for pod openshift-network-diagnostics/network-check-target-mznv5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:49.184655 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.184536 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2 podName:2ca26a65-0c70-48df-a83e-e6be1ad19492 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:57.184524092 +0000 UTC m=+18.163526426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bv7k2" (UniqueName: "kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2") pod "network-check-target-mznv5" (UID: "2ca26a65-0c70-48df-a83e-e6be1ad19492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:49.473063 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:49.472994 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:49.473421 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.473393 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:49.473935 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:49.473915 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:49.474150 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:49.474131 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:50.471879 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:50.471848 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:50.472355 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:50.471973 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:51.473340 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:51.473309 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:51.473826 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:51.473434 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:51.473826 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:51.473783 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:51.473953 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:51.473880 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:52.472306 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:52.472092 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:52.472491 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:52.472417 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:53.471677 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:53.471593 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:53.472078 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:53.471745 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:53.472078 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:53.471810 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:53.472078 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:53.471937 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:54.471633 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:54.471601 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:54.471817 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:54.471722 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:55.471773 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:55.471743 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:55.472019 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:55.471880 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:55.472019 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:55.471943 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:55.472441 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:55.472047 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:56.471679 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:56.471639 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:56.471885 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:56.471763 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:57.248784 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:57.248757 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:57.248784 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:57.248790 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:57.248853 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.248966 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.248983 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.248997 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bv7k2 for pod openshift-network-diagnostics/network-check-target-mznv5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.248994 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.249067 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2 podName:2ca26a65-0c70-48df-a83e-e6be1ad19492 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:13.249046836 +0000 UTC m=+34.228049183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bv7k2" (UniqueName: "kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2") pod "network-check-target-mznv5" (UID: "2ca26a65-0c70-48df-a83e-e6be1ad19492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.249081 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.249086 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret podName:fa514adf-5a6e-4c8e-85be-661f9c10de48 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:13.249076674 +0000 UTC m=+34.228079004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret") pod "global-pull-secret-syncer-zl55s" (UID: "fa514adf-5a6e-4c8e-85be-661f9c10de48") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:57.249228 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.249144 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs podName:2811d697-4951-498a-9f2a-9b24db3d320d nodeName:}" failed. No retries permitted until 2026-07-01 18:28:13.249125031 +0000 UTC m=+34.228127364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs") pod "network-metrics-daemon-5j9jb" (UID: "2811d697-4951-498a-9f2a-9b24db3d320d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:57.474213 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:57.474185 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:57.474361 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.474315 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:27:57.474728 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:57.474702 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:57.474850 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:57.474827 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:58.472126 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:58.472085 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:27:58.472528 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:58.472227 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:27:59.472686 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:59.472656 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:27:59.473039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:27:59.472740 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:27:59.473039 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:59.472761 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:27:59.473039 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:27:59.472857 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:00.471620 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:00.471585 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:00.471792 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:00.471699 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:01.485294 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:01.480826 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:01.485294 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:01.481231 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:01.485294 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:01.481360 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:01.485294 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:01.481651 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:01.563131 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:01.562723 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" event={"ID":"301e4bc3-328a-443a-9f1d-d1d17c5b251e","Type":"ContainerStarted","Data":"6b8c850bd03522197d2579998a0d707871f834a1f6c9120ff4e1ffda306140d2"} Jul 01 18:28:01.580630 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:01.579414 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qrkjt" podStartSLOduration=3.583659569 podStartE2EDuration="22.579395353s" totalImagesPullingTime="18.995735784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:01.579329246 +0000 UTC m=+22.558331599" watchObservedRunningTime="2026-07-01 18:28:01.579395353 +0000 UTC m=+22.558397697" Jul 01 18:28:01.580630 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:01.579596 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-114.ec2.internal" podStartSLOduration=21.579587172 podStartE2EDuration="21.579587172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:44.539885189 +0000 UTC m=+5.518887545" watchObservedRunningTime="2026-07-01 18:28:01.579587172 +0000 UTC m=+22.558589526" Jul 01 18:28:02.471992 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.471810 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:02.472162 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:02.472091 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:02.566571 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.566541 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jzlrj" event={"ID":"730c0b6a-43db-46dc-8734-a13b46596717","Type":"ContainerStarted","Data":"61c71784a00a6ae3b5e66e20a140e488290e93e0f100d50bbc48be7a4fe944d2"} Jul 01 18:28:02.567961 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.567932 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-996n2" event={"ID":"555d68e5-e953-48a7-92fe-abd2fc0ca36d","Type":"ContainerStarted","Data":"617096a540ce8dd6bb182677f8227a878b46b3049d6590d94778c3de34ac0079"} Jul 01 18:28:02.570791 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.570768 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:28:02.571112 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.571093 2528 generic.go:356] "Generic (PLEG): container finished" podID="353fcc95-ba74-4841-b484-60d98f3971aa" containerID="7edcf5725f7449547a988ebd44e9e1a92cda84de00d7baf108cb9ea888b2a3d7" exitCode=1 Jul 01 18:28:02.571210 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.571151 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"eaff74c3032e460613e4cbc6f996372f246eed1a6117e189a3023b04e9f243b4"} Jul 01 18:28:02.571268 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.571211 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"b4ac4aa59411163c281117ecea8c101280890d036c970f6014fa7a870490fb96"} Jul 01 18:28:02.571268 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.571243 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"be881052fe84adc21d29e2fe41873c4c19715bb0ba4b187d6c32fc243e1529b9"} Jul 01 18:28:02.571346 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.571282 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"5dfa4f8b222f9835b3e614b62c854991d06b958f3100eebb3a0733a140e85bf9"} Jul 01 18:28:02.571346 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.571310 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerDied","Data":"7edcf5725f7449547a988ebd44e9e1a92cda84de00d7baf108cb9ea888b2a3d7"} Jul 01 18:28:02.571346 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.571339 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"02714df99c970773874b5931d4bd69e7e287388ac280576471495371db0df16a"} Jul 01 18:28:02.572471 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.572449 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8zgz4" event={"ID":"73bf0e9b-9b1b-4c6e-af6b-291cd8440054","Type":"ContainerStarted","Data":"21df3ff19e849a57ae757638823afbeec79f03d95b241f0de3c8713d9ca67b4c"} Jul 01 18:28:02.573811 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.573793 2528 generic.go:356] "Generic (PLEG): container finished" podID="31b2e3bc-3f08-47a7-ac4a-361b7749430d" containerID="1ba7fb055b5fe8692128f536e9e080da9667939189318642e98d57c62d8a7d14" exitCode=0 Jul 01 18:28:02.573898 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.573866 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerDied","Data":"1ba7fb055b5fe8692128f536e9e080da9667939189318642e98d57c62d8a7d14"} Jul 01 18:28:02.575326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.575306 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" event={"ID":"7e8bd3f8-02b3-42ad-af51-d3b41977d678","Type":"ContainerStarted","Data":"2612447c2a56bb70396bb0407ce5508d2d4cf354988f1c18662f4002a65530b2"} Jul 01 18:28:02.576768 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.576748 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64mdz" event={"ID":"3a223020-b30b-4c4d-a467-91cd848a0944","Type":"ContainerStarted","Data":"35c8d53f0860061d379be608b7dc77d48e0e5fd0f751df3a56881bdf125240f4"} Jul 01 18:28:02.587027 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.586994 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jzlrj" podStartSLOduration=4.600654424 podStartE2EDuration="23.586983761s" totalImagesPullingTime="18.986329337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:02.586947065 +0000 UTC m=+23.565949407" watchObservedRunningTime="2026-07-01 18:28:02.586983761 +0000 UTC m=+23.565986112" Jul 01 18:28:02.608317 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.608276 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-64mdz" podStartSLOduration=4.553489343 podStartE2EDuration="23.608262696s" totalImagesPullingTime="19.054773353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:02.607913068 +0000 UTC m=+23.586915420" watchObservedRunningTime="2026-07-01 18:28:02.608262696 +0000 UTC m=+23.587265048" Jul 01 18:28:02.648883 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.648845 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8zgz4" podStartSLOduration=4.653591971 podStartE2EDuration="23.648832852s" totalImagesPullingTime="18.995240881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:02.648635401 +0000 UTC m=+23.627637754" watchObservedRunningTime="2026-07-01 18:28:02.648832852 +0000 UTC m=+23.627835204" Jul 01 18:28:02.664994 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.664951 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-996n2" podStartSLOduration=12.78497922 podStartE2EDuration="23.664938604s" totalImagesPullingTime="10.879959384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:02.664721656 +0000 UTC m=+23.643724007" watchObservedRunningTime="2026-07-01 18:28:02.664938604 +0000 UTC m=+23.643940956" Jul 01 18:28:02.932084 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:02.931930 2528 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 18:28:03.466474 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.466351 2528 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T18:28:02.932081269Z","UUID":"e033dc06-4687-4813-ae47-04f9be5b0840","Handler":null,"Name":"","Endpoint":""} Jul 01 18:28:03.467987 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.467962 2528 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 18:28:03.468109 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.468010 2528 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 18:28:03.471484 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.471463 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:03.471615 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.471463 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:03.471615 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:03.471584 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:03.471728 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:03.471668 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:03.580529 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.580493 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zg4hl" event={"ID":"5adae018-0587-4082-af6e-83942a076cb7","Type":"ContainerStarted","Data":"1ad6d5f0a45f86c14b7a45f7a1224b285acacc7caeb988f87fa0aaa246da0227"} Jul 01 18:28:03.582632 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.582601 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" event={"ID":"7e8bd3f8-02b3-42ad-af51-d3b41977d678","Type":"ContainerStarted","Data":"ea38666dbac96b08bbfe14b8ff293de37e40bc4daf574482221de50b0df57c6c"} Jul 01 18:28:03.597060 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:03.597021 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zg4hl" podStartSLOduration=5.607600302 podStartE2EDuration="24.59700668s" totalImagesPullingTime="18.989406378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:03.59667509 +0000 UTC m=+24.575677444" watchObservedRunningTime="2026-07-01 18:28:03.59700668 +0000 UTC m=+24.576009032" Jul 01 18:28:04.471969 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:04.471903 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:04.472224 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:04.472030 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:04.587634 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:04.587599 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" event={"ID":"7e8bd3f8-02b3-42ad-af51-d3b41977d678","Type":"ContainerStarted","Data":"b700516a123644caae4c525ede87776eaa60c0a9c16426bdd33e9508fe9dc128"} Jul 01 18:28:04.591290 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:04.591259 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:28:04.591873 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:04.591837 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"8bafc3443c57657849f99f694b2054d186362a557523c278bfd9cc0bc925816a"} Jul 01 18:28:04.605775 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:04.605729 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrdhn" podStartSLOduration=4.35038023 podStartE2EDuration="25.605711307s" totalImagesPullingTime="21.255331077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:04.604901741 +0000 UTC m=+25.583904093" watchObservedRunningTime="2026-07-01 18:28:04.605711307 +0000 UTC m=+25.584713660" Jul 01 18:28:05.327458 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:05.327420 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-996n2" Jul 01 18:28:05.328115 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:05.328094 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-996n2" Jul 01 18:28:05.472863 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:05.471155 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:05.472863 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:05.471178 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:05.472863 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:05.471289 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:05.472863 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:05.471426 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:05.593998 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:05.593916 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-996n2" Jul 01 18:28:05.594569 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:05.594234 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-996n2" Jul 01 18:28:06.471738 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:06.471711 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:06.471893 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:06.471818 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:07.471910 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:07.471756 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:07.472458 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:07.471757 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:07.472458 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:07.471995 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:07.472458 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:07.472429 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:07.601799 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:07.601778 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:28:07.602142 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:07.602110 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"15bcade0b6bb58dbfded533e6ddd9363320f4ee62e2e4e4dea185b23be28f7b9"} Jul 01 18:28:07.602546 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:07.602534 2528 scope.go:117] "RemoveContainer" containerID="7edcf5725f7449547a988ebd44e9e1a92cda84de00d7baf108cb9ea888b2a3d7" Jul 01 18:28:08.471238 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.471205 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:08.471454 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:08.471323 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:08.609192 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.609159 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:28:08.609784 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.609591 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" event={"ID":"353fcc95-ba74-4841-b484-60d98f3971aa","Type":"ContainerStarted","Data":"1132caf8b6a8de933675101a7d9acb0db5eadc1204e764b86c8dce2d00c57c68"} Jul 01 18:28:08.610811 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.610790 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:28:08.611188 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.611176 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:28:08.611369 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.611349 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:28:08.619634 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.619462 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerDied","Data":"b0fac88beee458edcd20bcdc15bf881eaf002b80f94d56578afbb03f7a88a6c2"} Jul 01 18:28:08.619634 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.613640 2528 generic.go:356] "Generic (PLEG): container finished" podID="31b2e3bc-3f08-47a7-ac4a-361b7749430d" containerID="b0fac88beee458edcd20bcdc15bf881eaf002b80f94d56578afbb03f7a88a6c2" exitCode=0 Jul 01 18:28:08.638540 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.638515 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:28:08.639149 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.639131 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:28:08.644706 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:08.644664 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" podStartSLOduration=10.577596726 podStartE2EDuration="29.644651965s" totalImagesPullingTime="19.067055239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:08.644558253 +0000 UTC m=+29.623560604" watchObservedRunningTime="2026-07-01 18:28:08.644651965 +0000 UTC m=+29.623654317" Jul 01 18:28:09.473100 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.472944 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:09.473273 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.472999 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:09.473273 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:09.473161 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:09.473273 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:09.473245 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:09.501267 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.501240 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mznv5"] Jul 01 18:28:09.501372 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.501358 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:09.501504 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:09.501483 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:09.504636 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.504615 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zl55s"] Jul 01 18:28:09.505290 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.505268 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5j9jb"] Jul 01 18:28:09.623943 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.623909 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerStarted","Data":"f4d1ccfabcb904cb4dbd091a551a3f41b5c0595db6d025343d801ff27f65a557"} Jul 01 18:28:09.623943 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.623931 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:09.624506 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:09.623957 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:09.624506 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:09.624027 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:09.624655 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:09.624634 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:10.628121 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:10.628046 2528 generic.go:356] "Generic (PLEG): container finished" podID="31b2e3bc-3f08-47a7-ac4a-361b7749430d" containerID="f4d1ccfabcb904cb4dbd091a551a3f41b5c0595db6d025343d801ff27f65a557" exitCode=0 Jul 01 18:28:10.628536 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:10.628135 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerDied","Data":"f4d1ccfabcb904cb4dbd091a551a3f41b5c0595db6d025343d801ff27f65a557"} Jul 01 18:28:11.471890 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:11.471858 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:11.471890 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:11.471876 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:11.472114 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:11.471953 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:11.472114 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:11.472029 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:11.472114 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:11.472072 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:11.472222 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:11.472177 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:12.634908 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:12.634879 2528 generic.go:356] "Generic (PLEG): container finished" podID="31b2e3bc-3f08-47a7-ac4a-361b7749430d" containerID="3489886e6c6906483837eee025792a5d814b76fda219b2c6e74fe6d81ccbeb16" exitCode=0 Jul 01 18:28:12.635493 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:12.634919 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerDied","Data":"3489886e6c6906483837eee025792a5d814b76fda219b2c6e74fe6d81ccbeb16"} Jul 01 18:28:13.276007 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:13.275964 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:13.276176 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:13.276017 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:13.276176 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:13.276049 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276172 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276181 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276192 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276201 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276220 2528 projected.go:196] Error preparing data for projected volume kube-api-access-bv7k2 for pod openshift-network-diagnostics/network-check-target-mznv5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276256 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs podName:2811d697-4951-498a-9f2a-9b24db3d320d nodeName:}" failed. No retries permitted until 2026-07-01 18:28:45.276237357 +0000 UTC m=+66.255239704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs") pod "network-metrics-daemon-5j9jb" (UID: "2811d697-4951-498a-9f2a-9b24db3d320d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276279 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2 podName:2ca26a65-0c70-48df-a83e-e6be1ad19492 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:45.276263954 +0000 UTC m=+66.255266289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bv7k2" (UniqueName: "kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2") pod "network-check-target-mznv5" (UID: "2ca26a65-0c70-48df-a83e-e6be1ad19492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:28:13.276296 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.276300 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret podName:fa514adf-5a6e-4c8e-85be-661f9c10de48 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:45.276290115 +0000 UTC m=+66.255292468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret") pod "global-pull-secret-syncer-zl55s" (UID: "fa514adf-5a6e-4c8e-85be-661f9c10de48") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:28:13.472303 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:13.472271 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:13.472504 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:13.472271 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:13.472504 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.472417 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mznv5" podUID="2ca26a65-0c70-48df-a83e-e6be1ad19492" Jul 01 18:28:13.472641 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.472560 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zl55s" podUID="fa514adf-5a6e-4c8e-85be-661f9c10de48" Jul 01 18:28:13.472641 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:13.472632 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:13.472759 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:13.472732 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j9jb" podUID="2811d697-4951-498a-9f2a-9b24db3d320d" Jul 01 18:28:14.307960 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.307780 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-114.ec2.internal" event="NodeReady" Jul 01 18:28:14.308366 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.308080 2528 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 18:28:14.353298 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.353189 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h9fw2"] Jul 01 18:28:14.355115 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.355089 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.356856 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.356834 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r7ls9"] Jul 01 18:28:14.357759 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.357736 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 18:28:14.358534 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.358509 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 18:28:14.358672 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.358655 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.359089 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.359069 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5x58v\"" Jul 01 18:28:14.363774 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.363747 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 18:28:14.363915 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.363874 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 18:28:14.364048 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.364029 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hxnf9\"" Jul 01 18:28:14.364869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.364612 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 18:28:14.368476 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.368455 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9fw2"] Jul 01 18:28:14.375200 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.375183 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r7ls9"] Jul 01 18:28:14.382574 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.382556 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nmblh"] Jul 01 18:28:14.384407 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.384366 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.386930 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.386909 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 18:28:14.387285 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.387268 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 18:28:14.387437 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.387412 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ngz2\"" Jul 01 18:28:14.387528 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.387458 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 18:28:14.387688 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.387674 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 18:28:14.399650 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.399630 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmblh"] Jul 01 18:28:14.402421 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.402398 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb"] Jul 01 18:28:14.404210 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.404193 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.406965 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.406912 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pdz5b\"" Jul 01 18:28:14.407060 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.406966 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 18:28:14.407177 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.407162 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 18:28:14.407243 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.407196 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 18:28:14.407623 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.407599 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:28:14.417439 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.417422 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb"] Jul 01 18:28:14.486277 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486247 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4da1690-8a11-4f38-baf0-49102bf9aab1-config-volume\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.486489 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486287 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4da1690-8a11-4f38-baf0-49102bf9aab1-tmp-dir\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.486489 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486319 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzktn\" (UniqueName: \"kubernetes.io/projected/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-api-access-pzktn\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.486489 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486341 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzs5\" (UniqueName: \"kubernetes.io/projected/df3a5742-26c9-4161-ac23-7c45b90a8f9e-kube-api-access-4kzs5\") pod \"ingress-canary-r7ls9\" (UID: \"df3a5742-26c9-4161-ac23-7c45b90a8f9e\") " pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.486489 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486403 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.486489 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486436 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.486489 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486454 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9177dafa-20be-48cc-95c4-4377d2536ea6-crio-socket\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.486489 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486489 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z552g\" (UniqueName: \"kubernetes.io/projected/d4da1690-8a11-4f38-baf0-49102bf9aab1-kube-api-access-z552g\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.486835 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486530 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.486835 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486636 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9177dafa-20be-48cc-95c4-4377d2536ea6-data-volume\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.486835 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.486667 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df3a5742-26c9-4161-ac23-7c45b90a8f9e-cert\") pod \"ingress-canary-r7ls9\" (UID: \"df3a5742-26c9-4161-ac23-7c45b90a8f9e\") " pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.587610 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587573 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.587610 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587614 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.587835 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587641 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9177dafa-20be-48cc-95c4-4377d2536ea6-crio-socket\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.587835 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587669 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/144cb6a8-2ea3-4e98-8f81-865406276623-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.587835 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587698 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88w7\" (UniqueName: \"kubernetes.io/projected/144cb6a8-2ea3-4e98-8f81-865406276623-kube-api-access-t88w7\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.587835 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:14.587706 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:28:14.587835 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:14.587727 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:14.587835 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587727 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z552g\" (UniqueName: \"kubernetes.io/projected/d4da1690-8a11-4f38-baf0-49102bf9aab1-kube-api-access-z552g\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.587835 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:14.587801 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls podName:d4da1690-8a11-4f38-baf0-49102bf9aab1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:15.087779577 +0000 UTC m=+36.066781907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls") pod "dns-default-h9fw2" (UID: "d4da1690-8a11-4f38-baf0-49102bf9aab1") : secret "dns-default-metrics-tls" not found Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:14.587850 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-rbac-proxy-cm podName:9177dafa-20be-48cc-95c4-4377d2536ea6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:15.087836822 +0000 UTC m=+36.066839164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmblh" (UID: "9177dafa-20be-48cc-95c4-4377d2536ea6") : configmap "kube-rbac-proxy" not found Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587870 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587894 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9177dafa-20be-48cc-95c4-4377d2536ea6-crio-socket\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587919 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9177dafa-20be-48cc-95c4-4377d2536ea6-data-volume\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.587943 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df3a5742-26c9-4161-ac23-7c45b90a8f9e-cert\") pod \"ingress-canary-r7ls9\" (UID: \"df3a5742-26c9-4161-ac23-7c45b90a8f9e\") " pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:14.587979 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588010 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4da1690-8a11-4f38-baf0-49102bf9aab1-config-volume\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:14.588026 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls podName:9177dafa-20be-48cc-95c4-4377d2536ea6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:15.088013579 +0000 UTC m=+36.067015932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmblh" (UID: "9177dafa-20be-48cc-95c4-4377d2536ea6") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588046 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4da1690-8a11-4f38-baf0-49102bf9aab1-tmp-dir\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588069 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzktn\" (UniqueName: \"kubernetes.io/projected/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-api-access-pzktn\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.588093 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588086 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzs5\" (UniqueName: \"kubernetes.io/projected/df3a5742-26c9-4161-ac23-7c45b90a8f9e-kube-api-access-4kzs5\") pod \"ingress-canary-r7ls9\" (UID: \"df3a5742-26c9-4161-ac23-7c45b90a8f9e\") " pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.588433 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588105 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/144cb6a8-2ea3-4e98-8f81-865406276623-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.588433 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588172 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9177dafa-20be-48cc-95c4-4377d2536ea6-data-volume\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.588433 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588325 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4da1690-8a11-4f38-baf0-49102bf9aab1-tmp-dir\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.588592 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.588573 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4da1690-8a11-4f38-baf0-49102bf9aab1-config-volume\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.593116 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.593091 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df3a5742-26c9-4161-ac23-7c45b90a8f9e-cert\") pod \"ingress-canary-r7ls9\" (UID: \"df3a5742-26c9-4161-ac23-7c45b90a8f9e\") " pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.597838 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.597811 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzs5\" (UniqueName: \"kubernetes.io/projected/df3a5742-26c9-4161-ac23-7c45b90a8f9e-kube-api-access-4kzs5\") pod \"ingress-canary-r7ls9\" (UID: \"df3a5742-26c9-4161-ac23-7c45b90a8f9e\") " pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.598358 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.598337 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzktn\" (UniqueName: \"kubernetes.io/projected/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-api-access-pzktn\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:14.598628 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.598608 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z552g\" (UniqueName: \"kubernetes.io/projected/d4da1690-8a11-4f38-baf0-49102bf9aab1-kube-api-access-z552g\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:14.675916 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.675849 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r7ls9" Jul 01 18:28:14.688972 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.688946 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/144cb6a8-2ea3-4e98-8f81-865406276623-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.689077 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.688995 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88w7\" (UniqueName: \"kubernetes.io/projected/144cb6a8-2ea3-4e98-8f81-865406276623-kube-api-access-t88w7\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.689166 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.689099 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/144cb6a8-2ea3-4e98-8f81-865406276623-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.689719 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.689670 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/144cb6a8-2ea3-4e98-8f81-865406276623-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.691833 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.691811 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/144cb6a8-2ea3-4e98-8f81-865406276623-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.697622 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.697597 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88w7\" (UniqueName: \"kubernetes.io/projected/144cb6a8-2ea3-4e98-8f81-865406276623-kube-api-access-t88w7\") pod \"kube-storage-version-migrator-operator-79964ff6f9-k8jkb\" (UID: \"144cb6a8-2ea3-4e98-8f81-865406276623\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.714536 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.714514 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" Jul 01 18:28:14.836439 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.836405 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r7ls9"] Jul 01 18:28:14.841240 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:14.841211 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3a5742_26c9_4161_ac23_7c45b90a8f9e.slice/crio-b5ce9fac7f01b3e6346085de81e6c38bf7c97ad5694e0c9f40b3555e4f7175e8 WatchSource:0}: Error finding container b5ce9fac7f01b3e6346085de81e6c38bf7c97ad5694e0c9f40b3555e4f7175e8: Status 404 returned error can't find the container with id b5ce9fac7f01b3e6346085de81e6c38bf7c97ad5694e0c9f40b3555e4f7175e8 Jul 01 18:28:14.864528 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:14.864502 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb"] Jul 01 18:28:14.867687 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:14.867663 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144cb6a8_2ea3_4e98_8f81_865406276623.slice/crio-37bc3a021afded7a70033398abcc578f154607d254c440734a65abd2100ffbe0 WatchSource:0}: Error finding container 37bc3a021afded7a70033398abcc578f154607d254c440734a65abd2100ffbe0: Status 404 returned error can't find the container with id 37bc3a021afded7a70033398abcc578f154607d254c440734a65abd2100ffbe0 Jul 01 18:28:15.092101 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.092061 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:15.092286 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.092121 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:15.092286 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.092174 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:15.092286 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:15.092266 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:15.092493 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:15.092340 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls podName:d4da1690-8a11-4f38-baf0-49102bf9aab1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:16.092320501 +0000 UTC m=+37.071322851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls") pod "dns-default-h9fw2" (UID: "d4da1690-8a11-4f38-baf0-49102bf9aab1") : secret "dns-default-metrics-tls" not found Jul 01 18:28:15.092493 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:15.092396 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:15.092493 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:15.092446 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls podName:9177dafa-20be-48cc-95c4-4377d2536ea6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:16.092432638 +0000 UTC m=+37.071434979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmblh" (UID: "9177dafa-20be-48cc-95c4-4377d2536ea6") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:15.092689 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.092660 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9177dafa-20be-48cc-95c4-4377d2536ea6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:15.471474 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.471388 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:15.471934 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.471364 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:15.471934 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.471535 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:15.476033 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.476012 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:28:15.476167 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.476044 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:28:15.476167 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.476073 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l88pn\"" Jul 01 18:28:15.476167 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.476017 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:28:15.476167 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.476013 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:28:15.476167 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.476077 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tjgt\"" Jul 01 18:28:15.504466 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.504446 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8zgz4_73bf0e9b-9b1b-4c6e-af6b-291cd8440054/dns-node-resolver/0.log" Jul 01 18:28:15.644021 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.643987 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" event={"ID":"144cb6a8-2ea3-4e98-8f81-865406276623","Type":"ContainerStarted","Data":"37bc3a021afded7a70033398abcc578f154607d254c440734a65abd2100ffbe0"} Jul 01 18:28:15.645265 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:15.645244 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r7ls9" event={"ID":"df3a5742-26c9-4161-ac23-7c45b90a8f9e","Type":"ContainerStarted","Data":"b5ce9fac7f01b3e6346085de81e6c38bf7c97ad5694e0c9f40b3555e4f7175e8"} Jul 01 18:28:16.100196 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:16.100151 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:16.100368 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:16.100247 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:16.100368 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:16.100341 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:16.100368 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:16.100342 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:16.100519 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:16.100415 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls podName:d4da1690-8a11-4f38-baf0-49102bf9aab1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:18.100400394 +0000 UTC m=+39.079402737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls") pod "dns-default-h9fw2" (UID: "d4da1690-8a11-4f38-baf0-49102bf9aab1") : secret "dns-default-metrics-tls" not found Jul 01 18:28:16.100519 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:16.100440 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls podName:9177dafa-20be-48cc-95c4-4377d2536ea6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:18.100421612 +0000 UTC m=+39.079423946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmblh" (UID: "9177dafa-20be-48cc-95c4-4377d2536ea6") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:16.482338 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:16.482266 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jzlrj_730c0b6a-43db-46dc-8734-a13b46596717/node-ca/0.log" Jul 01 18:28:17.014834 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.014588 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-tqwkb"] Jul 01 18:28:17.032556 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.032531 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-tqwkb"] Jul 01 18:28:17.032709 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.032674 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" Jul 01 18:28:17.035953 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.035890 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jbq6c\"" Jul 01 18:28:17.212069 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.212032 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt84v\" (UniqueName: \"kubernetes.io/projected/88b4d650-7d78-4231-a186-718516988d7d-kube-api-access-pt84v\") pod \"network-check-source-56499946bc-tqwkb\" (UID: \"88b4d650-7d78-4231-a186-718516988d7d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" Jul 01 18:28:17.313061 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.312929 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt84v\" (UniqueName: \"kubernetes.io/projected/88b4d650-7d78-4231-a186-718516988d7d-kube-api-access-pt84v\") pod \"network-check-source-56499946bc-tqwkb\" (UID: \"88b4d650-7d78-4231-a186-718516988d7d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" Jul 01 18:28:17.325885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.325856 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt84v\" (UniqueName: \"kubernetes.io/projected/88b4d650-7d78-4231-a186-718516988d7d-kube-api-access-pt84v\") pod \"network-check-source-56499946bc-tqwkb\" (UID: \"88b4d650-7d78-4231-a186-718516988d7d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" Jul 01 18:28:17.364814 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.364779 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" Jul 01 18:28:17.523577 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.523546 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-tqwkb"] Jul 01 18:28:17.529998 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:17.529968 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b4d650_7d78_4231_a186_718516988d7d.slice/crio-06d4a4cf12a341cc1cc49715145f39e19f2f74561c30b383c71c2e7933bb89ac WatchSource:0}: Error finding container 06d4a4cf12a341cc1cc49715145f39e19f2f74561c30b383c71c2e7933bb89ac: Status 404 returned error can't find the container with id 06d4a4cf12a341cc1cc49715145f39e19f2f74561c30b383c71c2e7933bb89ac Jul 01 18:28:17.652103 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.652022 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" event={"ID":"88b4d650-7d78-4231-a186-718516988d7d","Type":"ContainerStarted","Data":"06d4a4cf12a341cc1cc49715145f39e19f2f74561c30b383c71c2e7933bb89ac"} Jul 01 18:28:17.655208 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.655180 2528 generic.go:356] "Generic (PLEG): container finished" podID="31b2e3bc-3f08-47a7-ac4a-361b7749430d" containerID="c4a987abe8b0bf34f89717f3dbcedf7e25f9f4401bb897e344c18259fa5b9f22" exitCode=0 Jul 01 18:28:17.655356 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:17.655224 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerDied","Data":"c4a987abe8b0bf34f89717f3dbcedf7e25f9f4401bb897e344c18259fa5b9f22"} Jul 01 18:28:18.119957 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:18.119921 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:18.120134 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:18.120022 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:18.120134 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:18.120088 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:18.120134 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:18.120126 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:18.120279 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:18.120167 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls podName:9177dafa-20be-48cc-95c4-4377d2536ea6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:22.120149051 +0000 UTC m=+43.099151385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmblh" (UID: "9177dafa-20be-48cc-95c4-4377d2536ea6") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:18.120279 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:18.120186 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls podName:d4da1690-8a11-4f38-baf0-49102bf9aab1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:22.120177408 +0000 UTC m=+43.099179738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls") pod "dns-default-h9fw2" (UID: "d4da1690-8a11-4f38-baf0-49102bf9aab1") : secret "dns-default-metrics-tls" not found Jul 01 18:28:18.663636 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:18.663601 2528 generic.go:356] "Generic (PLEG): container finished" podID="31b2e3bc-3f08-47a7-ac4a-361b7749430d" containerID="2312f9247efd25275f3ad93becf8ac2c8b1252540734e24eb8c077daffa6f8d4" exitCode=0 Jul 01 18:28:18.664122 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:18.663665 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerDied","Data":"2312f9247efd25275f3ad93becf8ac2c8b1252540734e24eb8c077daffa6f8d4"} Jul 01 18:28:20.673970 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:20.673711 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" event={"ID":"31b2e3bc-3f08-47a7-ac4a-361b7749430d","Type":"ContainerStarted","Data":"b6ce0abfbf7339e747e8c0df44bd54d3c609a8418492564d4e30128d55b52693"} Jul 01 18:28:20.677027 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:20.676661 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" event={"ID":"144cb6a8-2ea3-4e98-8f81-865406276623","Type":"ContainerStarted","Data":"c458ab48f7143f5a11a389f9b27766215243ddec1a1825e21af7c9cf87c4454d"} Jul 01 18:28:20.678255 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:20.678226 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r7ls9" event={"ID":"df3a5742-26c9-4161-ac23-7c45b90a8f9e","Type":"ContainerStarted","Data":"e1bb92ee5f1a9056cb96a50443e149c6d9430b01a7c15a37c1c4ad2b53e268c9"} Jul 01 18:28:20.704616 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:20.704575 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5g9cg" podStartSLOduration=11.7938131 podStartE2EDuration="41.704563259s" totalImagesPullingTime="29.910750159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:20.704305814 +0000 UTC m=+41.683308169" watchObservedRunningTime="2026-07-01 18:28:20.704563259 +0000 UTC m=+41.683565611" Jul 01 18:28:20.742824 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:20.742748 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r7ls9" podStartSLOduration=1.9357677720000002 podStartE2EDuration="6.742729385s" totalImagesPullingTime="4.806961613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:20.723446295 +0000 UTC m=+41.702448647" watchObservedRunningTime="2026-07-01 18:28:20.742729385 +0000 UTC m=+41.721731738" Jul 01 18:28:22.152423 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:22.152370 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:22.152837 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:22.152475 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:22.152837 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:22.152527 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:22.152837 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:22.152558 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:22.152837 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:22.152591 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls podName:9177dafa-20be-48cc-95c4-4377d2536ea6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:30.152576394 +0000 UTC m=+51.131578725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmblh" (UID: "9177dafa-20be-48cc-95c4-4377d2536ea6") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:22.152837 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:22.152609 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls podName:d4da1690-8a11-4f38-baf0-49102bf9aab1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:30.1525982 +0000 UTC m=+51.131600529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls") pod "dns-default-h9fw2" (UID: "d4da1690-8a11-4f38-baf0-49102bf9aab1") : secret "dns-default-metrics-tls" not found Jul 01 18:28:22.684704 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:22.684665 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" event={"ID":"88b4d650-7d78-4231-a186-718516988d7d","Type":"ContainerStarted","Data":"d1dd8a3de7d96991c772057abec6b7f6a0468c63e656b2c8f91c13615ca9e267"} Jul 01 18:28:22.706936 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:22.706848 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" podStartSLOduration=3.920967379 podStartE2EDuration="8.706832885s" totalImagesPullingTime="4.785865506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:20.743007515 +0000 UTC m=+41.722009868" watchObservedRunningTime="2026-07-01 18:28:22.706832885 +0000 UTC m=+43.685835244" Jul 01 18:28:23.430295 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.430232 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-tqwkb" podStartSLOduration=2.618774705 podStartE2EDuration="7.430210153s" totalImagesPullingTime="4.811435448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:22.706831323 +0000 UTC m=+43.685833675" watchObservedRunningTime="2026-07-01 18:28:23.430210153 +0000 UTC m=+44.409212509" Jul 01 18:28:23.430713 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.430697 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q"] Jul 01 18:28:23.455764 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.455714 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q"] Jul 01 18:28:23.455924 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.455856 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.461313 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.460476 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 18:28:23.461313 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.460691 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-b72g6\"" Jul 01 18:28:23.461313 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.461049 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2jn2\" (UniqueName: \"kubernetes.io/projected/63d0dc2a-c4de-49f4-954f-408d6fecf8da-kube-api-access-q2jn2\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.461313 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.461080 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/63d0dc2a-c4de-49f4-954f-408d6fecf8da-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.461313 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.461131 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/63d0dc2a-c4de-49f4-954f-408d6fecf8da-signing-key\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.463191 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.462084 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 18:28:23.463191 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.462272 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 18:28:23.463191 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.462505 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 18:28:23.562120 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.562097 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/63d0dc2a-c4de-49f4-954f-408d6fecf8da-signing-key\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.562243 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.562189 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2jn2\" (UniqueName: \"kubernetes.io/projected/63d0dc2a-c4de-49f4-954f-408d6fecf8da-kube-api-access-q2jn2\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.562243 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.562213 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/63d0dc2a-c4de-49f4-954f-408d6fecf8da-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.562897 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.562878 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/63d0dc2a-c4de-49f4-954f-408d6fecf8da-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.565964 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.565943 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/63d0dc2a-c4de-49f4-954f-408d6fecf8da-signing-key\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.571630 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.571609 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2jn2\" (UniqueName: \"kubernetes.io/projected/63d0dc2a-c4de-49f4-954f-408d6fecf8da-kube-api-access-q2jn2\") pod \"service-ca-7bb4f4bcc7-vhw2q\" (UID: \"63d0dc2a-c4de-49f4-954f-408d6fecf8da\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.771416 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.771368 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" Jul 01 18:28:23.923945 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:23.923907 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q"] Jul 01 18:28:23.927674 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:23.927646 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d0dc2a_c4de_49f4_954f_408d6fecf8da.slice/crio-8a0885dd50b3c01e37e6cb2c621325095428ea9b7b2d4329cfa297b8a7d2f899 WatchSource:0}: Error finding container 8a0885dd50b3c01e37e6cb2c621325095428ea9b7b2d4329cfa297b8a7d2f899: Status 404 returned error can't find the container with id 8a0885dd50b3c01e37e6cb2c621325095428ea9b7b2d4329cfa297b8a7d2f899 Jul 01 18:28:24.692787 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:24.692753 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" event={"ID":"63d0dc2a-c4de-49f4-954f-408d6fecf8da","Type":"ContainerStarted","Data":"8a0885dd50b3c01e37e6cb2c621325095428ea9b7b2d4329cfa297b8a7d2f899"} Jul 01 18:28:28.703609 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:28.703519 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" event={"ID":"63d0dc2a-c4de-49f4-954f-408d6fecf8da","Type":"ContainerStarted","Data":"c07d764ffdb0e9ea65622debf315f11b3f187919530e5010474a57228c6297d5"} Jul 01 18:28:28.721026 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:28.720982 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-vhw2q" podStartSLOduration=1.271775061 podStartE2EDuration="5.720967463s" totalImagesPullingTime="4.449192402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:28.720497192 +0000 UTC m=+49.699499543" watchObservedRunningTime="2026-07-01 18:28:28.720967463 +0000 UTC m=+49.699969815" Jul 01 18:28:30.213062 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:30.213025 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:30.213462 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:30.213106 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:30.213462 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:30.213182 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:30.213462 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:30.213194 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:30.213462 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:30.213233 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls podName:d4da1690-8a11-4f38-baf0-49102bf9aab1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:46.213221151 +0000 UTC m=+67.192223481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls") pod "dns-default-h9fw2" (UID: "d4da1690-8a11-4f38-baf0-49102bf9aab1") : secret "dns-default-metrics-tls" not found Jul 01 18:28:30.213462 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:30.213271 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls podName:9177dafa-20be-48cc-95c4-4377d2536ea6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:46.213252891 +0000 UTC m=+67.192255225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmblh" (UID: "9177dafa-20be-48cc-95c4-4377d2536ea6") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:40.645908 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:40.645882 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gmwz" Jul 01 18:28:44.695070 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.695033 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn"] Jul 01 18:28:44.697941 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.697919 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:44.701046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.701023 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 18:28:44.702200 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.702181 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 18:28:44.702319 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.702200 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h224b\"" Jul 01 18:28:44.708927 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.708905 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75cf75d8c7-m9x5c"] Jul 01 18:28:44.710919 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.710904 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.713908 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.713889 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8xwh\"" Jul 01 18:28:44.714005 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.713892 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 18:28:44.714005 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.713896 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 18:28:44.714005 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.713897 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 18:28:44.722342 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.722318 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 18:28:44.735683 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.735664 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75cf75d8c7-m9x5c"] Jul 01 18:28:44.751636 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.751606 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn"] Jul 01 18:28:44.800242 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.800216 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l"] Jul 01 18:28:44.802049 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.802032 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" Jul 01 18:28:44.806890 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.806857 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pxj5f\"" Jul 01 18:28:44.806997 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.806989 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 18:28:44.808153 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.808137 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw"] Jul 01 18:28:44.810121 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.810105 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:44.815350 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.815321 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 18:28:44.815465 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.815427 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 18:28:44.815618 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.815595 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 18:28:44.815715 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.815685 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 18:28:44.815855 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.815837 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 18:28:44.816071 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.816051 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 18:28:44.816462 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.816443 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 18:28:44.816637 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.816619 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l"] Jul 01 18:28:44.828278 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828259 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-tls\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828370 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828291 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91375fed-600d-4287-9ef1-9b5cb492aff8-ca-trust-extracted\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828370 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828308 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-bound-sa-token\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828370 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828328 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-installation-pull-secrets\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828370 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828345 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-image-registry-private-configuration\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828639 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828415 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-trusted-ca\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828639 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828557 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-certificates\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828761 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828727 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b19ba83-00ae-47f8-a659-34e79d5c1525-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-x8cwn\" (UID: \"4b19ba83-00ae-47f8-a659-34e79d5c1525\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:44.828829 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828769 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw8cs\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-kube-api-access-vw8cs\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.828829 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.828801 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4b19ba83-00ae-47f8-a659-34e79d5c1525-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-x8cwn\" (UID: \"4b19ba83-00ae-47f8-a659-34e79d5c1525\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:44.830018 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.829998 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75cf75d8c7-m9x5c"] Jul 01 18:28:44.830240 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:44.830186 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-vw8cs registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" podUID="91375fed-600d-4287-9ef1-9b5cb492aff8" Jul 01 18:28:44.831175 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.831158 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw"] Jul 01 18:28:44.929903 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.929874 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-certificates\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.929903 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.929906 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b19ba83-00ae-47f8-a659-34e79d5c1525-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-x8cwn\" (UID: \"4b19ba83-00ae-47f8-a659-34e79d5c1525\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:44.930097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.929927 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:44.930097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.929947 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8cs\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-kube-api-access-vw8cs\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.929966 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4b19ba83-00ae-47f8-a659-34e79d5c1525-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-x8cwn\" (UID: \"4b19ba83-00ae-47f8-a659-34e79d5c1525\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:44.930097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930044 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-ca\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:44.930288 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930100 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1112585a-d560-4310-bd8f-24bb96e252fe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:44.930288 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930150 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-hub\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:44.930288 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930201 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-tls\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930288 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930233 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bdb71551-0d68-4081-9814-7cab108a8cd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tld8l\" (UID: \"bdb71551-0d68-4081-9814-7cab108a8cd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" Jul 01 18:28:44.930288 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930278 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7kmq\" (UniqueName: \"kubernetes.io/projected/1112585a-d560-4310-bd8f-24bb96e252fe-kube-api-access-f7kmq\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:44.930625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930313 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91375fed-600d-4287-9ef1-9b5cb492aff8-ca-trust-extracted\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930338 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-bound-sa-token\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930400 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-installation-pull-secrets\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930426 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:44.930625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930453 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-image-registry-private-configuration\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930488 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-trusted-ca\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930875 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930663 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91375fed-600d-4287-9ef1-9b5cb492aff8-ca-trust-extracted\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930875 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930801 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-certificates\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.930942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.930923 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4b19ba83-00ae-47f8-a659-34e79d5c1525-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-x8cwn\" (UID: \"4b19ba83-00ae-47f8-a659-34e79d5c1525\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:44.932396 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.932360 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-trusted-ca\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.932722 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.932702 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b19ba83-00ae-47f8-a659-34e79d5c1525-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-x8cwn\" (UID: \"4b19ba83-00ae-47f8-a659-34e79d5c1525\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:44.932894 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.932876 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-tls\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.933732 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.933706 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-image-registry-private-configuration\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.933869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.933849 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-installation-pull-secrets\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.943219 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.943201 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-bound-sa-token\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:44.943302 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:44.943228 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw8cs\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-kube-api-access-vw8cs\") pod \"image-registry-75cf75d8c7-m9x5c\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:45.007065 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.007011 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" Jul 01 18:28:45.030908 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.030878 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1112585a-d560-4310-bd8f-24bb96e252fe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.031028 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.030943 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-hub\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.031028 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.030979 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bdb71551-0d68-4081-9814-7cab108a8cd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tld8l\" (UID: \"bdb71551-0d68-4081-9814-7cab108a8cd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" Jul 01 18:28:45.031028 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.031015 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7kmq\" (UniqueName: \"kubernetes.io/projected/1112585a-d560-4310-bd8f-24bb96e252fe-kube-api-access-f7kmq\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.031196 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.031058 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.031196 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.031120 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.031196 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.031187 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-ca\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.031787 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.031673 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1112585a-d560-4310-bd8f-24bb96e252fe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.033684 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.033662 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-hub\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.033779 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.033767 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bdb71551-0d68-4081-9814-7cab108a8cd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tld8l\" (UID: \"bdb71551-0d68-4081-9814-7cab108a8cd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" Jul 01 18:28:45.034196 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.034168 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.034420 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.034399 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-ca\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.034576 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.034562 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1112585a-d560-4310-bd8f-24bb96e252fe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.042646 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.042623 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7kmq\" (UniqueName: \"kubernetes.io/projected/1112585a-d560-4310-bd8f-24bb96e252fe-kube-api-access-f7kmq\") pod \"cluster-proxy-proxy-agent-757b8777f8-dqzbw\" (UID: \"1112585a-d560-4310-bd8f-24bb96e252fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.111647 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.111620 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" Jul 01 18:28:45.129327 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.129297 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn"] Jul 01 18:28:45.130276 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.130253 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" Jul 01 18:28:45.132350 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:45.132318 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b19ba83_00ae_47f8_a659_34e79d5c1525.slice/crio-388f11b82df298707823a32a159a335fede5dcc09f520252f9f4e23aedc677ee WatchSource:0}: Error finding container 388f11b82df298707823a32a159a335fede5dcc09f520252f9f4e23aedc677ee: Status 404 returned error can't find the container with id 388f11b82df298707823a32a159a335fede5dcc09f520252f9f4e23aedc677ee Jul 01 18:28:45.239294 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.239267 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l"] Jul 01 18:28:45.241830 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:45.241806 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb71551_0d68_4081_9814_7cab108a8cd2.slice/crio-da5375705e9a53e082d96e6acca2cf2c2e3c5a0b093ac4275983b1486677a485 WatchSource:0}: Error finding container da5375705e9a53e082d96e6acca2cf2c2e3c5a0b093ac4275983b1486677a485: Status 404 returned error can't find the container with id da5375705e9a53e082d96e6acca2cf2c2e3c5a0b093ac4275983b1486677a485 Jul 01 18:28:45.258498 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.258442 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw"] Jul 01 18:28:45.261121 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:45.261097 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1112585a_d560_4310_bd8f_24bb96e252fe.slice/crio-705e19cfda588d9d9a05b92e95b4257d20cf2b280af430195b3680570ecf780f WatchSource:0}: Error finding container 705e19cfda588d9d9a05b92e95b4257d20cf2b280af430195b3680570ecf780f: Status 404 returned error can't find the container with id 705e19cfda588d9d9a05b92e95b4257d20cf2b280af430195b3680570ecf780f Jul 01 18:28:45.334150 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.334125 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:45.334246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.334156 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:45.334246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.334177 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:45.336653 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.336635 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7k2\" (UniqueName: \"kubernetes.io/projected/2ca26a65-0c70-48df-a83e-e6be1ad19492-kube-api-access-bv7k2\") pod \"network-check-target-mznv5\" (UID: \"2ca26a65-0c70-48df-a83e-e6be1ad19492\") " pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:45.337000 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.336985 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:28:45.337087 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.337033 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:28:45.346646 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.346628 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa514adf-5a6e-4c8e-85be-661f9c10de48-original-pull-secret\") pod \"global-pull-secret-syncer-zl55s\" (UID: \"fa514adf-5a6e-4c8e-85be-661f9c10de48\") " pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:45.346729 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.346712 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2811d697-4951-498a-9f2a-9b24db3d320d-metrics-certs\") pod \"network-metrics-daemon-5j9jb\" (UID: \"2811d697-4951-498a-9f2a-9b24db3d320d\") " pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:45.487915 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.487889 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tjgt\"" Jul 01 18:28:45.492421 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.492404 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l88pn\"" Jul 01 18:28:45.494538 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.494524 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j9jb" Jul 01 18:28:45.496682 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.496654 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zl55s" Jul 01 18:28:45.500236 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.500219 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:45.634741 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.634708 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mznv5"] Jul 01 18:28:45.639647 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:45.639604 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca26a65_0c70_48df_a83e_e6be1ad19492.slice/crio-835a57f494d133c852feb880c4cb7c015eb33feb4e3270733028268cb2010985 WatchSource:0}: Error finding container 835a57f494d133c852feb880c4cb7c015eb33feb4e3270733028268cb2010985: Status 404 returned error can't find the container with id 835a57f494d133c852feb880c4cb7c015eb33feb4e3270733028268cb2010985 Jul 01 18:28:45.651996 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.651947 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5j9jb"] Jul 01 18:28:45.654652 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:45.654627 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2811d697_4951_498a_9f2a_9b24db3d320d.slice/crio-e521bc20fc1a58824af9cf8a1835d0755afc97f765eac323165c389f50942641 WatchSource:0}: Error finding container e521bc20fc1a58824af9cf8a1835d0755afc97f765eac323165c389f50942641: Status 404 returned error can't find the container with id e521bc20fc1a58824af9cf8a1835d0755afc97f765eac323165c389f50942641 Jul 01 18:28:45.671557 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.671481 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zl55s"] Jul 01 18:28:45.674829 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:45.674803 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa514adf_5a6e_4c8e_85be_661f9c10de48.slice/crio-acc7a6e75a6de6e33452852f971f73bb37167b73b7a384726b08221683f438a6 WatchSource:0}: Error finding container acc7a6e75a6de6e33452852f971f73bb37167b73b7a384726b08221683f438a6: Status 404 returned error can't find the container with id acc7a6e75a6de6e33452852f971f73bb37167b73b7a384726b08221683f438a6 Jul 01 18:28:45.749202 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.749173 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mznv5" event={"ID":"2ca26a65-0c70-48df-a83e-e6be1ad19492","Type":"ContainerStarted","Data":"7abf692162f83865c793239a1c9b867adcaeeeabad93e481c815be7109c27beb"} Jul 01 18:28:45.749616 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.749217 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mznv5" event={"ID":"2ca26a65-0c70-48df-a83e-e6be1ad19492","Type":"ContainerStarted","Data":"835a57f494d133c852feb880c4cb7c015eb33feb4e3270733028268cb2010985"} Jul 01 18:28:45.749616 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.749241 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:28:45.750264 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.750241 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5j9jb" event={"ID":"2811d697-4951-498a-9f2a-9b24db3d320d","Type":"ContainerStarted","Data":"e521bc20fc1a58824af9cf8a1835d0755afc97f765eac323165c389f50942641"} Jul 01 18:28:45.751275 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.751258 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" event={"ID":"1112585a-d560-4310-bd8f-24bb96e252fe","Type":"ContainerStarted","Data":"705e19cfda588d9d9a05b92e95b4257d20cf2b280af430195b3680570ecf780f"} Jul 01 18:28:45.752227 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.752210 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zl55s" event={"ID":"fa514adf-5a6e-4c8e-85be-661f9c10de48","Type":"ContainerStarted","Data":"acc7a6e75a6de6e33452852f971f73bb37167b73b7a384726b08221683f438a6"} Jul 01 18:28:45.753212 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.753194 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" event={"ID":"bdb71551-0d68-4081-9814-7cab108a8cd2","Type":"ContainerStarted","Data":"da5375705e9a53e082d96e6acca2cf2c2e3c5a0b093ac4275983b1486677a485"} Jul 01 18:28:45.754223 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.754205 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:45.754304 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.754203 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" event={"ID":"4b19ba83-00ae-47f8-a659-34e79d5c1525","Type":"ContainerStarted","Data":"388f11b82df298707823a32a159a335fede5dcc09f520252f9f4e23aedc677ee"} Jul 01 18:28:45.758851 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.758835 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:45.790454 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.790412 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mznv5" podStartSLOduration=66.790397737 podStartE2EDuration="1m6.790397737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:45.790009724 +0000 UTC m=+66.769012076" watchObservedRunningTime="2026-07-01 18:28:45.790397737 +0000 UTC m=+66.769400080" Jul 01 18:28:45.838246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838215 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-tls\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.838397 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838283 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-certificates\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.838397 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838322 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-installation-pull-secrets\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.838397 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838350 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-image-registry-private-configuration\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.838516 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838439 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-bound-sa-token\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.838516 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838470 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw8cs\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-kube-api-access-vw8cs\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.838516 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838512 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91375fed-600d-4287-9ef1-9b5cb492aff8-ca-trust-extracted\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.838646 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838540 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-trusted-ca\") pod \"91375fed-600d-4287-9ef1-9b5cb492aff8\" (UID: \"91375fed-600d-4287-9ef1-9b5cb492aff8\") " Jul 01 18:28:45.839411 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.838941 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91375fed-600d-4287-9ef1-9b5cb492aff8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:28:45.839411 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.839099 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:28:45.839567 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.839530 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:28:45.841293 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.841265 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-kube-api-access-vw8cs" (OuterVolumeSpecName: "kube-api-access-vw8cs") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "kube-api-access-vw8cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:28:45.841408 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.841313 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:28:45.841692 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.841663 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:28:45.842956 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.842924 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:28:45.845451 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.845424 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "91375fed-600d-4287-9ef1-9b5cb492aff8" (UID: "91375fed-600d-4287-9ef1-9b5cb492aff8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939520 2528 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-tls\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939546 2528 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-registry-certificates\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939563 2528 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-installation-pull-secrets\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939579 2528 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91375fed-600d-4287-9ef1-9b5cb492aff8-image-registry-private-configuration\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939594 2528 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-bound-sa-token\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939607 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw8cs\" (UniqueName: \"kubernetes.io/projected/91375fed-600d-4287-9ef1-9b5cb492aff8-kube-api-access-vw8cs\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939620 2528 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91375fed-600d-4287-9ef1-9b5cb492aff8-ca-trust-extracted\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:45.939659 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:45.939635 2528 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91375fed-600d-4287-9ef1-9b5cb492aff8-trusted-ca\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:28:46.242404 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.242300 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:46.242404 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.242371 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:46.245924 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.245897 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9177dafa-20be-48cc-95c4-4377d2536ea6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmblh\" (UID: \"9177dafa-20be-48cc-95c4-4377d2536ea6\") " pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:46.247261 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.247241 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4da1690-8a11-4f38-baf0-49102bf9aab1-metrics-tls\") pod \"dns-default-h9fw2\" (UID: \"d4da1690-8a11-4f38-baf0-49102bf9aab1\") " pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:46.471801 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.471774 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5x58v\"" Jul 01 18:28:46.479062 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.479039 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:46.497476 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.497412 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ngz2\"" Jul 01 18:28:46.505701 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.505680 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmblh" Jul 01 18:28:46.760917 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.759446 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf75d8c7-m9x5c" Jul 01 18:28:46.797901 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.797858 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75cf75d8c7-m9x5c"] Jul 01 18:28:46.802153 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:46.802130 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75cf75d8c7-m9x5c"] Jul 01 18:28:47.476343 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:47.476302 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91375fed-600d-4287-9ef1-9b5cb492aff8" path="/var/lib/kubelet/pods/91375fed-600d-4287-9ef1-9b5cb492aff8/volumes" Jul 01 18:28:51.376695 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.376434 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9fw2"] Jul 01 18:28:51.383162 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:51.383128 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4da1690_8a11_4f38_baf0_49102bf9aab1.slice/crio-57b2db4438913e74e7296711385d72e6126ac3e0c56d36489f4eab41b2a323b7 WatchSource:0}: Error finding container 57b2db4438913e74e7296711385d72e6126ac3e0c56d36489f4eab41b2a323b7: Status 404 returned error can't find the container with id 57b2db4438913e74e7296711385d72e6126ac3e0c56d36489f4eab41b2a323b7 Jul 01 18:28:51.422849 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.422809 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmblh"] Jul 01 18:28:51.777130 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.777092 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" event={"ID":"4b19ba83-00ae-47f8-a659-34e79d5c1525","Type":"ContainerStarted","Data":"d31dabba7d59f12dc4c462517d93ede135dd6ca302132958f6324c5bc6387538"} Jul 01 18:28:51.778314 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.778286 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmblh" event={"ID":"9177dafa-20be-48cc-95c4-4377d2536ea6","Type":"ContainerStarted","Data":"abbfa5e2c844a6bb098c7c50feb9572622a68481de04d9ce493dec4340b3b1b3"} Jul 01 18:28:51.780101 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.780080 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5j9jb" event={"ID":"2811d697-4951-498a-9f2a-9b24db3d320d","Type":"ContainerStarted","Data":"b40fb23362d851b35c7e5cb5daa6c69ea99b606ce5aa71a121b4ece41db6094b"} Jul 01 18:28:51.780183 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.780129 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5j9jb" event={"ID":"2811d697-4951-498a-9f2a-9b24db3d320d","Type":"ContainerStarted","Data":"fce11db210936326e5e35d1d5336767a82b2a1b7256206ba3ef469ceee12510a"} Jul 01 18:28:51.782181 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.782162 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" event={"ID":"1112585a-d560-4310-bd8f-24bb96e252fe","Type":"ContainerStarted","Data":"4141299b12902f9e9aa1d9d91d93aeeeb33ce470bd114bdee773e985ced178dc"} Jul 01 18:28:51.782255 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.782189 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" event={"ID":"1112585a-d560-4310-bd8f-24bb96e252fe","Type":"ContainerStarted","Data":"5ec5c1eaea78f12199e0135ba43b815651d91f3aa4a16d65b717b0eb6746e475"} Jul 01 18:28:51.782255 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.782206 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" event={"ID":"1112585a-d560-4310-bd8f-24bb96e252fe","Type":"ContainerStarted","Data":"c81583df7e6b2b1ba4e905fea1d80652989676e9ceffd747fe6ba8792c4bd62a"} Jul 01 18:28:51.783285 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.783268 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9fw2" event={"ID":"d4da1690-8a11-4f38-baf0-49102bf9aab1","Type":"ContainerStarted","Data":"57b2db4438913e74e7296711385d72e6126ac3e0c56d36489f4eab41b2a323b7"} Jul 01 18:28:51.784692 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.784672 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zl55s" event={"ID":"fa514adf-5a6e-4c8e-85be-661f9c10de48","Type":"ContainerStarted","Data":"8e05115eb189d7ab5cdbc9c5d12cd8bcad4cef25afa9244243554170e5c29279"} Jul 01 18:28:51.786171 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.786154 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" event={"ID":"bdb71551-0d68-4081-9814-7cab108a8cd2","Type":"ContainerStarted","Data":"f6b3f09bb48e756712752e5bbe4faf7c6d2484b662a41bd1d1c0a91eceda9363"} Jul 01 18:28:51.786362 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.786346 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" Jul 01 18:28:51.791096 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.791078 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" Jul 01 18:28:51.794912 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.794877 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-x8cwn" podStartSLOduration=1.733269779 podStartE2EDuration="7.794862914s" totalImagesPullingTime="6.061593135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:51.793561644 +0000 UTC m=+72.772563998" watchObservedRunningTime="2026-07-01 18:28:51.794862914 +0000 UTC m=+72.773865266" Jul 01 18:28:51.809798 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.809761 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zl55s" podStartSLOduration=67.270533725 podStartE2EDuration="1m12.809746527s" totalImagesPullingTime="5.539212802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:51.809439892 +0000 UTC m=+72.788442244" watchObservedRunningTime="2026-07-01 18:28:51.809746527 +0000 UTC m=+72.788748879" Jul 01 18:28:51.829717 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.829670 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tld8l" podStartSLOduration=1.8760583290000001 podStartE2EDuration="7.829651771s" totalImagesPullingTime="5.953593442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:51.82868645 +0000 UTC m=+72.807688804" watchObservedRunningTime="2026-07-01 18:28:51.829651771 +0000 UTC m=+72.808654124" Jul 01 18:28:51.847311 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.847265 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-757b8777f8-dqzbw" podStartSLOduration=1.881751527 podStartE2EDuration="7.847249474s" totalImagesPullingTime="5.965497947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:51.846271733 +0000 UTC m=+72.825274086" watchObservedRunningTime="2026-07-01 18:28:51.847249474 +0000 UTC m=+72.826251825" Jul 01 18:28:51.862187 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:51.862059 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5j9jb" podStartSLOduration=67.321216259 podStartE2EDuration="1m12.862040489s" totalImagesPullingTime="5.54082423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:51.861019304 +0000 UTC m=+72.840021656" watchObservedRunningTime="2026-07-01 18:28:51.862040489 +0000 UTC m=+72.841042842" Jul 01 18:28:56.807620 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:56.807578 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9fw2" event={"ID":"d4da1690-8a11-4f38-baf0-49102bf9aab1","Type":"ContainerStarted","Data":"7cc1811ab2ea1cddb32e90b0b274e2f6bdaac4b024e386d1495a12a5ac904147"} Jul 01 18:28:56.808108 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:56.807757 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h9fw2" Jul 01 18:28:56.808108 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:56.807799 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9fw2" event={"ID":"d4da1690-8a11-4f38-baf0-49102bf9aab1","Type":"ContainerStarted","Data":"4ac108130da65afc9e403ca9d8a4af8588af2f65f8707e951f9ea76df19ab8c0"} Jul 01 18:28:56.809081 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:56.809058 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmblh" event={"ID":"9177dafa-20be-48cc-95c4-4377d2536ea6","Type":"ContainerStarted","Data":"cd0e3f70354bd69918f5307761f18362538054f2a1792d3d0d799e860b867954"} Jul 01 18:28:56.829243 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:56.829200 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h9fw2" podStartSLOduration=37.998686349 podStartE2EDuration="42.829187728s" totalImagesPullingTime="4.830501379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:56.82799898 +0000 UTC m=+77.807001333" watchObservedRunningTime="2026-07-01 18:28:56.829187728 +0000 UTC m=+77.808190080" Jul 01 18:28:57.815617 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:57.815576 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmblh" event={"ID":"9177dafa-20be-48cc-95c4-4377d2536ea6","Type":"ContainerStarted","Data":"b931b7893dc8e26b3875ff67880db7e91494a9eb3f62db050fb379255791174f"} Jul 01 18:28:58.277509 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.276231 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz"] Jul 01 18:28:58.279627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.279598 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.284040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.283503 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4kh8f\"" Jul 01 18:28:58.284040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.283654 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 18:28:58.284040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.283737 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 18:28:58.284040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.283853 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 18:28:58.284040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.283949 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 18:28:58.285237 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.284763 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 18:28:58.288146 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.288124 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-gc4ps"] Jul 01 18:28:58.291437 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.291421 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.299431 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.299407 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 18:28:58.299610 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.299593 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vxxwv\"" Jul 01 18:28:58.299864 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.299836 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 18:28:58.301901 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.301882 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz"] Jul 01 18:28:58.313405 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.312257 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 18:28:58.321564 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.321543 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-gc4ps"] Jul 01 18:28:58.323153 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.323103 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s98d6"] Jul 01 18:28:58.338455 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.327459 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.338455 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.332616 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 18:28:58.338455 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.332910 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q7jwb\"" Jul 01 18:28:58.338455 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.333065 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 18:28:58.338455 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.335415 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.437809 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-textfile\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.437857 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-tls\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.437883 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24813269-84ea-45cf-abaa-61bce0686757-metrics-client-ca\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.437909 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.437940 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wttb5\" (UniqueName: \"kubernetes.io/projected/24813269-84ea-45cf-abaa-61bce0686757-kube-api-access-wttb5\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.437961 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.437994 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-sys\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438011 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-accelerators-collector-config\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438045 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438082 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lc7\" (UniqueName: \"kubernetes.io/projected/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-kube-api-access-b2lc7\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438111 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/24813269-84ea-45cf-abaa-61bce0686757-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438127 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-wtmp\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438153 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438171 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.438424 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438190 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df5e4c9d-8324-468f-8148-cac3f9fe5609-metrics-client-ca\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.439098 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438210 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.439098 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438238 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.439098 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438256 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjrr7\" (UniqueName: \"kubernetes.io/projected/df5e4c9d-8324-468f-8148-cac3f9fe5609-kube-api-access-sjrr7\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.439098 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.438274 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-root\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539504 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539409 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.539504 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539449 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjrr7\" (UniqueName: \"kubernetes.io/projected/df5e4c9d-8324-468f-8148-cac3f9fe5609-kube-api-access-sjrr7\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539504 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539473 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-root\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539504 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539504 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-textfile\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539530 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-tls\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539554 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24813269-84ea-45cf-abaa-61bce0686757-metrics-client-ca\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539577 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539612 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttb5\" (UniqueName: \"kubernetes.io/projected/24813269-84ea-45cf-abaa-61bce0686757-kube-api-access-wttb5\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539642 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539680 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-sys\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539681 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-root\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539706 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-accelerators-collector-config\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.539760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539758 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:58.539581 2528 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539795 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lc7\" (UniqueName: \"kubernetes.io/projected/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-kube-api-access-b2lc7\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:58.539837 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-tls podName:90c09e36-8f86-4437-80c0-d19a2ae1a0b6 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:59.039821534 +0000 UTC m=+80.018823864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-q6hgz" (UID: "90c09e36-8f86-4437-80c0-d19a2ae1a0b6") : secret "openshift-state-metrics-tls" not found Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539855 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/24813269-84ea-45cf-abaa-61bce0686757-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539911 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-wtmp\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539933 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539950 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539966 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df5e4c9d-8324-468f-8148-cac3f9fe5609-metrics-client-ca\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.540046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.539981 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.540364 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.540285 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-textfile\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.540364 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.540299 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-accelerators-collector-config\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.540364 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.540355 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-sys\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.541341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.540721 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/24813269-84ea-45cf-abaa-61bce0686757-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.541341 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:58.539639 2528 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 18:28:58.541341 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:28:58.541000 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-tls podName:df5e4c9d-8324-468f-8148-cac3f9fe5609 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:59.040983059 +0000 UTC m=+80.019985391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-tls") pod "node-exporter-s98d6" (UID: "df5e4c9d-8324-468f-8148-cac3f9fe5609") : secret "node-exporter-tls" not found Jul 01 18:28:58.541341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.540945 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-wtmp\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.541341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.541014 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.541726 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.541368 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.541726 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.541601 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24813269-84ea-45cf-abaa-61bce0686757-metrics-client-ca\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.541833 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.541749 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df5e4c9d-8324-468f-8148-cac3f9fe5609-metrics-client-ca\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.543880 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.543852 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.544354 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.544332 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.544455 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.544372 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/24813269-84ea-45cf-abaa-61bce0686757-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.549635 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.549586 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjrr7\" (UniqueName: \"kubernetes.io/projected/df5e4c9d-8324-468f-8148-cac3f9fe5609-kube-api-access-sjrr7\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.550048 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.550026 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lc7\" (UniqueName: \"kubernetes.io/projected/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-kube-api-access-b2lc7\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:58.551697 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.551674 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:58.562530 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.562504 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wttb5\" (UniqueName: \"kubernetes.io/projected/24813269-84ea-45cf-abaa-61bce0686757-kube-api-access-wttb5\") pod \"kube-state-metrics-845b954455-gc4ps\" (UID: \"24813269-84ea-45cf-abaa-61bce0686757\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.617178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.616952 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" Jul 01 18:28:58.794839 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:58.794768 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-gc4ps"] Jul 01 18:28:59.045874 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:59.045791 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:59.046253 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:59.045873 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-tls\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:59.048871 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:59.048838 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df5e4c9d-8324-468f-8148-cac3f9fe5609-node-exporter-tls\") pod \"node-exporter-s98d6\" (UID: \"df5e4c9d-8324-468f-8148-cac3f9fe5609\") " pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:59.049004 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:59.048983 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c09e36-8f86-4437-80c0-d19a2ae1a0b6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-q6hgz\" (UID: \"90c09e36-8f86-4437-80c0-d19a2ae1a0b6\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:59.206459 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:59.206421 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" Jul 01 18:28:59.240260 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:59.240233 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s98d6" Jul 01 18:28:59.835623 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:59.835575 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24813269_84ea_45cf_abaa_61bce0686757.slice/crio-632e82838bfc860f7e69c1b8be8bf4ac9e22f2e0330fbb37acbd3b1c4ea110c5 WatchSource:0}: Error finding container 632e82838bfc860f7e69c1b8be8bf4ac9e22f2e0330fbb37acbd3b1c4ea110c5: Status 404 returned error can't find the container with id 632e82838bfc860f7e69c1b8be8bf4ac9e22f2e0330fbb37acbd3b1c4ea110c5 Jul 01 18:28:59.848627 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:59.848600 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5e4c9d_8324_468f_8148_cac3f9fe5609.slice/crio-8eda9b985ba3088614de15b57965bd44f872b077059f3ed526a71c9481bf34dc WatchSource:0}: Error finding container 8eda9b985ba3088614de15b57965bd44f872b077059f3ed526a71c9481bf34dc: Status 404 returned error can't find the container with id 8eda9b985ba3088614de15b57965bd44f872b077059f3ed526a71c9481bf34dc Jul 01 18:28:59.966689 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:28:59.966663 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz"] Jul 01 18:28:59.968866 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:28:59.968846 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c09e36_8f86_4437_80c0_d19a2ae1a0b6.slice/crio-50cf5c1ce8835f8d233ab4d2ec4b51cc25bb9b257b181dfdb9f1db0e14d8202b WatchSource:0}: Error finding container 50cf5c1ce8835f8d233ab4d2ec4b51cc25bb9b257b181dfdb9f1db0e14d8202b: Status 404 returned error can't find the container with id 50cf5c1ce8835f8d233ab4d2ec4b51cc25bb9b257b181dfdb9f1db0e14d8202b Jul 01 18:29:00.833895 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.833028 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmblh" event={"ID":"9177dafa-20be-48cc-95c4-4377d2536ea6","Type":"ContainerStarted","Data":"b6988af0c911b06ebcaa3d522150c03fbef0a9b9a7ed521c5e97b4683684ea49"} Jul 01 18:29:00.836544 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.836516 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s98d6" event={"ID":"df5e4c9d-8324-468f-8148-cac3f9fe5609","Type":"ContainerStarted","Data":"7e46f4049c6b291449bbcc26f7ed376a6352751b0c8d13085c65ee3aa3e2fc84"} Jul 01 18:29:00.836657 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.836565 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s98d6" event={"ID":"df5e4c9d-8324-468f-8148-cac3f9fe5609","Type":"ContainerStarted","Data":"8eda9b985ba3088614de15b57965bd44f872b077059f3ed526a71c9481bf34dc"} Jul 01 18:29:00.840073 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.840047 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" event={"ID":"90c09e36-8f86-4437-80c0-d19a2ae1a0b6","Type":"ContainerStarted","Data":"0cfb899d726efadc8b2131d87aa0593081fc5a95b5225c11a9d648e9f05697a1"} Jul 01 18:29:00.840182 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.840106 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" event={"ID":"90c09e36-8f86-4437-80c0-d19a2ae1a0b6","Type":"ContainerStarted","Data":"a6ec6b0c2e5d35a3f4224f28eee1c0c05f1bda7cfa7bbaf093c325d42a9e9a09"} Jul 01 18:29:00.840182 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.840136 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" event={"ID":"90c09e36-8f86-4437-80c0-d19a2ae1a0b6","Type":"ContainerStarted","Data":"50cf5c1ce8835f8d233ab4d2ec4b51cc25bb9b257b181dfdb9f1db0e14d8202b"} Jul 01 18:29:00.841358 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.841333 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" event={"ID":"24813269-84ea-45cf-abaa-61bce0686757","Type":"ContainerStarted","Data":"632e82838bfc860f7e69c1b8be8bf4ac9e22f2e0330fbb37acbd3b1c4ea110c5"} Jul 01 18:29:00.853088 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:00.853045 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nmblh" podStartSLOduration=38.527342522 podStartE2EDuration="46.853034022s" totalImagesPullingTime="8.3256915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:28:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:00.851944303 +0000 UTC m=+81.830946657" watchObservedRunningTime="2026-07-01 18:29:00.853034022 +0000 UTC m=+81.832036374" Jul 01 18:29:01.847841 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.847811 2528 generic.go:356] "Generic (PLEG): container finished" podID="df5e4c9d-8324-468f-8148-cac3f9fe5609" containerID="7e46f4049c6b291449bbcc26f7ed376a6352751b0c8d13085c65ee3aa3e2fc84" exitCode=0 Jul 01 18:29:01.848337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.847885 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s98d6" event={"ID":"df5e4c9d-8324-468f-8148-cac3f9fe5609","Type":"ContainerDied","Data":"7e46f4049c6b291449bbcc26f7ed376a6352751b0c8d13085c65ee3aa3e2fc84"} Jul 01 18:29:01.850860 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.850836 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" event={"ID":"90c09e36-8f86-4437-80c0-d19a2ae1a0b6","Type":"ContainerStarted","Data":"1e98947cc6bdf9646f124805695d7cde3dca3bbd29b1b3a77fde06ef5646dc69"} Jul 01 18:29:01.853238 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.853218 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" event={"ID":"24813269-84ea-45cf-abaa-61bce0686757","Type":"ContainerStarted","Data":"eaf4a72c6a33d1d3816069a8340034f1c95f68cc10ab641d7dbd12bea929a158"} Jul 01 18:29:01.853329 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.853269 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" event={"ID":"24813269-84ea-45cf-abaa-61bce0686757","Type":"ContainerStarted","Data":"09daecb110eb2af28ca131c0be1b4448d30757a51b2b3d10b9f0da42449d2d84"} Jul 01 18:29:01.853329 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.853300 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" event={"ID":"24813269-84ea-45cf-abaa-61bce0686757","Type":"ContainerStarted","Data":"9579b5870e05cad57ea1a4d60f52492c7b2afd432265fb893ffd9582b382257a"} Jul 01 18:29:01.886472 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.886427 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-q6hgz" podStartSLOduration=2.485272771 podStartE2EDuration="3.886411838s" totalImagesPullingTime="1.401139067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:01.885943704 +0000 UTC m=+82.864946056" watchObservedRunningTime="2026-07-01 18:29:01.886411838 +0000 UTC m=+82.865414189" Jul 01 18:29:01.906046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:01.905993 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-gc4ps" podStartSLOduration=2.255913751 podStartE2EDuration="3.9059733s" totalImagesPullingTime="1.650059549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:01.905558648 +0000 UTC m=+82.884561001" watchObservedRunningTime="2026-07-01 18:29:01.9059733 +0000 UTC m=+82.884975657" Jul 01 18:29:02.859933 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:02.859893 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s98d6" event={"ID":"df5e4c9d-8324-468f-8148-cac3f9fe5609","Type":"ContainerStarted","Data":"a89fdc1988b0cda08d30a4869ca7a00e6b266132edd278a5cc5aa685354319c5"} Jul 01 18:29:02.860317 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:02.859954 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s98d6" event={"ID":"df5e4c9d-8324-468f-8148-cac3f9fe5609","Type":"ContainerStarted","Data":"0f4b66d76b5ebb02f93014ce091dad303421ec1507a014775e2e3c7548e52a46"} Jul 01 18:29:02.883639 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:02.883595 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s98d6" podStartSLOduration=3.913407618 podStartE2EDuration="4.883580706s" totalImagesPullingTime="888.85247ms" totalInitContainerRuntime="81.320618ms" isStatefulPod=true podCreationTimestamp="2026-07-01 18:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:02.882741675 +0000 UTC m=+83.861744026" watchObservedRunningTime="2026-07-01 18:29:02.883580706 +0000 UTC m=+83.862583057" Jul 01 18:29:06.817521 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:06.817487 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h9fw2" Jul 01 18:29:16.762468 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:16.762440 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mznv5" Jul 01 18:29:24.571547 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:24.571516 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r7ls9_df3a5742-26c9-4161-ac23-7c45b90a8f9e/serve-healthcheck-canary/0.log" Jul 01 18:29:35.986173 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:35.986126 2528 generic.go:356] "Generic (PLEG): container finished" podID="144cb6a8-2ea3-4e98-8f81-865406276623" containerID="c458ab48f7143f5a11a389f9b27766215243ddec1a1825e21af7c9cf87c4454d" exitCode=0 Jul 01 18:29:35.986623 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:35.986220 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" event={"ID":"144cb6a8-2ea3-4e98-8f81-865406276623","Type":"ContainerDied","Data":"c458ab48f7143f5a11a389f9b27766215243ddec1a1825e21af7c9cf87c4454d"} Jul 01 18:29:35.986733 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:35.986713 2528 scope.go:117] "RemoveContainer" containerID="c458ab48f7143f5a11a389f9b27766215243ddec1a1825e21af7c9cf87c4454d" Jul 01 18:29:36.992545 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:29:36.992500 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-k8jkb" event={"ID":"144cb6a8-2ea3-4e98-8f81-865406276623","Type":"ContainerStarted","Data":"8bce168da00279602c58091526bb46a4ba0f1f0a0a68c80d4908acedd270b712"} Jul 01 18:32:16.931225 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:16.931139 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-vsjsz"] Jul 01 18:32:16.933225 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:16.933208 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:16.936163 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:16.936143 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 18:32:16.936266 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:16.936212 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ctzj4\"" Jul 01 18:32:16.937315 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:16.937298 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 18:32:16.946501 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:16.946480 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vsjsz"] Jul 01 18:32:17.026285 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.026258 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35ce912a-429d-4807-91b2-bda622b7c831-bound-sa-token\") pod \"cert-manager-59c77684cc-vsjsz\" (UID: \"35ce912a-429d-4807-91b2-bda622b7c831\") " pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:17.026440 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.026299 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrxqx\" (UniqueName: \"kubernetes.io/projected/35ce912a-429d-4807-91b2-bda622b7c831-kube-api-access-rrxqx\") pod \"cert-manager-59c77684cc-vsjsz\" (UID: \"35ce912a-429d-4807-91b2-bda622b7c831\") " pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:17.127603 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.127575 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35ce912a-429d-4807-91b2-bda622b7c831-bound-sa-token\") pod \"cert-manager-59c77684cc-vsjsz\" (UID: \"35ce912a-429d-4807-91b2-bda622b7c831\") " pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:17.127731 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.127614 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrxqx\" (UniqueName: \"kubernetes.io/projected/35ce912a-429d-4807-91b2-bda622b7c831-kube-api-access-rrxqx\") pod \"cert-manager-59c77684cc-vsjsz\" (UID: \"35ce912a-429d-4807-91b2-bda622b7c831\") " pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:17.138781 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.138758 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrxqx\" (UniqueName: \"kubernetes.io/projected/35ce912a-429d-4807-91b2-bda622b7c831-kube-api-access-rrxqx\") pod \"cert-manager-59c77684cc-vsjsz\" (UID: \"35ce912a-429d-4807-91b2-bda622b7c831\") " pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:17.140239 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.140221 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35ce912a-429d-4807-91b2-bda622b7c831-bound-sa-token\") pod \"cert-manager-59c77684cc-vsjsz\" (UID: \"35ce912a-429d-4807-91b2-bda622b7c831\") " pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:17.242200 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.242118 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vsjsz" Jul 01 18:32:17.368850 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.368713 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vsjsz"] Jul 01 18:32:17.371471 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:32:17.371444 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35ce912a_429d_4807_91b2_bda622b7c831.slice/crio-fa23095738253e3a0dd1d713daabeac0e7643a51830edd955c8162044d1c6a69 WatchSource:0}: Error finding container fa23095738253e3a0dd1d713daabeac0e7643a51830edd955c8162044d1c6a69: Status 404 returned error can't find the container with id fa23095738253e3a0dd1d713daabeac0e7643a51830edd955c8162044d1c6a69 Jul 01 18:32:17.548854 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:17.548825 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vsjsz" event={"ID":"35ce912a-429d-4807-91b2-bda622b7c831","Type":"ContainerStarted","Data":"fa23095738253e3a0dd1d713daabeac0e7643a51830edd955c8162044d1c6a69"} Jul 01 18:32:23.572711 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:23.572676 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vsjsz" event={"ID":"35ce912a-429d-4807-91b2-bda622b7c831","Type":"ContainerStarted","Data":"e20ee7462f907f51259a8aa6b0a780556c6a6cbbb3f16de4060bf1314e197f50"} Jul 01 18:32:23.594709 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:23.594653 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-vsjsz" podStartSLOduration=1.518957146 podStartE2EDuration="7.594638184s" totalImagesPullingTime="6.075681038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:23.593926945 +0000 UTC m=+284.572929308" watchObservedRunningTime="2026-07-01 18:32:23.594638184 +0000 UTC m=+284.573640536" Jul 01 18:32:24.316683 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.316654 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w"] Jul 01 18:32:24.318692 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.318676 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.321665 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.321649 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 18:32:24.322960 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.322930 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mjpqx\"" Jul 01 18:32:24.322960 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.322942 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:32:24.328651 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.328630 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w"] Jul 01 18:32:24.383432 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.383407 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abf6e9ea-a4ea-4858-a177-f03299cd699d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ttf4w\" (UID: \"abf6e9ea-a4ea-4858-a177-f03299cd699d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.383548 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.383473 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8fkp\" (UniqueName: \"kubernetes.io/projected/abf6e9ea-a4ea-4858-a177-f03299cd699d-kube-api-access-c8fkp\") pod \"openshift-lws-operator-fd8ccff4c-ttf4w\" (UID: \"abf6e9ea-a4ea-4858-a177-f03299cd699d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.484509 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.484485 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8fkp\" (UniqueName: \"kubernetes.io/projected/abf6e9ea-a4ea-4858-a177-f03299cd699d-kube-api-access-c8fkp\") pod \"openshift-lws-operator-fd8ccff4c-ttf4w\" (UID: \"abf6e9ea-a4ea-4858-a177-f03299cd699d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.484623 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.484521 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abf6e9ea-a4ea-4858-a177-f03299cd699d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ttf4w\" (UID: \"abf6e9ea-a4ea-4858-a177-f03299cd699d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.484833 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.484819 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abf6e9ea-a4ea-4858-a177-f03299cd699d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ttf4w\" (UID: \"abf6e9ea-a4ea-4858-a177-f03299cd699d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.494708 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.494678 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8fkp\" (UniqueName: \"kubernetes.io/projected/abf6e9ea-a4ea-4858-a177-f03299cd699d-kube-api-access-c8fkp\") pod \"openshift-lws-operator-fd8ccff4c-ttf4w\" (UID: \"abf6e9ea-a4ea-4858-a177-f03299cd699d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.627942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.627858 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" Jul 01 18:32:24.749925 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:24.749890 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w"] Jul 01 18:32:24.752571 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:32:24.752544 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabf6e9ea_a4ea_4858_a177_f03299cd699d.slice/crio-b0e95c6613f30ad6f87b4304d296d083fb16e0e843e60287b5c513a04f20c005 WatchSource:0}: Error finding container b0e95c6613f30ad6f87b4304d296d083fb16e0e843e60287b5c513a04f20c005: Status 404 returned error can't find the container with id b0e95c6613f30ad6f87b4304d296d083fb16e0e843e60287b5c513a04f20c005 Jul 01 18:32:25.581400 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:25.581350 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" event={"ID":"abf6e9ea-a4ea-4858-a177-f03299cd699d","Type":"ContainerStarted","Data":"b0e95c6613f30ad6f87b4304d296d083fb16e0e843e60287b5c513a04f20c005"} Jul 01 18:32:28.596056 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:28.596020 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" event={"ID":"abf6e9ea-a4ea-4858-a177-f03299cd699d","Type":"ContainerStarted","Data":"2642e6a3c968ae7b5a1d8dc0fb9e7d2ad13204a099ca1434386c5f45983eb01b"} Jul 01 18:32:28.622567 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:28.622524 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttf4w" podStartSLOduration=1.569387205 podStartE2EDuration="4.622508234s" totalImagesPullingTime="3.053121029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:28.62024175 +0000 UTC m=+289.599244101" watchObservedRunningTime="2026-07-01 18:32:28.622508234 +0000 UTC m=+289.601510586" Jul 01 18:32:39.411712 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:39.411682 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:32:39.414366 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:39.414340 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:32:39.419715 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:39.419694 2528 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 18:32:44.387130 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.387086 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq"] Jul 01 18:32:44.392628 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.392606 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.397097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.397080 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 18:32:44.397858 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.397827 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 18:32:44.398018 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.397870 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nzsjd\"" Jul 01 18:32:44.398149 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.397956 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 18:32:44.402578 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.402555 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 18:32:44.417232 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.417209 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq"] Jul 01 18:32:44.538938 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.538909 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnjz5\" (UniqueName: \"kubernetes.io/projected/ed0423c5-7374-49d0-adc3-2be7918e1a05-kube-api-access-nnjz5\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.538938 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.538942 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed0423c5-7374-49d0-adc3-2be7918e1a05-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.539151 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.538962 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed0423c5-7374-49d0-adc3-2be7918e1a05-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.539151 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.539018 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed0423c5-7374-49d0-adc3-2be7918e1a05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.539151 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.539079 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed0423c5-7374-49d0-adc3-2be7918e1a05-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.639602 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.639510 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed0423c5-7374-49d0-adc3-2be7918e1a05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.639602 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.639570 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed0423c5-7374-49d0-adc3-2be7918e1a05-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.639602 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.639594 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnjz5\" (UniqueName: \"kubernetes.io/projected/ed0423c5-7374-49d0-adc3-2be7918e1a05-kube-api-access-nnjz5\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.639843 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.639617 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed0423c5-7374-49d0-adc3-2be7918e1a05-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.639843 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.639637 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed0423c5-7374-49d0-adc3-2be7918e1a05-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.640115 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.640086 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed0423c5-7374-49d0-adc3-2be7918e1a05-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.642011 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.641985 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed0423c5-7374-49d0-adc3-2be7918e1a05-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.642308 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.642285 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed0423c5-7374-49d0-adc3-2be7918e1a05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.642405 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.642291 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed0423c5-7374-49d0-adc3-2be7918e1a05-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.657440 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.657419 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnjz5\" (UniqueName: \"kubernetes.io/projected/ed0423c5-7374-49d0-adc3-2be7918e1a05-kube-api-access-nnjz5\") pod \"opendatahub-operator-controller-manager-7bfc969986-wmtzq\" (UID: \"ed0423c5-7374-49d0-adc3-2be7918e1a05\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.702440 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.702414 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:44.836797 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.836771 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq"] Jul 01 18:32:44.840033 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:32:44.840010 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0423c5_7374_49d0_adc3_2be7918e1a05.slice/crio-60ba64b82ff21b2d2ec47f5db640a4b9f4f0e5f57f43c548cd4a080308d7ccbd WatchSource:0}: Error finding container 60ba64b82ff21b2d2ec47f5db640a4b9f4f0e5f57f43c548cd4a080308d7ccbd: Status 404 returned error can't find the container with id 60ba64b82ff21b2d2ec47f5db640a4b9f4f0e5f57f43c548cd4a080308d7ccbd Jul 01 18:32:44.841877 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:44.841861 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:32:45.656739 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:45.656705 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" event={"ID":"ed0423c5-7374-49d0-adc3-2be7918e1a05","Type":"ContainerStarted","Data":"60ba64b82ff21b2d2ec47f5db640a4b9f4f0e5f57f43c548cd4a080308d7ccbd"} Jul 01 18:32:48.674958 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:48.674921 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" event={"ID":"ed0423c5-7374-49d0-adc3-2be7918e1a05","Type":"ContainerStarted","Data":"c4ad66feac491afd01085ad3c79370a2bca8169d5737f6864ed74b590d11cfe8"} Jul 01 18:32:49.680157 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:49.680116 2528 generic.go:356] "Generic (PLEG): container finished" podID="ed0423c5-7374-49d0-adc3-2be7918e1a05" containerID="c4ad66feac491afd01085ad3c79370a2bca8169d5737f6864ed74b590d11cfe8" exitCode=0 Jul 01 18:32:49.680552 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:49.680203 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" event={"ID":"ed0423c5-7374-49d0-adc3-2be7918e1a05","Type":"ContainerDied","Data":"c4ad66feac491afd01085ad3c79370a2bca8169d5737f6864ed74b590d11cfe8"} Jul 01 18:32:50.690483 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:50.690447 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" event={"ID":"ed0423c5-7374-49d0-adc3-2be7918e1a05","Type":"ContainerStarted","Data":"8ce2846f4b3a21c4969516569c87e3de67f9145a9ebcb964af47d575bd416743"} Jul 01 18:32:50.690860 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:50.690555 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:32:50.718255 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:32:50.718216 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" podStartSLOduration=1.306164713 podStartE2EDuration="6.718200986s" totalImagesPullingTime="4.453154087s" totalInitContainerRuntime="958.882186ms" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:50.716594699 +0000 UTC m=+311.695597051" watchObservedRunningTime="2026-07-01 18:32:50.718200986 +0000 UTC m=+311.697203337" Jul 01 18:33:01.697294 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:01.697265 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-wmtzq" Jul 01 18:33:11.479397 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.479343 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf5845d-l7625"] Jul 01 18:33:11.482290 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.482272 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.485129 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.485102 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 18:33:11.485439 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.485420 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 18:33:11.485903 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.485885 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 18:33:11.487428 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.487414 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 18:33:11.498725 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.498698 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf5845d-l7625"] Jul 01 18:33:11.541936 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.541908 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxw27\" (UniqueName: \"kubernetes.io/projected/a3e11a7f-c848-4993-98bf-be483b9880fa-kube-api-access-jxw27\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.542092 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.541969 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3e11a7f-c848-4993-98bf-be483b9880fa-tmp\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.542092 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.542025 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3e11a7f-c848-4993-98bf-be483b9880fa-tls-certs\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.621962 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.621928 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zgd4c"] Jul 01 18:33:11.625000 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.624985 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:11.627942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.627917 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 18:33:11.628086 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.627958 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ddlvn\"" Jul 01 18:33:11.637398 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.637338 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zgd4c"] Jul 01 18:33:11.643301 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.643274 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxw27\" (UniqueName: \"kubernetes.io/projected/a3e11a7f-c848-4993-98bf-be483b9880fa-kube-api-access-jxw27\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.643439 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.643326 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41032492-a629-4387-a668-9e3d3544b685-cert\") pod \"odh-model-controller-6dc94f689f-zgd4c\" (UID: \"41032492-a629-4387-a668-9e3d3544b685\") " pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:11.643439 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.643368 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4djbd\" (UniqueName: \"kubernetes.io/projected/41032492-a629-4387-a668-9e3d3544b685-kube-api-access-4djbd\") pod \"odh-model-controller-6dc94f689f-zgd4c\" (UID: \"41032492-a629-4387-a668-9e3d3544b685\") " pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:11.643439 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.643429 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3e11a7f-c848-4993-98bf-be483b9880fa-tmp\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.643579 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.643493 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3e11a7f-c848-4993-98bf-be483b9880fa-tls-certs\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.646497 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.646462 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3e11a7f-c848-4993-98bf-be483b9880fa-tmp\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.646816 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.646768 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3e11a7f-c848-4993-98bf-be483b9880fa-tls-certs\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.656066 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.656039 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxw27\" (UniqueName: \"kubernetes.io/projected/a3e11a7f-c848-4993-98bf-be483b9880fa-kube-api-access-jxw27\") pod \"kube-auth-proxy-cdf5845d-l7625\" (UID: \"a3e11a7f-c848-4993-98bf-be483b9880fa\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.744272 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.744193 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41032492-a629-4387-a668-9e3d3544b685-cert\") pod \"odh-model-controller-6dc94f689f-zgd4c\" (UID: \"41032492-a629-4387-a668-9e3d3544b685\") " pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:11.744272 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.744240 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4djbd\" (UniqueName: \"kubernetes.io/projected/41032492-a629-4387-a668-9e3d3544b685-kube-api-access-4djbd\") pod \"odh-model-controller-6dc94f689f-zgd4c\" (UID: \"41032492-a629-4387-a668-9e3d3544b685\") " pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:11.744494 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:11.744366 2528 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 18:33:11.744494 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:11.744446 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41032492-a629-4387-a668-9e3d3544b685-cert podName:41032492-a629-4387-a668-9e3d3544b685 nodeName:}" failed. No retries permitted until 2026-07-01 18:33:12.24443059 +0000 UTC m=+333.223432927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41032492-a629-4387-a668-9e3d3544b685-cert") pod "odh-model-controller-6dc94f689f-zgd4c" (UID: "41032492-a629-4387-a668-9e3d3544b685") : secret "odh-model-controller-webhook-cert" not found Jul 01 18:33:11.753637 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.753619 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4djbd\" (UniqueName: \"kubernetes.io/projected/41032492-a629-4387-a668-9e3d3544b685-kube-api-access-4djbd\") pod \"odh-model-controller-6dc94f689f-zgd4c\" (UID: \"41032492-a629-4387-a668-9e3d3544b685\") " pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:11.792326 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.792303 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" Jul 01 18:33:11.922681 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:11.922652 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf5845d-l7625"] Jul 01 18:33:11.926303 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:11.926283 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e11a7f_c848_4993_98bf_be483b9880fa.slice/crio-e1852f1fb597d947f33585a07500f7424c10558fc69192fb548a73d14d4f8dd2 WatchSource:0}: Error finding container e1852f1fb597d947f33585a07500f7424c10558fc69192fb548a73d14d4f8dd2: Status 404 returned error can't find the container with id e1852f1fb597d947f33585a07500f7424c10558fc69192fb548a73d14d4f8dd2 Jul 01 18:33:12.248060 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.248025 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41032492-a629-4387-a668-9e3d3544b685-cert\") pod \"odh-model-controller-6dc94f689f-zgd4c\" (UID: \"41032492-a629-4387-a668-9e3d3544b685\") " pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:12.250562 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.250539 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41032492-a629-4387-a668-9e3d3544b685-cert\") pod \"odh-model-controller-6dc94f689f-zgd4c\" (UID: \"41032492-a629-4387-a668-9e3d3544b685\") " pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:12.361785 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.361739 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rb8gj"] Jul 01 18:33:12.366585 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.366563 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.369675 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.369653 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 18:33:12.376758 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.376735 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rb8gj"] Jul 01 18:33:12.449930 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.449903 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b03fa292-bcc2-4c28-a1cc-a403c789881e-tls-certs\") pod \"model-serving-api-5dd488fc48-rb8gj\" (UID: \"b03fa292-bcc2-4c28-a1cc-a403c789881e\") " pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.450036 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.449934 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hb79\" (UniqueName: \"kubernetes.io/projected/b03fa292-bcc2-4c28-a1cc-a403c789881e-kube-api-access-8hb79\") pod \"model-serving-api-5dd488fc48-rb8gj\" (UID: \"b03fa292-bcc2-4c28-a1cc-a403c789881e\") " pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.537245 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.537222 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:12.551039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.551018 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b03fa292-bcc2-4c28-a1cc-a403c789881e-tls-certs\") pod \"model-serving-api-5dd488fc48-rb8gj\" (UID: \"b03fa292-bcc2-4c28-a1cc-a403c789881e\") " pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.551132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.551051 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hb79\" (UniqueName: \"kubernetes.io/projected/b03fa292-bcc2-4c28-a1cc-a403c789881e-kube-api-access-8hb79\") pod \"model-serving-api-5dd488fc48-rb8gj\" (UID: \"b03fa292-bcc2-4c28-a1cc-a403c789881e\") " pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.553475 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.553453 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b03fa292-bcc2-4c28-a1cc-a403c789881e-tls-certs\") pod \"model-serving-api-5dd488fc48-rb8gj\" (UID: \"b03fa292-bcc2-4c28-a1cc-a403c789881e\") " pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.564078 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.564051 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hb79\" (UniqueName: \"kubernetes.io/projected/b03fa292-bcc2-4c28-a1cc-a403c789881e-kube-api-access-8hb79\") pod \"model-serving-api-5dd488fc48-rb8gj\" (UID: \"b03fa292-bcc2-4c28-a1cc-a403c789881e\") " pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.668438 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.668392 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zgd4c"] Jul 01 18:33:12.670366 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:12.670338 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41032492_a629_4387_a668_9e3d3544b685.slice/crio-f6f9bd5997bf0bae8b460265fbd254780917a6ce80bf2e7c76250f5def56a672 WatchSource:0}: Error finding container f6f9bd5997bf0bae8b460265fbd254780917a6ce80bf2e7c76250f5def56a672: Status 404 returned error can't find the container with id f6f9bd5997bf0bae8b460265fbd254780917a6ce80bf2e7c76250f5def56a672 Jul 01 18:33:12.679087 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.679067 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:12.771561 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.771526 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-27tsz"] Jul 01 18:33:12.775310 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.775289 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.778113 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.778092 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 18:33:12.778226 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.778157 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 18:33:12.778435 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.778418 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 18:33:12.778737 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.778521 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 18:33:12.778737 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.778544 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b2dcm\"" Jul 01 18:33:12.783059 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.783031 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" event={"ID":"41032492-a629-4387-a668-9e3d3544b685","Type":"ContainerStarted","Data":"f6f9bd5997bf0bae8b460265fbd254780917a6ce80bf2e7c76250f5def56a672"} Jul 01 18:33:12.784440 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.784415 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" event={"ID":"a3e11a7f-c848-4993-98bf-be483b9880fa","Type":"ContainerStarted","Data":"e1852f1fb597d947f33585a07500f7424c10558fc69192fb548a73d14d4f8dd2"} Jul 01 18:33:12.788254 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.788189 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-27tsz"] Jul 01 18:33:12.818545 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.818522 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rb8gj"] Jul 01 18:33:12.821266 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:12.821239 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03fa292_bcc2_4c28_a1cc_a403c789881e.slice/crio-3765b79f36a5ede4c548dabdc9a084a8b3425eefac968795b74ffab7af3a755a WatchSource:0}: Error finding container 3765b79f36a5ede4c548dabdc9a084a8b3425eefac968795b74ffab7af3a755a: Status 404 returned error can't find the container with id 3765b79f36a5ede4c548dabdc9a084a8b3425eefac968795b74ffab7af3a755a Jul 01 18:33:12.853010 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.852990 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.853096 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.853023 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f352df02-8c31-409c-8c24-c1267598ad49-local-certs\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.853096 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.853040 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-istio-token\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.853096 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.853080 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlqr2\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-kube-api-access-xlqr2\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.853218 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.853118 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-cacerts\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.853218 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.853190 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.853285 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.853276 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.953991 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.953966 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f352df02-8c31-409c-8c24-c1267598ad49-local-certs\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.954116 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.954001 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-istio-token\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.954116 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.954029 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlqr2\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-kube-api-access-xlqr2\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.954116 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.954063 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-cacerts\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.954116 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.954095 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.954318 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.954163 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.954318 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.954203 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.954845 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.954806 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.956696 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.956669 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.956781 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.956708 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.956884 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.956865 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f352df02-8c31-409c-8c24-c1267598ad49-local-certs\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.956920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.956903 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-cacerts\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.962415 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.962398 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-istio-token\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:12.962903 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:12.962878 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlqr2\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-kube-api-access-xlqr2\") pod \"istiod-openshift-gateway-7574459656-27tsz\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:13.088855 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:13.088782 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:13.240920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:13.240855 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-27tsz"] Jul 01 18:33:13.243765 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:13.243738 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf352df02_8c31_409c_8c24_c1267598ad49.slice/crio-290437e30708050f08f3a033f7c446d786b4ec3c92d4cd24b24ad04092a6d781 WatchSource:0}: Error finding container 290437e30708050f08f3a033f7c446d786b4ec3c92d4cd24b24ad04092a6d781: Status 404 returned error can't find the container with id 290437e30708050f08f3a033f7c446d786b4ec3c92d4cd24b24ad04092a6d781 Jul 01 18:33:13.792354 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:13.792257 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" event={"ID":"b03fa292-bcc2-4c28-a1cc-a403c789881e","Type":"ContainerStarted","Data":"3765b79f36a5ede4c548dabdc9a084a8b3425eefac968795b74ffab7af3a755a"} Jul 01 18:33:13.794245 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:13.794208 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" event={"ID":"f352df02-8c31-409c-8c24-c1267598ad49","Type":"ContainerStarted","Data":"290437e30708050f08f3a033f7c446d786b4ec3c92d4cd24b24ad04092a6d781"} Jul 01 18:33:18.813298 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:18.813263 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:18.813677 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:18.813325 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:18.820969 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:18.820943 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" event={"ID":"a3e11a7f-c848-4993-98bf-be483b9880fa","Type":"ContainerStarted","Data":"049a0540c5293fba8d97a5e35bf0c29f6659ad5b1ec0f4594835a18e481f02be"} Jul 01 18:33:18.840029 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:18.839988 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cdf5845d-l7625" podStartSLOduration=1.021333637 podStartE2EDuration="7.839970317s" totalImagesPullingTime="6.81863668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:18.839459343 +0000 UTC m=+339.818461697" watchObservedRunningTime="2026-07-01 18:33:18.839970317 +0000 UTC m=+339.818972680" Jul 01 18:33:19.829438 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.829400 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" event={"ID":"41032492-a629-4387-a668-9e3d3544b685","Type":"ContainerStarted","Data":"52b1fe1b75e39842e2cef326b2b3fab51ca208ad15c0385303f3fdc2f40b3e67"} Jul 01 18:33:19.830095 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.830073 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:19.831850 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.831790 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" event={"ID":"f352df02-8c31-409c-8c24-c1267598ad49","Type":"ContainerStarted","Data":"940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f"} Jul 01 18:33:19.835683 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.835624 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" event={"ID":"b03fa292-bcc2-4c28-a1cc-a403c789881e","Type":"ContainerStarted","Data":"405c1597125898a62de15e4db0196d7919fdf5a54f98148e55c9b7a1674cbe1a"} Jul 01 18:33:19.836098 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.836048 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:19.854349 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.854292 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" podStartSLOduration=2.775679482 podStartE2EDuration="8.854272339s" totalImagesPullingTime="6.078592857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:19.851162123 +0000 UTC m=+340.830164490" watchObservedRunningTime="2026-07-01 18:33:19.854272339 +0000 UTC m=+340.833274693" Jul 01 18:33:19.885593 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.885548 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" podStartSLOduration=1.9512596690000001 podStartE2EDuration="7.885531697s" totalImagesPullingTime="5.934272028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:19.884535782 +0000 UTC m=+340.863538137" watchObservedRunningTime="2026-07-01 18:33:19.885531697 +0000 UTC m=+340.864534048" Jul 01 18:33:19.910170 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:19.910111 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" podStartSLOduration=2.343100334 podStartE2EDuration="7.910089954s" totalImagesPullingTime="5.56698962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:19.908195935 +0000 UTC m=+340.887198289" watchObservedRunningTime="2026-07-01 18:33:19.910089954 +0000 UTC m=+340.889092308" Jul 01 18:33:20.083449 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.082735 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c"] Jul 01 18:33:20.086097 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.086075 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.089155 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.089132 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kpx77\"" Jul 01 18:33:20.104179 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.104156 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c"] Jul 01 18:33:20.118538 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118517 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118636 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118555 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118636 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118577 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118734 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118644 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118734 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118663 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cklqq\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-kube-api-access-cklqq\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118734 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118693 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118883 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118774 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118883 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118825 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.118883 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.118860 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220251 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220218 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220251 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220254 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220488 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220277 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220488 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220299 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220488 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220337 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220488 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220364 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220488 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220422 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220488 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220445 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cklqq\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-kube-api-access-cklqq\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220488 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220470 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220824 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220748 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220910 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220884 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.220978 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220935 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.221033 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.220988 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.221114 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.221095 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.222980 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.222955 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.223246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.223227 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.234368 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.234346 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cklqq\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-kube-api-access-cklqq\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.262686 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.262665 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.329904 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.329875 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f"] Jul 01 18:33:20.334199 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.334155 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.384979 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.384945 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f"] Jul 01 18:33:20.398528 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.398507 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:20.422469 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422439 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1219490-9452-4877-b2af-68cef9deae02-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422585 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422491 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422585 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422550 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1219490-9452-4877-b2af-68cef9deae02-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422677 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422623 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422677 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422651 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422757 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422724 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcp9z\" (UniqueName: \"kubernetes.io/projected/d1219490-9452-4877-b2af-68cef9deae02-kube-api-access-kcp9z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422834 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422815 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1219490-9452-4877-b2af-68cef9deae02-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422855 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.422977 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.422960 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524065 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524036 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524094 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524118 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1219490-9452-4877-b2af-68cef9deae02-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524143 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524169 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1219490-9452-4877-b2af-68cef9deae02-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524195 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524246 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524231 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524583 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524275 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcp9z\" (UniqueName: \"kubernetes.io/projected/d1219490-9452-4877-b2af-68cef9deae02-kube-api-access-kcp9z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524583 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524320 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1219490-9452-4877-b2af-68cef9deae02-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524583 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524517 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524810 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524635 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524810 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524753 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.524810 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.524794 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.525025 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.525010 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1219490-9452-4877-b2af-68cef9deae02-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.527090 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.527060 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1219490-9452-4877-b2af-68cef9deae02-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.527814 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.527798 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1219490-9452-4877-b2af-68cef9deae02-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.536661 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.536641 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1219490-9452-4877-b2af-68cef9deae02-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.536796 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.536776 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcp9z\" (UniqueName: \"kubernetes.io/projected/d1219490-9452-4877-b2af-68cef9deae02-kube-api-access-kcp9z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g789f\" (UID: \"d1219490-9452-4877-b2af-68cef9deae02\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.554324 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.554300 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c"] Jul 01 18:33:20.558007 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:20.557985 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf066d1f_1a97_4a64_8fde_232d2fc3ac28.slice/crio-75edbd9d51b93524202f9c2b0602c0a33944c7c110f20ef1101c8c571265bd9a WatchSource:0}: Error finding container 75edbd9d51b93524202f9c2b0602c0a33944c7c110f20ef1101c8c571265bd9a: Status 404 returned error can't find the container with id 75edbd9d51b93524202f9c2b0602c0a33944c7c110f20ef1101c8c571265bd9a Jul 01 18:33:20.644137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.644078 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:20.774462 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.774435 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f"] Jul 01 18:33:20.776428 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:20.776399 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1219490_9452_4877_b2af_68cef9deae02.slice/crio-b9dda0ecfe8fac04880e3abdd187e051a699cfd6ec36e3a3658884876aa9ca29 WatchSource:0}: Error finding container b9dda0ecfe8fac04880e3abdd187e051a699cfd6ec36e3a3658884876aa9ca29: Status 404 returned error can't find the container with id b9dda0ecfe8fac04880e3abdd187e051a699cfd6ec36e3a3658884876aa9ca29 Jul 01 18:33:20.840723 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.840693 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" event={"ID":"d1219490-9452-4877-b2af-68cef9deae02","Type":"ContainerStarted","Data":"b9dda0ecfe8fac04880e3abdd187e051a699cfd6ec36e3a3658884876aa9ca29"} Jul 01 18:33:20.841968 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.841941 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" event={"ID":"bf066d1f-1a97-4a64-8fde-232d2fc3ac28","Type":"ContainerStarted","Data":"75edbd9d51b93524202f9c2b0602c0a33944c7c110f20ef1101c8c571265bd9a"} Jul 01 18:33:20.842244 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.842217 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:20.843719 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:20.843702 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:21.878419 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.878330 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-92gld"] Jul 01 18:33:21.943125 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.942399 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-92gld"] Jul 01 18:33:21.943125 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.942514 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:21.943125 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.942526 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb"] Jul 01 18:33:21.945969 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.945590 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sbhcx\"" Jul 01 18:33:21.945969 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.945831 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 18:33:21.959230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.959030 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb"] Jul 01 18:33:21.959230 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.959145 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:21.962219 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.962197 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 01 18:33:21.962442 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:21.962421 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xqwp5\"" Jul 01 18:33:22.038199 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.038165 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72mvm\" (UniqueName: \"kubernetes.io/projected/5035ec09-82f8-4fe7-8fbb-2541d3943b68-kube-api-access-72mvm\") pod \"kserve-controller-manager-69fc866d76-92gld\" (UID: \"5035ec09-82f8-4fe7-8fbb-2541d3943b68\") " pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:22.038199 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.038203 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:22.038457 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.038229 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9kll\" (UniqueName: \"kubernetes.io/projected/2aaff639-a6e0-4752-b729-9fe401206686-kube-api-access-g9kll\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:22.038457 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.038311 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5035ec09-82f8-4fe7-8fbb-2541d3943b68-cert\") pod \"kserve-controller-manager-69fc866d76-92gld\" (UID: \"5035ec09-82f8-4fe7-8fbb-2541d3943b68\") " pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:22.139088 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.138994 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5035ec09-82f8-4fe7-8fbb-2541d3943b68-cert\") pod \"kserve-controller-manager-69fc866d76-92gld\" (UID: \"5035ec09-82f8-4fe7-8fbb-2541d3943b68\") " pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:22.139088 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.139065 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72mvm\" (UniqueName: \"kubernetes.io/projected/5035ec09-82f8-4fe7-8fbb-2541d3943b68-kube-api-access-72mvm\") pod \"kserve-controller-manager-69fc866d76-92gld\" (UID: \"5035ec09-82f8-4fe7-8fbb-2541d3943b68\") " pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:22.139302 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.139107 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:22.139302 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.139148 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9kll\" (UniqueName: \"kubernetes.io/projected/2aaff639-a6e0-4752-b729-9fe401206686-kube-api-access-g9kll\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:22.139481 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:22.139403 2528 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 18:33:22.139551 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:22.139485 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert podName:2aaff639-a6e0-4752-b729-9fe401206686 nodeName:}" failed. No retries permitted until 2026-07-01 18:33:22.639464475 +0000 UTC m=+343.618466821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert") pod "llmisvc-controller-manager-864bfd7bc9-vqvrb" (UID: "2aaff639-a6e0-4752-b729-9fe401206686") : secret "llmisvc-webhook-server-cert" not found Jul 01 18:33:22.141840 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.141821 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5035ec09-82f8-4fe7-8fbb-2541d3943b68-cert\") pod \"kserve-controller-manager-69fc866d76-92gld\" (UID: \"5035ec09-82f8-4fe7-8fbb-2541d3943b68\") " pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:22.158597 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.158577 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72mvm\" (UniqueName: \"kubernetes.io/projected/5035ec09-82f8-4fe7-8fbb-2541d3943b68-kube-api-access-72mvm\") pod \"kserve-controller-manager-69fc866d76-92gld\" (UID: \"5035ec09-82f8-4fe7-8fbb-2541d3943b68\") " pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:22.163576 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.163557 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9kll\" (UniqueName: \"kubernetes.io/projected/2aaff639-a6e0-4752-b729-9fe401206686-kube-api-access-g9kll\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:22.256684 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.256656 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:22.463195 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.463066 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-92gld"] Jul 01 18:33:22.471523 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:22.469578 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5035ec09_82f8_4fe7_8fbb_2541d3943b68.slice/crio-c75df57a07df4ad4a70518f0d44245f0e968059c062a5e3833c16f79a37b55ba WatchSource:0}: Error finding container c75df57a07df4ad4a70518f0d44245f0e968059c062a5e3833c16f79a37b55ba: Status 404 returned error can't find the container with id c75df57a07df4ad4a70518f0d44245f0e968059c062a5e3833c16f79a37b55ba Jul 01 18:33:22.644141 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.643834 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:22.644517 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:22.644486 2528 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 18:33:22.644617 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:22.644568 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert podName:2aaff639-a6e0-4752-b729-9fe401206686 nodeName:}" failed. No retries permitted until 2026-07-01 18:33:23.644548814 +0000 UTC m=+344.623551162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert") pod "llmisvc-controller-manager-864bfd7bc9-vqvrb" (UID: "2aaff639-a6e0-4752-b729-9fe401206686") : secret "llmisvc-webhook-server-cert" not found Jul 01 18:33:22.857932 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:22.857889 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" event={"ID":"5035ec09-82f8-4fe7-8fbb-2541d3943b68","Type":"ContainerStarted","Data":"c75df57a07df4ad4a70518f0d44245f0e968059c062a5e3833c16f79a37b55ba"} Jul 01 18:33:23.282206 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.282171 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-27tsz"] Jul 01 18:33:23.655441 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.655331 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:23.662583 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.662555 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaff639-a6e0-4752-b729-9fe401206686-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vqvrb\" (UID: \"2aaff639-a6e0-4752-b729-9fe401206686\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:23.771456 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.771426 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:23.862140 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.862094 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" podUID="f352df02-8c31-409c-8c24-c1267598ad49" containerName="discovery" containerID="cri-o://940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f" gracePeriod=30 Jul 01 18:33:23.920570 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.920527 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:23.920693 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.920620 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:23.920693 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.920661 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:23.925957 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.925929 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:23.926042 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.925994 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:23.926042 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:23.926028 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:33:24.016920 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.016883 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb"] Jul 01 18:33:24.019638 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:24.019612 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2aaff639_a6e0_4752_b729_9fe401206686.slice/crio-68eb1b430caab7b03ebc7c9bd7247cdb4c384b15d47406bb585c3bb344baeb9a WatchSource:0}: Error finding container 68eb1b430caab7b03ebc7c9bd7247cdb4c384b15d47406bb585c3bb344baeb9a: Status 404 returned error can't find the container with id 68eb1b430caab7b03ebc7c9bd7247cdb4c384b15d47406bb585c3bb344baeb9a Jul 01 18:33:24.112201 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.112175 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:24.161804 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.161711 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-ca-configmap\") pod \"f352df02-8c31-409c-8c24-c1267598ad49\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " Jul 01 18:33:24.161804 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.161767 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-kubeconfig\") pod \"f352df02-8c31-409c-8c24-c1267598ad49\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " Jul 01 18:33:24.162039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.161823 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlqr2\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-kube-api-access-xlqr2\") pod \"f352df02-8c31-409c-8c24-c1267598ad49\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " Jul 01 18:33:24.162039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.161854 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f352df02-8c31-409c-8c24-c1267598ad49-local-certs\") pod \"f352df02-8c31-409c-8c24-c1267598ad49\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " Jul 01 18:33:24.162039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.161878 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-dns-cert\") pod \"f352df02-8c31-409c-8c24-c1267598ad49\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " Jul 01 18:33:24.162039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.161918 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-cacerts\") pod \"f352df02-8c31-409c-8c24-c1267598ad49\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " Jul 01 18:33:24.162039 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.161999 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-istio-token\") pod \"f352df02-8c31-409c-8c24-c1267598ad49\" (UID: \"f352df02-8c31-409c-8c24-c1267598ad49\") " Jul 01 18:33:24.162295 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.162187 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f352df02-8c31-409c-8c24-c1267598ad49" (UID: "f352df02-8c31-409c-8c24-c1267598ad49"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:33:24.165581 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.165477 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-cacerts" (OuterVolumeSpecName: "cacerts") pod "f352df02-8c31-409c-8c24-c1267598ad49" (UID: "f352df02-8c31-409c-8c24-c1267598ad49"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:33:24.165581 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.165550 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f352df02-8c31-409c-8c24-c1267598ad49" (UID: "f352df02-8c31-409c-8c24-c1267598ad49"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:33:24.165581 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.165564 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-istio-token" (OuterVolumeSpecName: "istio-token") pod "f352df02-8c31-409c-8c24-c1267598ad49" (UID: "f352df02-8c31-409c-8c24-c1267598ad49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:33:24.165797 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.165585 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f352df02-8c31-409c-8c24-c1267598ad49-local-certs" (OuterVolumeSpecName: "local-certs") pod "f352df02-8c31-409c-8c24-c1267598ad49" (UID: "f352df02-8c31-409c-8c24-c1267598ad49"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:33:24.165951 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.165929 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f352df02-8c31-409c-8c24-c1267598ad49" (UID: "f352df02-8c31-409c-8c24-c1267598ad49"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:33:24.166959 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.166932 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-kube-api-access-xlqr2" (OuterVolumeSpecName: "kube-api-access-xlqr2") pod "f352df02-8c31-409c-8c24-c1267598ad49" (UID: "f352df02-8c31-409c-8c24-c1267598ad49"). InnerVolumeSpecName "kube-api-access-xlqr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:33:24.263373 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.263231 2528 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-istio-token\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:24.263373 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.263268 2528 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-ca-configmap\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:24.263373 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.263285 2528 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-kubeconfig\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:24.263373 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.263299 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlqr2\" (UniqueName: \"kubernetes.io/projected/f352df02-8c31-409c-8c24-c1267598ad49-kube-api-access-xlqr2\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:24.263373 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.263315 2528 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f352df02-8c31-409c-8c24-c1267598ad49-local-certs\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:24.263373 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.263329 2528 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-istio-csr-dns-cert\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:24.263373 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.263343 2528 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f352df02-8c31-409c-8c24-c1267598ad49-cacerts\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:24.870445 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.870401 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" event={"ID":"d1219490-9452-4877-b2af-68cef9deae02","Type":"ContainerStarted","Data":"f169e095aaba892531f02d1d49b1cd12eaca02b6442b9f841dd44b4bdd476dcd"} Jul 01 18:33:24.871774 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.871746 2528 generic.go:356] "Generic (PLEG): container finished" podID="f352df02-8c31-409c-8c24-c1267598ad49" containerID="940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f" exitCode=0 Jul 01 18:33:24.871909 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.871785 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" Jul 01 18:33:24.871909 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.871828 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" event={"ID":"f352df02-8c31-409c-8c24-c1267598ad49","Type":"ContainerDied","Data":"940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f"} Jul 01 18:33:24.871909 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.871880 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-27tsz" event={"ID":"f352df02-8c31-409c-8c24-c1267598ad49","Type":"ContainerDied","Data":"290437e30708050f08f3a033f7c446d786b4ec3c92d4cd24b24ad04092a6d781"} Jul 01 18:33:24.871909 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.871905 2528 scope.go:117] "RemoveContainer" containerID="940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f" Jul 01 18:33:24.874075 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.874048 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" event={"ID":"bf066d1f-1a97-4a64-8fde-232d2fc3ac28","Type":"ContainerStarted","Data":"edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde"} Jul 01 18:33:24.875664 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.875640 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" event={"ID":"2aaff639-a6e0-4752-b729-9fe401206686","Type":"ContainerStarted","Data":"68eb1b430caab7b03ebc7c9bd7247cdb4c384b15d47406bb585c3bb344baeb9a"} Jul 01 18:33:24.896087 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.895563 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" podStartSLOduration=1.748334382 podStartE2EDuration="4.8955444s" totalImagesPullingTime="3.147210018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:24.893634521 +0000 UTC m=+345.872636886" watchObservedRunningTime="2026-07-01 18:33:24.8955444 +0000 UTC m=+345.874546754" Jul 01 18:33:24.914608 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.914559 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" podStartSLOduration=1.554863805 podStartE2EDuration="4.914538975s" totalImagesPullingTime="3.35967517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:24.912798698 +0000 UTC m=+345.891801043" watchObservedRunningTime="2026-07-01 18:33:24.914538975 +0000 UTC m=+345.893541329" Jul 01 18:33:24.927663 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.927596 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-27tsz"] Jul 01 18:33:24.934178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.934138 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-27tsz"] Jul 01 18:33:24.951500 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.951365 2528 scope.go:117] "RemoveContainer" containerID="940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f" Jul 01 18:33:24.951784 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:24.951752 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f\": container with ID starting with 940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f not found: ID does not exist" containerID="940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f" Jul 01 18:33:24.951865 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:24.951799 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f"} err="failed to get container status \"940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f\": rpc error: code = NotFound desc = could not find container \"940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f\": container with ID starting with 940e7519c51532974d089592dcd4c6ef91c356732710ab4630d144e0504b983f not found: ID does not exist" Jul 01 18:33:25.399752 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.399669 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:25.401438 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.401373 2528 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 01 18:33:25.401576 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.401457 2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 01 18:33:25.479755 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.479702 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f352df02-8c31-409c-8c24-c1267598ad49" path="/var/lib/kubelet/pods/f352df02-8c31-409c-8c24-c1267598ad49/volumes" Jul 01 18:33:25.644990 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.644958 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:25.651320 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.651247 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:25.883960 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.883903 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:25.885077 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.885032 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g789f" Jul 01 18:33:25.942586 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:25.942509 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c"] Jul 01 18:33:26.399875 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.399832 2528 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 01 18:33:26.400031 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.399898 2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 01 18:33:26.615257 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.615225 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-84b695bfbb-v54lj"] Jul 01 18:33:26.615704 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.615680 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f352df02-8c31-409c-8c24-c1267598ad49" containerName="discovery" Jul 01 18:33:26.615704 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.615705 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="f352df02-8c31-409c-8c24-c1267598ad49" containerName="discovery" Jul 01 18:33:26.615873 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.615777 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="f352df02-8c31-409c-8c24-c1267598ad49" containerName="discovery" Jul 01 18:33:26.618733 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.618714 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:26.621720 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.621679 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 18:33:26.621874 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.621839 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mjrjx\"" Jul 01 18:33:26.628327 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.628304 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84b695bfbb-v54lj"] Jul 01 18:33:26.686522 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.686490 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhmv2\" (UniqueName: \"kubernetes.io/projected/541c9102-8d1d-437b-89e8-ff9dff6a8a1e-kube-api-access-lhmv2\") pod \"dashboard-redirect-84b695bfbb-v54lj\" (UID: \"541c9102-8d1d-437b-89e8-ff9dff6a8a1e\") " pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:26.686673 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.686560 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/541c9102-8d1d-437b-89e8-ff9dff6a8a1e-redirect-config\") pod \"dashboard-redirect-84b695bfbb-v54lj\" (UID: \"541c9102-8d1d-437b-89e8-ff9dff6a8a1e\") " pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:26.787662 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.787636 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmv2\" (UniqueName: \"kubernetes.io/projected/541c9102-8d1d-437b-89e8-ff9dff6a8a1e-kube-api-access-lhmv2\") pod \"dashboard-redirect-84b695bfbb-v54lj\" (UID: \"541c9102-8d1d-437b-89e8-ff9dff6a8a1e\") " pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:26.787807 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.787695 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/541c9102-8d1d-437b-89e8-ff9dff6a8a1e-redirect-config\") pod \"dashboard-redirect-84b695bfbb-v54lj\" (UID: \"541c9102-8d1d-437b-89e8-ff9dff6a8a1e\") " pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:26.788400 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.788358 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/541c9102-8d1d-437b-89e8-ff9dff6a8a1e-redirect-config\") pod \"dashboard-redirect-84b695bfbb-v54lj\" (UID: \"541c9102-8d1d-437b-89e8-ff9dff6a8a1e\") " pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:26.796356 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.796332 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhmv2\" (UniqueName: \"kubernetes.io/projected/541c9102-8d1d-437b-89e8-ff9dff6a8a1e-kube-api-access-lhmv2\") pod \"dashboard-redirect-84b695bfbb-v54lj\" (UID: \"541c9102-8d1d-437b-89e8-ff9dff6a8a1e\") " pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:26.888751 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.888681 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" event={"ID":"5035ec09-82f8-4fe7-8fbb-2541d3943b68","Type":"ContainerStarted","Data":"396ecf36d4fc6e0286676c182046187db121be497c3581f032c825eeb73bc646"} Jul 01 18:33:26.889100 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.888845 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:26.909317 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.909275 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" podStartSLOduration=2.130774694 podStartE2EDuration="5.909262182s" totalImagesPullingTime="3.778487488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:26.90786926 +0000 UTC m=+347.886871612" watchObservedRunningTime="2026-07-01 18:33:26.909262182 +0000 UTC m=+347.888264533" Jul 01 18:33:26.929765 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:26.929742 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" Jul 01 18:33:27.108143 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.108119 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84b695bfbb-v54lj"] Jul 01 18:33:27.109978 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:33:27.109947 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541c9102_8d1d_437b_89e8_ff9dff6a8a1e.slice/crio-5e3e512859276495ff5272b620f57b50137f35a89f219883e95aeaa170f92f0e WatchSource:0}: Error finding container 5e3e512859276495ff5272b620f57b50137f35a89f219883e95aeaa170f92f0e: Status 404 returned error can't find the container with id 5e3e512859276495ff5272b620f57b50137f35a89f219883e95aeaa170f92f0e Jul 01 18:33:27.398928 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.398889 2528 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 01 18:33:27.399111 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.398954 2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 01 18:33:27.894655 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.894620 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" event={"ID":"2aaff639-a6e0-4752-b729-9fe401206686","Type":"ContainerStarted","Data":"e9dca1b3d499ee6328b80fb52a50a39ea27e876351761a79b4ba0b05c164be87"} Jul 01 18:33:27.895004 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.894719 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:33:27.895904 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.895881 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" event={"ID":"541c9102-8d1d-437b-89e8-ff9dff6a8a1e","Type":"ContainerStarted","Data":"5e3e512859276495ff5272b620f57b50137f35a89f219883e95aeaa170f92f0e"} Jul 01 18:33:27.896178 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.896156 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerName="istio-proxy" containerID="cri-o://edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde" gracePeriod=30 Jul 01 18:33:27.913414 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:27.913349 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" podStartSLOduration=3.20664394 podStartE2EDuration="6.913336666s" totalImagesPullingTime="3.706692726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:27.912729365 +0000 UTC m=+348.891731719" watchObservedRunningTime="2026-07-01 18:33:27.913336666 +0000 UTC m=+348.892339042" Jul 01 18:33:30.848601 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:30.848529 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-rb8gj" Jul 01 18:33:30.863750 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:30.863726 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-zgd4c" Jul 01 18:33:33.151770 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.151747 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:33.247902 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.247830 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-certs\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.247902 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.247870 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-envoy\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.247902 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.247886 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-socket\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.248152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.247911 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-credential-socket\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.248152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.247932 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-podinfo\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.248152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.247953 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-data\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.248152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.247981 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cklqq\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-kube-api-access-cklqq\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.248152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248039 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-token\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.248152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248092 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istiod-ca-cert\") pod \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\" (UID: \"bf066d1f-1a97-4a64-8fde-232d2fc3ac28\") " Jul 01 18:33:33.248152 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248140 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:33:33.248559 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248244 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:33:33.248559 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248405 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:33:33.248559 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248426 2528 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-certs\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.248559 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248445 2528 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-workload-socket\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.248559 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248509 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:33:33.248559 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.248464 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:33:33.250190 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.250163 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:33:33.250358 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.250343 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 01 18:33:33.250452 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.250429 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:33:33.250516 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.250498 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-kube-api-access-cklqq" (OuterVolumeSpecName: "kube-api-access-cklqq") pod "bf066d1f-1a97-4a64-8fde-232d2fc3ac28" (UID: "bf066d1f-1a97-4a64-8fde-232d2fc3ac28"). InnerVolumeSpecName "kube-api-access-cklqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:33:33.348816 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.348789 2528 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-token\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.348816 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.348814 2528 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istiod-ca-cert\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.348966 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.348824 2528 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-envoy\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.348966 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.348832 2528 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-credential-socket\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.348966 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.348841 2528 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-podinfo\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.348966 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.348849 2528 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-istio-data\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.348966 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.348856 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cklqq\" (UniqueName: \"kubernetes.io/projected/bf066d1f-1a97-4a64-8fde-232d2fc3ac28-kube-api-access-cklqq\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:33:33.926029 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.925995 2528 generic.go:356] "Generic (PLEG): container finished" podID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerID="edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde" exitCode=0 Jul 01 18:33:33.926029 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.926029 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" event={"ID":"bf066d1f-1a97-4a64-8fde-232d2fc3ac28","Type":"ContainerDied","Data":"edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde"} Jul 01 18:33:33.926265 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.926046 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" Jul 01 18:33:33.926265 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.926065 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c" event={"ID":"bf066d1f-1a97-4a64-8fde-232d2fc3ac28","Type":"ContainerDied","Data":"75edbd9d51b93524202f9c2b0602c0a33944c7c110f20ef1101c8c571265bd9a"} Jul 01 18:33:33.926265 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.926086 2528 scope.go:117] "RemoveContainer" containerID="edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde" Jul 01 18:33:33.934482 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.934466 2528 scope.go:117] "RemoveContainer" containerID="edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde" Jul 01 18:33:33.934788 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:33:33.934757 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde\": container with ID starting with edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde not found: ID does not exist" containerID="edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde" Jul 01 18:33:33.934869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.934793 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde"} err="failed to get container status \"edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde\": rpc error: code = NotFound desc = could not find container \"edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde\": container with ID starting with edd0d2c4075d0f47e9525d74b27e1e1235e8c2d5e891baa9492452bdfb295fde not found: ID does not exist" Jul 01 18:33:33.944924 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.944907 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c"] Jul 01 18:33:33.948118 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:33.948100 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-rbx9c"] Jul 01 18:33:35.477292 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:35.477256 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" path="/var/lib/kubelet/pods/bf066d1f-1a97-4a64-8fde-232d2fc3ac28/volumes" Jul 01 18:33:57.901536 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:57.901506 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-92gld" Jul 01 18:33:58.904786 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:33:58.904753 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vqvrb" Jul 01 18:34:07.514341 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.514311 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nnqpc"] Jul 01 18:34:07.514794 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.514657 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerName="istio-proxy" Jul 01 18:34:07.514794 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.514668 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerName="istio-proxy" Jul 01 18:34:07.514794 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.514719 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf066d1f-1a97-4a64-8fde-232d2fc3ac28" containerName="istio-proxy" Jul 01 18:34:07.516657 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.516642 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" Jul 01 18:34:07.520148 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.520128 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5gpws\"" Jul 01 18:34:07.521492 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.521473 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 18:34:07.521568 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.521552 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 18:34:07.529882 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.529861 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nnqpc"] Jul 01 18:34:07.608513 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.608483 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trg2m\" (UniqueName: \"kubernetes.io/projected/e8952d3e-1f4b-452d-9bd0-9576e419dda1-kube-api-access-trg2m\") pod \"kuadrant-operator-catalog-nnqpc\" (UID: \"e8952d3e-1f4b-452d-9bd0-9576e419dda1\") " pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" Jul 01 18:34:07.709301 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.709257 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trg2m\" (UniqueName: \"kubernetes.io/projected/e8952d3e-1f4b-452d-9bd0-9576e419dda1-kube-api-access-trg2m\") pod \"kuadrant-operator-catalog-nnqpc\" (UID: \"e8952d3e-1f4b-452d-9bd0-9576e419dda1\") " pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" Jul 01 18:34:07.717982 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.717961 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trg2m\" (UniqueName: \"kubernetes.io/projected/e8952d3e-1f4b-452d-9bd0-9576e419dda1-kube-api-access-trg2m\") pod \"kuadrant-operator-catalog-nnqpc\" (UID: \"e8952d3e-1f4b-452d-9bd0-9576e419dda1\") " pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" Jul 01 18:34:07.826430 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.826309 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" Jul 01 18:34:07.860588 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.860551 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nnqpc"] Jul 01 18:34:07.961203 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:07.961180 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nnqpc"] Jul 01 18:34:07.963714 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:34:07.963687 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8952d3e_1f4b_452d_9bd0_9576e419dda1.slice/crio-d2bbdb8548dbab26d18274e69be5d187bb7225e9a54e125f80ff50955769a263 WatchSource:0}: Error finding container d2bbdb8548dbab26d18274e69be5d187bb7225e9a54e125f80ff50955769a263: Status 404 returned error can't find the container with id d2bbdb8548dbab26d18274e69be5d187bb7225e9a54e125f80ff50955769a263 Jul 01 18:34:08.070975 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.070944 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" event={"ID":"e8952d3e-1f4b-452d-9bd0-9576e419dda1","Type":"ContainerStarted","Data":"d2bbdb8548dbab26d18274e69be5d187bb7225e9a54e125f80ff50955769a263"} Jul 01 18:34:08.071615 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.071597 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f2qdg"] Jul 01 18:34:08.074737 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.074724 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:08.082410 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.082365 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f2qdg"] Jul 01 18:34:08.112689 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.112661 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrvgv\" (UniqueName: \"kubernetes.io/projected/ed05fd6d-4755-4e84-842b-98f85d92653f-kube-api-access-xrvgv\") pod \"kuadrant-operator-catalog-f2qdg\" (UID: \"ed05fd6d-4755-4e84-842b-98f85d92653f\") " pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:08.214018 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.213990 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrvgv\" (UniqueName: \"kubernetes.io/projected/ed05fd6d-4755-4e84-842b-98f85d92653f-kube-api-access-xrvgv\") pod \"kuadrant-operator-catalog-f2qdg\" (UID: \"ed05fd6d-4755-4e84-842b-98f85d92653f\") " pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:08.222717 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.222695 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrvgv\" (UniqueName: \"kubernetes.io/projected/ed05fd6d-4755-4e84-842b-98f85d92653f-kube-api-access-xrvgv\") pod \"kuadrant-operator-catalog-f2qdg\" (UID: \"ed05fd6d-4755-4e84-842b-98f85d92653f\") " pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:08.384713 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.384636 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:08.511419 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:08.511395 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f2qdg"] Jul 01 18:34:08.513421 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:34:08.513396 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded05fd6d_4755_4e84_842b_98f85d92653f.slice/crio-62a4438444d1ff0192ffb6ccab7d6c073d6118a2246c3ed3a90ab7c592121f24 WatchSource:0}: Error finding container 62a4438444d1ff0192ffb6ccab7d6c073d6118a2246c3ed3a90ab7c592121f24: Status 404 returned error can't find the container with id 62a4438444d1ff0192ffb6ccab7d6c073d6118a2246c3ed3a90ab7c592121f24 Jul 01 18:34:09.078505 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:09.078468 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" event={"ID":"ed05fd6d-4755-4e84-842b-98f85d92653f","Type":"ContainerStarted","Data":"62a4438444d1ff0192ffb6ccab7d6c073d6118a2246c3ed3a90ab7c592121f24"} Jul 01 18:34:11.089220 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.089187 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" event={"ID":"ed05fd6d-4755-4e84-842b-98f85d92653f","Type":"ContainerStarted","Data":"55746cfcae1fbe45d8f46a975b242993ea3a2a7dd73c194c10e0819e55a49c65"} Jul 01 18:34:11.090689 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.090666 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" event={"ID":"e8952d3e-1f4b-452d-9bd0-9576e419dda1","Type":"ContainerStarted","Data":"9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925"} Jul 01 18:34:11.090779 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.090761 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" podUID="e8952d3e-1f4b-452d-9bd0-9576e419dda1" containerName="registry-server" containerID="cri-o://9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925" gracePeriod=2 Jul 01 18:34:11.106780 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.106730 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" podStartSLOduration=1.597706404 podStartE2EDuration="3.106709956s" totalImagesPullingTime="1.509003552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:11.106067598 +0000 UTC m=+392.085069976" watchObservedRunningTime="2026-07-01 18:34:11.106709956 +0000 UTC m=+392.085712313" Jul 01 18:34:11.123136 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.123093 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" podStartSLOduration=2.067076316 podStartE2EDuration="4.123080637s" totalImagesPullingTime="2.056004321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:11.121527583 +0000 UTC m=+392.100529954" watchObservedRunningTime="2026-07-01 18:34:11.123080637 +0000 UTC m=+392.102082988" Jul 01 18:34:11.341763 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.341706 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" Jul 01 18:34:11.439490 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.439461 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trg2m\" (UniqueName: \"kubernetes.io/projected/e8952d3e-1f4b-452d-9bd0-9576e419dda1-kube-api-access-trg2m\") pod \"e8952d3e-1f4b-452d-9bd0-9576e419dda1\" (UID: \"e8952d3e-1f4b-452d-9bd0-9576e419dda1\") " Jul 01 18:34:11.441736 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.441711 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8952d3e-1f4b-452d-9bd0-9576e419dda1-kube-api-access-trg2m" (OuterVolumeSpecName: "kube-api-access-trg2m") pod "e8952d3e-1f4b-452d-9bd0-9576e419dda1" (UID: "e8952d3e-1f4b-452d-9bd0-9576e419dda1"). InnerVolumeSpecName "kube-api-access-trg2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:34:11.540588 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:11.540562 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trg2m\" (UniqueName: \"kubernetes.io/projected/e8952d3e-1f4b-452d-9bd0-9576e419dda1-kube-api-access-trg2m\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:34:12.095855 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.095821 2528 generic.go:356] "Generic (PLEG): container finished" podID="e8952d3e-1f4b-452d-9bd0-9576e419dda1" containerID="9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925" exitCode=0 Jul 01 18:34:12.096337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.095862 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" Jul 01 18:34:12.096337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.095907 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" event={"ID":"e8952d3e-1f4b-452d-9bd0-9576e419dda1","Type":"ContainerDied","Data":"9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925"} Jul 01 18:34:12.096337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.095959 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nnqpc" event={"ID":"e8952d3e-1f4b-452d-9bd0-9576e419dda1","Type":"ContainerDied","Data":"d2bbdb8548dbab26d18274e69be5d187bb7225e9a54e125f80ff50955769a263"} Jul 01 18:34:12.096337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.095983 2528 scope.go:117] "RemoveContainer" containerID="9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925" Jul 01 18:34:12.108917 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.108897 2528 scope.go:117] "RemoveContainer" containerID="9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925" Jul 01 18:34:12.109167 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:34:12.109149 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925\": container with ID starting with 9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925 not found: ID does not exist" containerID="9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925" Jul 01 18:34:12.109224 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.109174 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925"} err="failed to get container status \"9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925\": rpc error: code = NotFound desc = could not find container \"9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925\": container with ID starting with 9605d18b2a2b8baab2f0ddb48c1609739a8272517f5de7ac2f3aa63a1f1be925 not found: ID does not exist" Jul 01 18:34:12.119065 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.119039 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nnqpc"] Jul 01 18:34:12.120726 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:12.120708 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nnqpc"] Jul 01 18:34:13.476561 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:13.476521 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8952d3e-1f4b-452d-9bd0-9576e419dda1" path="/var/lib/kubelet/pods/e8952d3e-1f4b-452d-9bd0-9576e419dda1/volumes" Jul 01 18:34:18.385217 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:18.385183 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:18.385693 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:18.385264 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:18.408876 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:18.408841 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:19.152306 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:19.152280 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-f2qdg" Jul 01 18:34:31.184207 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:31.184166 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" event={"ID":"541c9102-8d1d-437b-89e8-ff9dff6a8a1e","Type":"ContainerStarted","Data":"b30d91a78493522d3cbf0cd72b59a267f4fc909fcf8a0b1e49437470bcde26e9"} Jul 01 18:34:31.202049 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:31.202000 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-84b695bfbb-v54lj" podStartSLOduration=1.75951503 podStartE2EDuration="1m5.201983942s" totalImagesPullingTime="1m3.442468912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:31.200121042 +0000 UTC m=+412.179123396" watchObservedRunningTime="2026-07-01 18:34:31.201983942 +0000 UTC m=+412.180986314" Jul 01 18:34:39.038760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.038726 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l"] Jul 01 18:34:39.039254 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.039059 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8952d3e-1f4b-452d-9bd0-9576e419dda1" containerName="registry-server" Jul 01 18:34:39.039254 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.039069 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8952d3e-1f4b-452d-9bd0-9576e419dda1" containerName="registry-server" Jul 01 18:34:39.039254 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.039121 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8952d3e-1f4b-452d-9bd0-9576e419dda1" containerName="registry-server" Jul 01 18:34:39.041592 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.041574 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" Jul 01 18:34:39.044619 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.044601 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-749zf\"" Jul 01 18:34:39.046856 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.046834 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 18:34:39.058316 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.058294 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l"] Jul 01 18:34:39.161650 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.161620 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxprc\" (UniqueName: \"kubernetes.io/projected/b26ac4cc-c6ea-4235-9935-d5e870c508a3-kube-api-access-hxprc\") pod \"dns-operator-controller-manager-864dd78c4c-67x7l\" (UID: \"b26ac4cc-c6ea-4235-9935-d5e870c508a3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" Jul 01 18:34:39.262520 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.262486 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxprc\" (UniqueName: \"kubernetes.io/projected/b26ac4cc-c6ea-4235-9935-d5e870c508a3-kube-api-access-hxprc\") pod \"dns-operator-controller-manager-864dd78c4c-67x7l\" (UID: \"b26ac4cc-c6ea-4235-9935-d5e870c508a3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" Jul 01 18:34:39.272058 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.272029 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxprc\" (UniqueName: \"kubernetes.io/projected/b26ac4cc-c6ea-4235-9935-d5e870c508a3-kube-api-access-hxprc\") pod \"dns-operator-controller-manager-864dd78c4c-67x7l\" (UID: \"b26ac4cc-c6ea-4235-9935-d5e870c508a3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" Jul 01 18:34:39.352300 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.352233 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" Jul 01 18:34:39.492471 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:39.492309 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l"] Jul 01 18:34:39.495092 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:34:39.495068 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26ac4cc_c6ea_4235_9935_d5e870c508a3.slice/crio-87869a8cf3f78b4562c991e5eddd99e1a257410b22dbbfd7bfe28f67d209c7d2 WatchSource:0}: Error finding container 87869a8cf3f78b4562c991e5eddd99e1a257410b22dbbfd7bfe28f67d209c7d2: Status 404 returned error can't find the container with id 87869a8cf3f78b4562c991e5eddd99e1a257410b22dbbfd7bfe28f67d209c7d2 Jul 01 18:34:40.226049 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:40.226013 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" event={"ID":"b26ac4cc-c6ea-4235-9935-d5e870c508a3","Type":"ContainerStarted","Data":"87869a8cf3f78b4562c991e5eddd99e1a257410b22dbbfd7bfe28f67d209c7d2"} Jul 01 18:34:42.048880 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:42.048857 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 18:34:42.238933 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:42.238898 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" event={"ID":"b26ac4cc-c6ea-4235-9935-d5e870c508a3","Type":"ContainerStarted","Data":"7e5cb0af3ba5b61510d66ddfdbaf3faba7ee04c231348c7139ad964841250b55"} Jul 01 18:34:42.239132 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:42.238981 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" Jul 01 18:34:42.258235 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:42.258185 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" podStartSLOduration=0.710105653 podStartE2EDuration="3.258171132s" totalImagesPullingTime="2.548065479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:42.256981996 +0000 UTC m=+423.235984359" watchObservedRunningTime="2026-07-01 18:34:42.258171132 +0000 UTC m=+423.237173552" Jul 01 18:34:43.059457 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.059428 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv"] Jul 01 18:34:43.067756 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.067732 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" Jul 01 18:34:43.070779 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.070760 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nwqhf\"" Jul 01 18:34:43.078134 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.078110 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv"] Jul 01 18:34:43.195625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.195595 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppb46\" (UniqueName: \"kubernetes.io/projected/3dd08d0e-7409-41a5-bfd2-4fe577c3868e-kube-api-access-ppb46\") pod \"authorino-operator-75cc8d5cb7-q8nrv\" (UID: \"3dd08d0e-7409-41a5-bfd2-4fe577c3868e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" Jul 01 18:34:43.296187 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.296157 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppb46\" (UniqueName: \"kubernetes.io/projected/3dd08d0e-7409-41a5-bfd2-4fe577c3868e-kube-api-access-ppb46\") pod \"authorino-operator-75cc8d5cb7-q8nrv\" (UID: \"3dd08d0e-7409-41a5-bfd2-4fe577c3868e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" Jul 01 18:34:43.308979 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.308958 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppb46\" (UniqueName: \"kubernetes.io/projected/3dd08d0e-7409-41a5-bfd2-4fe577c3868e-kube-api-access-ppb46\") pod \"authorino-operator-75cc8d5cb7-q8nrv\" (UID: \"3dd08d0e-7409-41a5-bfd2-4fe577c3868e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" Jul 01 18:34:43.379148 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.379079 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" Jul 01 18:34:43.526965 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:43.526942 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv"] Jul 01 18:34:43.528777 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:34:43.528756 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd08d0e_7409_41a5_bfd2_4fe577c3868e.slice/crio-d485c11515681518dc3836bc1bb2697986245f766e902b8805058d77e4022a20 WatchSource:0}: Error finding container d485c11515681518dc3836bc1bb2697986245f766e902b8805058d77e4022a20: Status 404 returned error can't find the container with id d485c11515681518dc3836bc1bb2697986245f766e902b8805058d77e4022a20 Jul 01 18:34:44.248878 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:44.248845 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" event={"ID":"3dd08d0e-7409-41a5-bfd2-4fe577c3868e","Type":"ContainerStarted","Data":"d485c11515681518dc3836bc1bb2697986245f766e902b8805058d77e4022a20"} Jul 01 18:34:46.259770 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.259674 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" event={"ID":"3dd08d0e-7409-41a5-bfd2-4fe577c3868e","Type":"ContainerStarted","Data":"b7bbfe0417098414fc4c5addadd2872df3ba07d551caf15a9dbf200590a9270e"} Jul 01 18:34:46.260134 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.259798 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" Jul 01 18:34:46.281253 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.281212 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" podStartSLOduration=0.900378848 podStartE2EDuration="3.281198216s" totalImagesPullingTime="2.380819368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:46.280018118 +0000 UTC m=+427.259020493" watchObservedRunningTime="2026-07-01 18:34:46.281198216 +0000 UTC m=+427.260200568" Jul 01 18:34:46.383768 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.383738 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8"] Jul 01 18:34:46.386216 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.386201 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:34:46.392136 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.389913 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-msvp5\"" Jul 01 18:34:46.407483 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.407459 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8"] Jul 01 18:34:46.527973 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.527940 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jx6q\" (UniqueName: \"kubernetes.io/projected/95ddc9c8-dcf2-4cbf-af35-3a46380005d8-kube-api-access-5jx6q\") pod \"limitador-operator-controller-manager-859d7b78bd-sgct8\" (UID: \"95ddc9c8-dcf2-4cbf-af35-3a46380005d8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:34:46.628626 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.628546 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jx6q\" (UniqueName: \"kubernetes.io/projected/95ddc9c8-dcf2-4cbf-af35-3a46380005d8-kube-api-access-5jx6q\") pod \"limitador-operator-controller-manager-859d7b78bd-sgct8\" (UID: \"95ddc9c8-dcf2-4cbf-af35-3a46380005d8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:34:46.640548 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.640484 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jx6q\" (UniqueName: \"kubernetes.io/projected/95ddc9c8-dcf2-4cbf-af35-3a46380005d8-kube-api-access-5jx6q\") pod \"limitador-operator-controller-manager-859d7b78bd-sgct8\" (UID: \"95ddc9c8-dcf2-4cbf-af35-3a46380005d8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:34:46.701321 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.701286 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:34:46.876593 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:46.876452 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8"] Jul 01 18:34:46.879301 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:34:46.879269 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ddc9c8_dcf2_4cbf_af35_3a46380005d8.slice/crio-4a549bbcf201c8efe263ac7254d22e472ec7382f4a5e883fbecd7cc402767182 WatchSource:0}: Error finding container 4a549bbcf201c8efe263ac7254d22e472ec7382f4a5e883fbecd7cc402767182: Status 404 returned error can't find the container with id 4a549bbcf201c8efe263ac7254d22e472ec7382f4a5e883fbecd7cc402767182 Jul 01 18:34:47.264957 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:47.264925 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" event={"ID":"95ddc9c8-dcf2-4cbf-af35-3a46380005d8","Type":"ContainerStarted","Data":"4a549bbcf201c8efe263ac7254d22e472ec7382f4a5e883fbecd7cc402767182"} Jul 01 18:34:49.275265 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:49.275233 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" event={"ID":"95ddc9c8-dcf2-4cbf-af35-3a46380005d8","Type":"ContainerStarted","Data":"79df4df1d8db6a7cea2235b9fbb735c8e32bb262943347fa9255ccb3efc91eb3"} Jul 01 18:34:49.275665 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:49.275293 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:34:49.295125 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:49.295078 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" podStartSLOduration=1.194903078 podStartE2EDuration="3.295062438s" totalImagesPullingTime="2.10015936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:49.293876946 +0000 UTC m=+430.272879297" watchObservedRunningTime="2026-07-01 18:34:49.295062438 +0000 UTC m=+430.274064790" Jul 01 18:34:51.113465 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.113430 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt"] Jul 01 18:34:51.116722 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.116705 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.119580 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.119559 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rh66x\"" Jul 01 18:34:51.129689 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.129665 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt"] Jul 01 18:34:51.276873 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.276845 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lt4\" (UniqueName: \"kubernetes.io/projected/a720f834-ead5-4297-9bee-924634a7ac66-kube-api-access-44lt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.277017 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.276879 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a720f834-ead5-4297-9bee-924634a7ac66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.377555 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.377481 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lt4\" (UniqueName: \"kubernetes.io/projected/a720f834-ead5-4297-9bee-924634a7ac66-kube-api-access-44lt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.377555 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.377516 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a720f834-ead5-4297-9bee-924634a7ac66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.377902 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.377885 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a720f834-ead5-4297-9bee-924634a7ac66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.386538 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.386507 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lt4\" (UniqueName: \"kubernetes.io/projected/a720f834-ead5-4297-9bee-924634a7ac66-kube-api-access-44lt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.426446 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.426422 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:51.572970 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:51.572948 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt"] Jul 01 18:34:51.575164 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:34:51.575132 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda720f834_ead5_4297_9bee_924634a7ac66.slice/crio-9e820d660dd9aa47db9e299f6d05093171aa82615d4c6eda4bd02e0a0b253567 WatchSource:0}: Error finding container 9e820d660dd9aa47db9e299f6d05093171aa82615d4c6eda4bd02e0a0b253567: Status 404 returned error can't find the container with id 9e820d660dd9aa47db9e299f6d05093171aa82615d4c6eda4bd02e0a0b253567 Jul 01 18:34:52.290032 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:52.289997 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" event={"ID":"a720f834-ead5-4297-9bee-924634a7ac66","Type":"ContainerStarted","Data":"9e820d660dd9aa47db9e299f6d05093171aa82615d4c6eda4bd02e0a0b253567"} Jul 01 18:34:53.245531 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:53.245504 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-67x7l" Jul 01 18:34:57.267472 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:57.267446 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8nrv" Jul 01 18:34:58.323160 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:58.323130 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" event={"ID":"a720f834-ead5-4297-9bee-924634a7ac66","Type":"ContainerStarted","Data":"d3937fae541e0189f29587f62d626108d7858f01e922440c0113c45467554847"} Jul 01 18:34:58.323540 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:58.323324 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:34:58.345565 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:34:58.345476 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" podStartSLOduration=0.910065768 podStartE2EDuration="7.345454274s" totalImagesPullingTime="6.435388506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:58.343573795 +0000 UTC m=+439.322576168" watchObservedRunningTime="2026-07-01 18:34:58.345454274 +0000 UTC m=+439.324456626" Jul 01 18:35:00.281924 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:00.281853 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:35:09.330086 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:09.330054 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:10.594277 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.594241 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg"] Jul 01 18:35:10.613443 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.613419 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg"] Jul 01 18:35:10.613595 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.613529 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:10.645576 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.645548 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2p9w\" (UniqueName: \"kubernetes.io/projected/d30bbdd0-4e26-461f-80af-fc4266a541a6-kube-api-access-w2p9w\") pod \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:10.645736 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.645587 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30bbdd0-4e26-461f-80af-fc4266a541a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:10.746136 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.746105 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2p9w\" (UniqueName: \"kubernetes.io/projected/d30bbdd0-4e26-461f-80af-fc4266a541a6-kube-api-access-w2p9w\") pod \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:10.746282 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.746143 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30bbdd0-4e26-461f-80af-fc4266a541a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:10.746585 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.746567 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30bbdd0-4e26-461f-80af-fc4266a541a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:10.759722 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.759694 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2p9w\" (UniqueName: \"kubernetes.io/projected/d30bbdd0-4e26-461f-80af-fc4266a541a6-kube-api-access-w2p9w\") pod \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:10.923760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:10.923674 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:11.077442 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.077416 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg"] Jul 01 18:35:11.080439 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:35:11.080411 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30bbdd0_4e26_461f_80af_fc4266a541a6.slice/crio-126b2b6f5cc02d249584f10e80d59fd5084172849fd3d91aa713b9ef3ea109a4 WatchSource:0}: Error finding container 126b2b6f5cc02d249584f10e80d59fd5084172849fd3d91aa713b9ef3ea109a4: Status 404 returned error can't find the container with id 126b2b6f5cc02d249584f10e80d59fd5084172849fd3d91aa713b9ef3ea109a4 Jul 01 18:35:11.102965 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.102929 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg"] Jul 01 18:35:11.122616 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.122593 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg"] Jul 01 18:35:11.155109 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.155084 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt"] Jul 01 18:35:11.155298 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.155263 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" podUID="a720f834-ead5-4297-9bee-924634a7ac66" containerName="manager" containerID="cri-o://d3937fae541e0189f29587f62d626108d7858f01e922440c0113c45467554847" gracePeriod=2 Jul 01 18:35:11.176154 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.176097 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt"] Jul 01 18:35:11.181081 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.181058 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624"] Jul 01 18:35:11.181365 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.181326 2528 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a720f834-ead5-4297-9bee-924634a7ac66\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\": pods \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:11.181550 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.181528 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" containerName="manager" Jul 01 18:35:11.181550 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.181550 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" containerName="manager" Jul 01 18:35:11.181698 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.181566 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a720f834-ead5-4297-9bee-924634a7ac66" containerName="manager" Jul 01 18:35:11.181698 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.181572 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="a720f834-ead5-4297-9bee-924634a7ac66" containerName="manager" Jul 01 18:35:11.181698 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.181668 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" containerName="manager" Jul 01 18:35:11.181698 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.181682 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="a720f834-ead5-4297-9bee-924634a7ac66" containerName="manager" Jul 01 18:35:11.184657 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.184640 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.187618 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.187584 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="a720f834-ead5-4297-9bee-924634a7ac66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:11.188706 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.188687 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8"] Jul 01 18:35:11.188876 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.188843 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" containerName="manager" containerID="cri-o://79df4df1d8db6a7cea2235b9fbb735c8e32bb262943347fa9255ccb3efc91eb3" gracePeriod=2 Jul 01 18:35:11.195461 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.195439 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8"] Jul 01 18:35:11.199008 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.198986 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624"] Jul 01 18:35:11.220825 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.220803 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb"] Jul 01 18:35:11.221136 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.221124 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" containerName="manager" Jul 01 18:35:11.221186 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.221138 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" containerName="manager" Jul 01 18:35:11.221222 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.221195 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" containerName="manager" Jul 01 18:35:11.227053 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.227028 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="a720f834-ead5-4297-9bee-924634a7ac66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:11.229354 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.229329 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgct8\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:35:11.231738 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.231722 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" Jul 01 18:35:11.238967 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.238945 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb"] Jul 01 18:35:11.250733 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.250710 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zp88\" (UniqueName: \"kubernetes.io/projected/6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7-kube-api-access-6zp88\") pod \"limitador-operator-controller-manager-859d7b78bd-thxwb\" (UID: \"6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" Jul 01 18:35:11.250821 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.250763 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b1c1ca-80a3-46fe-b700-2a21a337884b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zw624\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.250877 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.250826 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlzwg\" (UniqueName: \"kubernetes.io/projected/03b1c1ca-80a3-46fe-b700-2a21a337884b-kube-api-access-nlzwg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zw624\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.256078 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.256053 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="a720f834-ead5-4297-9bee-924634a7ac66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:11.258404 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.258366 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgct8\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:35:11.351666 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.351634 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b1c1ca-80a3-46fe-b700-2a21a337884b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zw624\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.351828 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.351685 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlzwg\" (UniqueName: \"kubernetes.io/projected/03b1c1ca-80a3-46fe-b700-2a21a337884b-kube-api-access-nlzwg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zw624\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.351828 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.351778 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zp88\" (UniqueName: \"kubernetes.io/projected/6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7-kube-api-access-6zp88\") pod \"limitador-operator-controller-manager-859d7b78bd-thxwb\" (UID: \"6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" Jul 01 18:35:11.352065 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.352043 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b1c1ca-80a3-46fe-b700-2a21a337884b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zw624\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.363590 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.363567 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zp88\" (UniqueName: \"kubernetes.io/projected/6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7-kube-api-access-6zp88\") pod \"limitador-operator-controller-manager-859d7b78bd-thxwb\" (UID: \"6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" Jul 01 18:35:11.363736 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.363701 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlzwg\" (UniqueName: \"kubernetes.io/projected/03b1c1ca-80a3-46fe-b700-2a21a337884b-kube-api-access-nlzwg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zw624\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.392047 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.392012 2528 generic.go:356] "Generic (PLEG): container finished" podID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" containerID="79df4df1d8db6a7cea2235b9fbb735c8e32bb262943347fa9255ccb3efc91eb3" exitCode=0 Jul 01 18:35:11.394019 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.393992 2528 generic.go:356] "Generic (PLEG): container finished" podID="a720f834-ead5-4297-9bee-924634a7ac66" containerID="d3937fae541e0189f29587f62d626108d7858f01e922440c0113c45467554847" exitCode=0 Jul 01 18:35:11.395922 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.395894 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" containerName="manager" containerID="cri-o://4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895" gracePeriod=2 Jul 01 18:35:11.398591 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.398538 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mbsqt\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="a720f834-ead5-4297-9bee-924634a7ac66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:11.400674 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.400649 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgct8\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:35:11.402754 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:11.402631 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:11.507338 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.507311 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:11.510719 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.510703 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:35:11.553049 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.553020 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jx6q\" (UniqueName: \"kubernetes.io/projected/95ddc9c8-dcf2-4cbf-af35-3a46380005d8-kube-api-access-5jx6q\") pod \"95ddc9c8-dcf2-4cbf-af35-3a46380005d8\" (UID: \"95ddc9c8-dcf2-4cbf-af35-3a46380005d8\") " Jul 01 18:35:11.553226 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.553113 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a720f834-ead5-4297-9bee-924634a7ac66-extensions-socket-volume\") pod \"a720f834-ead5-4297-9bee-924634a7ac66\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " Jul 01 18:35:11.553226 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.553158 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44lt4\" (UniqueName: \"kubernetes.io/projected/a720f834-ead5-4297-9bee-924634a7ac66-kube-api-access-44lt4\") pod \"a720f834-ead5-4297-9bee-924634a7ac66\" (UID: \"a720f834-ead5-4297-9bee-924634a7ac66\") " Jul 01 18:35:11.553614 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.553590 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a720f834-ead5-4297-9bee-924634a7ac66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a720f834-ead5-4297-9bee-924634a7ac66" (UID: "a720f834-ead5-4297-9bee-924634a7ac66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:35:11.555358 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.555325 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a720f834-ead5-4297-9bee-924634a7ac66-kube-api-access-44lt4" (OuterVolumeSpecName: "kube-api-access-44lt4") pod "a720f834-ead5-4297-9bee-924634a7ac66" (UID: "a720f834-ead5-4297-9bee-924634a7ac66"). InnerVolumeSpecName "kube-api-access-44lt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:35:11.555487 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.555431 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ddc9c8-dcf2-4cbf-af35-3a46380005d8-kube-api-access-5jx6q" (OuterVolumeSpecName: "kube-api-access-5jx6q") pod "95ddc9c8-dcf2-4cbf-af35-3a46380005d8" (UID: "95ddc9c8-dcf2-4cbf-af35-3a46380005d8"). InnerVolumeSpecName "kube-api-access-5jx6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:35:11.582683 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.582660 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:11.587715 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.587695 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" Jul 01 18:35:11.626297 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.626270 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:11.654278 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.653704 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2p9w\" (UniqueName: \"kubernetes.io/projected/d30bbdd0-4e26-461f-80af-fc4266a541a6-kube-api-access-w2p9w\") pod \"d30bbdd0-4e26-461f-80af-fc4266a541a6\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " Jul 01 18:35:11.654278 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.653753 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30bbdd0-4e26-461f-80af-fc4266a541a6-extensions-socket-volume\") pod \"d30bbdd0-4e26-461f-80af-fc4266a541a6\" (UID: \"d30bbdd0-4e26-461f-80af-fc4266a541a6\") " Jul 01 18:35:11.654278 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.654051 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44lt4\" (UniqueName: \"kubernetes.io/projected/a720f834-ead5-4297-9bee-924634a7ac66-kube-api-access-44lt4\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:35:11.654278 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.654070 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jx6q\" (UniqueName: \"kubernetes.io/projected/95ddc9c8-dcf2-4cbf-af35-3a46380005d8-kube-api-access-5jx6q\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:35:11.654278 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.654085 2528 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a720f834-ead5-4297-9bee-924634a7ac66-extensions-socket-volume\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:35:11.654726 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.654682 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d30bbdd0-4e26-461f-80af-fc4266a541a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d30bbdd0-4e26-461f-80af-fc4266a541a6" (UID: "d30bbdd0-4e26-461f-80af-fc4266a541a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:35:11.657651 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.657616 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d30bbdd0-4e26-461f-80af-fc4266a541a6-kube-api-access-w2p9w" (OuterVolumeSpecName: "kube-api-access-w2p9w") pod "d30bbdd0-4e26-461f-80af-fc4266a541a6" (UID: "d30bbdd0-4e26-461f-80af-fc4266a541a6"). InnerVolumeSpecName "kube-api-access-w2p9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:35:11.733955 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.733930 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624"] Jul 01 18:35:11.736015 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:35:11.735980 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b1c1ca_80a3_46fe_b700_2a21a337884b.slice/crio-a32bd2f5d874ccd40d44ba255d3b2623bf17cf88b4f4d27c3995699675d8d475 WatchSource:0}: Error finding container a32bd2f5d874ccd40d44ba255d3b2623bf17cf88b4f4d27c3995699675d8d475: Status 404 returned error can't find the container with id a32bd2f5d874ccd40d44ba255d3b2623bf17cf88b4f4d27c3995699675d8d475 Jul 01 18:35:11.754536 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.754513 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2p9w\" (UniqueName: \"kubernetes.io/projected/d30bbdd0-4e26-461f-80af-fc4266a541a6-kube-api-access-w2p9w\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:35:11.754624 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.754543 2528 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30bbdd0-4e26-461f-80af-fc4266a541a6-extensions-socket-volume\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:35:11.763285 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:11.763262 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb"] Jul 01 18:35:11.766558 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:35:11.766520 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc0c5bc_be51_4bfe_b59b_21c8e4bd53c7.slice/crio-068bfaee61174630f60abd189e0e954a3d9d0b80bdaa512440dee053d08bbdb9 WatchSource:0}: Error finding container 068bfaee61174630f60abd189e0e954a3d9d0b80bdaa512440dee053d08bbdb9: Status 404 returned error can't find the container with id 068bfaee61174630f60abd189e0e954a3d9d0b80bdaa512440dee053d08bbdb9 Jul 01 18:35:12.401357 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.401326 2528 scope.go:117] "RemoveContainer" containerID="d3937fae541e0189f29587f62d626108d7858f01e922440c0113c45467554847" Jul 01 18:35:12.401563 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.401335 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mbsqt" Jul 01 18:35:12.402955 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.402931 2528 generic.go:356] "Generic (PLEG): container finished" podID="d30bbdd0-4e26-461f-80af-fc4266a541a6" containerID="4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895" exitCode=2 Jul 01 18:35:12.403059 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.402972 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:12.404976 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.404949 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" event={"ID":"6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7","Type":"ContainerStarted","Data":"8256e89d5dca1a334604573101649e964eb7a28a24a9f8668f19e2fe05aec743"} Jul 01 18:35:12.405099 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.405007 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" event={"ID":"6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7","Type":"ContainerStarted","Data":"068bfaee61174630f60abd189e0e954a3d9d0b80bdaa512440dee053d08bbdb9"} Jul 01 18:35:12.405099 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.405041 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" Jul 01 18:35:12.405947 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:12.405926 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:12.406935 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.406913 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" event={"ID":"03b1c1ca-80a3-46fe-b700-2a21a337884b","Type":"ContainerStarted","Data":"d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f"} Jul 01 18:35:12.407040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.406970 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:12.407040 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.406988 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" event={"ID":"03b1c1ca-80a3-46fe-b700-2a21a337884b","Type":"ContainerStarted","Data":"a32bd2f5d874ccd40d44ba255d3b2623bf17cf88b4f4d27c3995699675d8d475"} Jul 01 18:35:12.408695 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.408680 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgct8" Jul 01 18:35:12.411543 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.411456 2528 scope.go:117] "RemoveContainer" containerID="4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895" Jul 01 18:35:12.413457 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:12.413432 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:12.419806 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.419791 2528 scope.go:117] "RemoveContainer" containerID="4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895" Jul 01 18:35:12.420049 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:12.420032 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895\": container with ID starting with 4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895 not found: ID does not exist" containerID="4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895" Jul 01 18:35:12.420112 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.420062 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895"} err="failed to get container status \"4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895\": rpc error: code = NotFound desc = could not find container \"4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895\": container with ID starting with 4d4b69f025640dacf57a2466700cc93d6992fd63c43d98e893df8ad5a96a3895 not found: ID does not exist" Jul 01 18:35:12.420112 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.420084 2528 scope.go:117] "RemoveContainer" containerID="79df4df1d8db6a7cea2235b9fbb735c8e32bb262943347fa9255ccb3efc91eb3" Jul 01 18:35:12.452048 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.452009 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" podStartSLOduration=1.4519974150000001 podStartE2EDuration="1.451997415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:35:12.451482495 +0000 UTC m=+453.430484847" watchObservedRunningTime="2026-07-01 18:35:12.451997415 +0000 UTC m=+453.430999768" Jul 01 18:35:12.496068 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:12.496024 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" podStartSLOduration=1.496011659 podStartE2EDuration="1.496011659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:35:12.494830706 +0000 UTC m=+453.473833055" watchObservedRunningTime="2026-07-01 18:35:12.496011659 +0000 UTC m=+453.475014010" Jul 01 18:35:12.498411 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:12.498368 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mp5gg\" is forbidden: User \"system:node:ip-10-0-133-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-114.ec2.internal' and this object" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mp5gg" Jul 01 18:35:13.477601 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:13.477564 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ddc9c8-dcf2-4cbf-af35-3a46380005d8" path="/var/lib/kubelet/pods/95ddc9c8-dcf2-4cbf-af35-3a46380005d8/volumes" Jul 01 18:35:13.477931 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:13.477891 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a720f834-ead5-4297-9bee-924634a7ac66" path="/var/lib/kubelet/pods/a720f834-ead5-4297-9bee-924634a7ac66/volumes" Jul 01 18:35:13.478202 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:13.478189 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d30bbdd0-4e26-461f-80af-fc4266a541a6" path="/var/lib/kubelet/pods/d30bbdd0-4e26-461f-80af-fc4266a541a6/volumes" Jul 01 18:35:23.425735 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:23.425703 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thxwb" Jul 01 18:35:23.426164 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:23.425790 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:43.670433 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:43.670396 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624"] Jul 01 18:35:43.670882 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:43.670601 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" podUID="03b1c1ca-80a3-46fe-b700-2a21a337884b" containerName="manager" containerID="cri-o://d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f" gracePeriod=10 Jul 01 18:35:43.919945 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:43.919918 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5"] Jul 01 18:35:43.922330 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:43.922276 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:43.924970 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:43.924949 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:43.939758 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:43.939732 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5"] Jul 01 18:35:44.001906 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.001881 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlzwg\" (UniqueName: \"kubernetes.io/projected/03b1c1ca-80a3-46fe-b700-2a21a337884b-kube-api-access-nlzwg\") pod \"03b1c1ca-80a3-46fe-b700-2a21a337884b\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " Jul 01 18:35:44.002050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.001916 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b1c1ca-80a3-46fe-b700-2a21a337884b-extensions-socket-volume\") pod \"03b1c1ca-80a3-46fe-b700-2a21a337884b\" (UID: \"03b1c1ca-80a3-46fe-b700-2a21a337884b\") " Jul 01 18:35:44.002050 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.002010 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37f17845-3667-4738-99d2-b161cda7bb6f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h9qp5\" (UID: \"37f17845-3667-4738-99d2-b161cda7bb6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.002125 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.002067 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4j2n\" (UniqueName: \"kubernetes.io/projected/37f17845-3667-4738-99d2-b161cda7bb6f-kube-api-access-r4j2n\") pod \"kuadrant-operator-controller-manager-86878c769f-h9qp5\" (UID: \"37f17845-3667-4738-99d2-b161cda7bb6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.002351 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.002330 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b1c1ca-80a3-46fe-b700-2a21a337884b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "03b1c1ca-80a3-46fe-b700-2a21a337884b" (UID: "03b1c1ca-80a3-46fe-b700-2a21a337884b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:35:44.004112 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.004092 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b1c1ca-80a3-46fe-b700-2a21a337884b-kube-api-access-nlzwg" (OuterVolumeSpecName: "kube-api-access-nlzwg") pod "03b1c1ca-80a3-46fe-b700-2a21a337884b" (UID: "03b1c1ca-80a3-46fe-b700-2a21a337884b"). InnerVolumeSpecName "kube-api-access-nlzwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:35:44.102710 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.102676 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37f17845-3667-4738-99d2-b161cda7bb6f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h9qp5\" (UID: \"37f17845-3667-4738-99d2-b161cda7bb6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.102840 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.102755 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4j2n\" (UniqueName: \"kubernetes.io/projected/37f17845-3667-4738-99d2-b161cda7bb6f-kube-api-access-r4j2n\") pod \"kuadrant-operator-controller-manager-86878c769f-h9qp5\" (UID: \"37f17845-3667-4738-99d2-b161cda7bb6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.102840 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.102820 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlzwg\" (UniqueName: \"kubernetes.io/projected/03b1c1ca-80a3-46fe-b700-2a21a337884b-kube-api-access-nlzwg\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:35:44.102840 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.102835 2528 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03b1c1ca-80a3-46fe-b700-2a21a337884b-extensions-socket-volume\") on node \"ip-10-0-133-114.ec2.internal\" DevicePath \"\"" Jul 01 18:35:44.103059 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.103041 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37f17845-3667-4738-99d2-b161cda7bb6f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h9qp5\" (UID: \"37f17845-3667-4738-99d2-b161cda7bb6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.111792 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.111764 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4j2n\" (UniqueName: \"kubernetes.io/projected/37f17845-3667-4738-99d2-b161cda7bb6f-kube-api-access-r4j2n\") pod \"kuadrant-operator-controller-manager-86878c769f-h9qp5\" (UID: \"37f17845-3667-4738-99d2-b161cda7bb6f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.231541 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.231460 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.372449 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.372427 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5"] Jul 01 18:35:44.375109 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:35:44.375080 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f17845_3667_4738_99d2_b161cda7bb6f.slice/crio-511a6f68e704e1fa06cf072fea1bfe7bf08533bb81a4eaa3ae9da31ad3c0b19e WatchSource:0}: Error finding container 511a6f68e704e1fa06cf072fea1bfe7bf08533bb81a4eaa3ae9da31ad3c0b19e: Status 404 returned error can't find the container with id 511a6f68e704e1fa06cf072fea1bfe7bf08533bb81a4eaa3ae9da31ad3c0b19e Jul 01 18:35:44.578027 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.577995 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" event={"ID":"37f17845-3667-4738-99d2-b161cda7bb6f","Type":"ContainerStarted","Data":"3cc95656a9efd948c26c2ca9983a6c8fc3c7dcd4e295e3db18d72d4e773048cc"} Jul 01 18:35:44.578236 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.578062 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" event={"ID":"37f17845-3667-4738-99d2-b161cda7bb6f","Type":"ContainerStarted","Data":"511a6f68e704e1fa06cf072fea1bfe7bf08533bb81a4eaa3ae9da31ad3c0b19e"} Jul 01 18:35:44.578236 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.578095 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:35:44.579330 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.579307 2528 generic.go:356] "Generic (PLEG): container finished" podID="03b1c1ca-80a3-46fe-b700-2a21a337884b" containerID="d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f" exitCode=0 Jul 01 18:35:44.579466 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.579345 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" Jul 01 18:35:44.579466 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.579405 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" event={"ID":"03b1c1ca-80a3-46fe-b700-2a21a337884b","Type":"ContainerDied","Data":"d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f"} Jul 01 18:35:44.579466 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.579457 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624" event={"ID":"03b1c1ca-80a3-46fe-b700-2a21a337884b","Type":"ContainerDied","Data":"a32bd2f5d874ccd40d44ba255d3b2623bf17cf88b4f4d27c3995699675d8d475"} Jul 01 18:35:44.579584 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.579489 2528 scope.go:117] "RemoveContainer" containerID="d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f" Jul 01 18:35:44.588645 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.588624 2528 scope.go:117] "RemoveContainer" containerID="d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f" Jul 01 18:35:44.588919 ip-10-0-133-114 kubenswrapper[2528]: E0701 18:35:44.588902 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f\": container with ID starting with d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f not found: ID does not exist" containerID="d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f" Jul 01 18:35:44.588991 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.588925 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f"} err="failed to get container status \"d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f\": rpc error: code = NotFound desc = could not find container \"d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f\": container with ID starting with d6b2b7c7936be17c7cec44c1f4d97b166b052cc9a083e0ab80476687b60e043f not found: ID does not exist" Jul 01 18:35:44.597364 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.597329 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" podStartSLOduration=1.597317811 podStartE2EDuration="1.597317811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:35:44.596484784 +0000 UTC m=+485.575487169" watchObservedRunningTime="2026-07-01 18:35:44.597317811 +0000 UTC m=+485.576320163" Jul 01 18:35:44.614627 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.614607 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624"] Jul 01 18:35:44.616456 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:44.616437 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zw624"] Jul 01 18:35:45.477310 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:45.477276 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b1c1ca-80a3-46fe-b700-2a21a337884b" path="/var/lib/kubelet/pods/03b1c1ca-80a3-46fe-b700-2a21a337884b/volumes" Jul 01 18:35:55.587759 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:35:55.587726 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9qp5" Jul 01 18:36:00.192363 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.192328 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks"] Jul 01 18:36:00.192797 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.192750 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b1c1ca-80a3-46fe-b700-2a21a337884b" containerName="manager" Jul 01 18:36:00.192797 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.192767 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b1c1ca-80a3-46fe-b700-2a21a337884b" containerName="manager" Jul 01 18:36:00.192867 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.192828 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b1c1ca-80a3-46fe-b700-2a21a337884b" containerName="manager" Jul 01 18:36:00.195678 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.195662 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.198683 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.198663 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-z4zzp\"" Jul 01 18:36:00.207759 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.207736 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks"] Jul 01 18:36:00.342709 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342672 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.342709 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342710 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.342942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342740 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.342942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342776 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.342942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342875 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.342942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342906 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnk7h\" (UniqueName: \"kubernetes.io/projected/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-kube-api-access-dnk7h\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.342942 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342936 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.343128 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342977 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.343128 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.342993 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444398 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444289 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnk7h\" (UniqueName: \"kubernetes.io/projected/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-kube-api-access-dnk7h\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444398 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444353 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444621 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444432 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444621 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444462 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444621 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444526 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444621 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444555 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444621 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444589 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444928 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444705 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444928 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444763 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.444928 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444899 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.445087 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.444996 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.445164 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.445143 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.445226 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.445178 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.445269 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.445258 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.446977 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.446955 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.447291 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.447270 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.453719 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.453691 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnk7h\" (UniqueName: \"kubernetes.io/projected/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-kube-api-access-dnk7h\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.453831 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.453813 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9db1a4-8d4f-47c2-85a3-a515231f87b5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4dsks\" (UID: \"5c9db1a4-8d4f-47c2-85a3-a515231f87b5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.507157 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.507118 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:00.647702 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.647678 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks"] Jul 01 18:36:00.649576 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:36:00.649542 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9db1a4_8d4f_47c2_85a3_a515231f87b5.slice/crio-b0e96b1736a87e4dfee635d612fd5502956b38ab67a55bbb6717f975d408e25a WatchSource:0}: Error finding container b0e96b1736a87e4dfee635d612fd5502956b38ab67a55bbb6717f975d408e25a: Status 404 returned error can't find the container with id b0e96b1736a87e4dfee635d612fd5502956b38ab67a55bbb6717f975d408e25a Jul 01 18:36:00.651760 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.651724 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:36:00.651882 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.651811 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:36:00.651882 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.651852 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:36:00.656649 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:00.656615 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" event={"ID":"5c9db1a4-8d4f-47c2-85a3-a515231f87b5","Type":"ContainerStarted","Data":"b0e96b1736a87e4dfee635d612fd5502956b38ab67a55bbb6717f975d408e25a"} Jul 01 18:36:01.663294 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:01.663253 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" event={"ID":"5c9db1a4-8d4f-47c2-85a3-a515231f87b5","Type":"ContainerStarted","Data":"294dcbaca160783307ca447bcfbd4b140042038c6e67085eee23f181929601f8"} Jul 01 18:36:01.687411 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:01.687328 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" podStartSLOduration=1.687314358 podStartE2EDuration="1.687314358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:36:01.685980029 +0000 UTC m=+502.664982393" watchObservedRunningTime="2026-07-01 18:36:01.687314358 +0000 UTC m=+502.666316709" Jul 01 18:36:02.508137 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:02.508097 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:02.513026 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:02.513003 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:02.668314 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:02.668274 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:02.669306 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:02.669290 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:36:51.973046 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:51.973011 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-s78bf"] Jul 01 18:36:51.976140 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:51.976121 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" Jul 01 18:36:51.978921 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:51.978901 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 18:36:51.978921 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:51.978915 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 18:36:51.980169 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:51.980150 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-kqrt6\"" Jul 01 18:36:51.984712 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:51.984692 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-s78bf"] Jul 01 18:36:52.061851 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:52.061818 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7gz8\" (UniqueName: \"kubernetes.io/projected/61e99540-c568-4098-a2e9-b7ab06fccfd9-kube-api-access-f7gz8\") pod \"keycloak-operator-d8b9d7b4d-s78bf\" (UID: \"61e99540-c568-4098-a2e9-b7ab06fccfd9\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" Jul 01 18:36:52.162567 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:52.162535 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7gz8\" (UniqueName: \"kubernetes.io/projected/61e99540-c568-4098-a2e9-b7ab06fccfd9-kube-api-access-f7gz8\") pod \"keycloak-operator-d8b9d7b4d-s78bf\" (UID: \"61e99540-c568-4098-a2e9-b7ab06fccfd9\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" Jul 01 18:36:52.177292 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:52.177260 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7gz8\" (UniqueName: \"kubernetes.io/projected/61e99540-c568-4098-a2e9-b7ab06fccfd9-kube-api-access-f7gz8\") pod \"keycloak-operator-d8b9d7b4d-s78bf\" (UID: \"61e99540-c568-4098-a2e9-b7ab06fccfd9\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" Jul 01 18:36:52.286729 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:52.286703 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" Jul 01 18:36:52.424647 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:52.424621 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-s78bf"] Jul 01 18:36:52.427043 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:36:52.427014 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e99540_c568_4098_a2e9_b7ab06fccfd9.slice/crio-00d35d7f1a4c5d8b510a5020ef48cc7abeb0516d410d38ce7e10b426e4de1069 WatchSource:0}: Error finding container 00d35d7f1a4c5d8b510a5020ef48cc7abeb0516d410d38ce7e10b426e4de1069: Status 404 returned error can't find the container with id 00d35d7f1a4c5d8b510a5020ef48cc7abeb0516d410d38ce7e10b426e4de1069 Jul 01 18:36:52.907863 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:52.907824 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" event={"ID":"61e99540-c568-4098-a2e9-b7ab06fccfd9","Type":"ContainerStarted","Data":"00d35d7f1a4c5d8b510a5020ef48cc7abeb0516d410d38ce7e10b426e4de1069"} Jul 01 18:36:58.939844 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:58.939801 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" event={"ID":"61e99540-c568-4098-a2e9-b7ab06fccfd9","Type":"ContainerStarted","Data":"2d36c580b1d65ecda29d98fb9498ca82c44f1045b5f5e36c0405285fe596dd21"} Jul 01 18:36:58.957562 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:36:58.957509 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-s78bf" podStartSLOduration=2.19059799 podStartE2EDuration="7.957467091s" totalImagesPullingTime="5.766869101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:36:58.957028129 +0000 UTC m=+559.936030484" watchObservedRunningTime="2026-07-01 18:36:58.957467091 +0000 UTC m=+559.936469443" Jul 01 18:37:39.461744 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:37:39.461714 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:37:39.462496 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:37:39.462480 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:38:28.385112 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:28.385079 2528 generic.go:356] "Generic (PLEG): container finished" podID="5c9db1a4-8d4f-47c2-85a3-a515231f87b5" containerID="294dcbaca160783307ca447bcfbd4b140042038c6e67085eee23f181929601f8" exitCode=0 Jul 01 18:38:28.385546 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:28.385160 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" event={"ID":"5c9db1a4-8d4f-47c2-85a3-a515231f87b5","Type":"ContainerDied","Data":"294dcbaca160783307ca447bcfbd4b140042038c6e67085eee23f181929601f8"} Jul 01 18:38:28.385612 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:28.385596 2528 scope.go:117] "RemoveContainer" containerID="294dcbaca160783307ca447bcfbd4b140042038c6e67085eee23f181929601f8" Jul 01 18:38:28.386610 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:28.386582 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:38:28.386688 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:28.386649 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:38:28.386688 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:28.386680 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 01 18:38:29.393129 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:29.393097 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" event={"ID":"5c9db1a4-8d4f-47c2-85a3-a515231f87b5","Type":"ContainerStarted","Data":"4c916ef2cdf972003c446fc99fe0420676baa930d26b82c282ee5b71a707e2b3"} Jul 01 18:38:29.507265 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:29.507236 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:38:29.508094 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:29.508072 2528 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4dsks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 01 18:38:29.508192 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:29.508117 2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" podUID="5c9db1a4-8d4f-47c2-85a3-a515231f87b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 01 18:38:30.508288 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:30.508247 2528 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4dsks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 01 18:38:30.508694 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:30.508327 2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" podUID="5c9db1a4-8d4f-47c2-85a3-a515231f87b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 01 18:38:31.507929 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:31.507895 2528 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4dsks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 01 18:38:31.508101 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:31.507956 2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" podUID="5c9db1a4-8d4f-47c2-85a3-a515231f87b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 01 18:38:32.508062 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:32.508025 2528 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4dsks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 01 18:38:32.508497 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:32.508083 2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" podUID="5c9db1a4-8d4f-47c2-85a3-a515231f87b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 01 18:38:32.668975 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:32.668933 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:38:33.512455 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:33.512422 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:38:33.513484 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:38:33.513466 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4dsks" Jul 01 18:39:51.526518 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.526488 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd"] Jul 01 18:39:51.529221 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.529200 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.532244 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.532209 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 18:39:51.533358 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.533335 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7tk72\"" Jul 01 18:39:51.533497 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.533398 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 18:39:51.533497 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.533436 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 18:39:51.542287 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.542263 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd"] Jul 01 18:39:51.695576 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.695537 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxh9s\" (UniqueName: \"kubernetes.io/projected/40527605-9d57-4013-9a2f-5e98b4a843cb-kube-api-access-mxh9s\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.695755 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.695590 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.695755 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.695630 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.695755 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.695664 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.695755 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.695701 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40527605-9d57-4013-9a2f-5e98b4a843cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.796316 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.796245 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.796316 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.796282 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40527605-9d57-4013-9a2f-5e98b4a843cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.796544 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.796344 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxh9s\" (UniqueName: \"kubernetes.io/projected/40527605-9d57-4013-9a2f-5e98b4a843cb-kube-api-access-mxh9s\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.796544 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.796367 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.796544 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.796418 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.796706 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.796635 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.796755 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.796736 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.798608 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.798586 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40527605-9d57-4013-9a2f-5e98b4a843cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.798896 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.798880 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40527605-9d57-4013-9a2f-5e98b4a843cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.806853 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.806831 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxh9s\" (UniqueName: \"kubernetes.io/projected/40527605-9d57-4013-9a2f-5e98b4a843cb-kube-api-access-mxh9s\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd\" (UID: \"40527605-9d57-4013-9a2f-5e98b4a843cb\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.840902 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.840876 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:39:51.979945 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.979921 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd"] Jul 01 18:39:51.982700 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:39:51.982673 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40527605_9d57_4013_9a2f_5e98b4a843cb.slice/crio-c24ac1fc3830750ad27335b468dc59f8c2441d5b0d85697b1afa2baf53f384c1 WatchSource:0}: Error finding container c24ac1fc3830750ad27335b468dc59f8c2441d5b0d85697b1afa2baf53f384c1: Status 404 returned error can't find the container with id c24ac1fc3830750ad27335b468dc59f8c2441d5b0d85697b1afa2baf53f384c1 Jul 01 18:39:51.984371 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:51.984350 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:39:52.793217 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:52.793178 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" event={"ID":"40527605-9d57-4013-9a2f-5e98b4a843cb","Type":"ContainerStarted","Data":"c24ac1fc3830750ad27335b468dc59f8c2441d5b0d85697b1afa2baf53f384c1"} Jul 01 18:39:53.800624 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:53.800589 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" event={"ID":"40527605-9d57-4013-9a2f-5e98b4a843cb","Type":"ContainerStarted","Data":"2799cb0eb822a5663312368715e8dc492e150215ffd1ddd3de31a0139cb2a1de"} Jul 01 18:39:53.820787 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:53.820745 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" podStartSLOduration=1.8087611350000001 podStartE2EDuration="2.820730562s" totalImagesPullingTime="1.011969427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:53.819812226 +0000 UTC m=+734.798814588" watchObservedRunningTime="2026-07-01 18:39:53.820730562 +0000 UTC m=+734.799732914" Jul 01 18:39:59.637167 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.637129 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk"] Jul 01 18:39:59.640076 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.640057 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.642875 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.642859 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 18:39:59.654409 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.654369 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk"] Jul 01 18:39:59.765830 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.765792 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.765830 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.765831 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.766078 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.765857 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmnw\" (UniqueName: \"kubernetes.io/projected/8a380257-0171-4c07-a210-26a35f11106e-kube-api-access-jmmnw\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.766078 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.765936 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.766078 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.765982 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a380257-0171-4c07-a210-26a35f11106e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.867323 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.867285 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.867507 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.867331 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.867507 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.867368 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmnw\" (UniqueName: \"kubernetes.io/projected/8a380257-0171-4c07-a210-26a35f11106e-kube-api-access-jmmnw\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.867507 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.867428 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.867507 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.867473 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a380257-0171-4c07-a210-26a35f11106e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.867740 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.867695 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.867798 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.867750 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.869777 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.869757 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a380257-0171-4c07-a210-26a35f11106e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.870169 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.870149 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a380257-0171-4c07-a210-26a35f11106e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.876706 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.876684 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmnw\" (UniqueName: \"kubernetes.io/projected/8a380257-0171-4c07-a210-26a35f11106e-kube-api-access-jmmnw\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk\" (UID: \"8a380257-0171-4c07-a210-26a35f11106e\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:39:59.951154 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:39:59.951066 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:40:00.093930 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:00.093904 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk"] Jul 01 18:40:00.096038 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:40:00.096013 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a380257_0171_4c07_a210_26a35f11106e.slice/crio-714d54805f40951d41ab0309ebd5745de22e3256914b838d46b6326523b0f8a8 WatchSource:0}: Error finding container 714d54805f40951d41ab0309ebd5745de22e3256914b838d46b6326523b0f8a8: Status 404 returned error can't find the container with id 714d54805f40951d41ab0309ebd5745de22e3256914b838d46b6326523b0f8a8 Jul 01 18:40:00.836214 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:00.836176 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" event={"ID":"8a380257-0171-4c07-a210-26a35f11106e","Type":"ContainerStarted","Data":"f652618befe6aec9ce93bf67144087e541b6836ce63d0d3931cc651d17571a67"} Jul 01 18:40:00.836622 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:00.836223 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" event={"ID":"8a380257-0171-4c07-a210-26a35f11106e","Type":"ContainerStarted","Data":"714d54805f40951d41ab0309ebd5745de22e3256914b838d46b6326523b0f8a8"} Jul 01 18:40:00.856629 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:00.856579 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" podStartSLOduration=1.637988869 podStartE2EDuration="1.856563996s" totalImagesPullingTime="218.575127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:40:00.8547084 +0000 UTC m=+741.833710753" watchObservedRunningTime="2026-07-01 18:40:00.856563996 +0000 UTC m=+741.835566348" Jul 01 18:40:01.841011 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:01.840981 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:40:01.841539 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:01.841038 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:40:01.853505 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:01.853482 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:40:02.856684 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:02.856653 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd" Jul 01 18:40:09.951436 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:09.951367 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:40:09.951436 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:09.951453 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:40:09.964076 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:09.964050 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:40:10.895740 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:40:10.895712 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk" Jul 01 18:42:30.098359 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:30.098273 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84b695bfbb-v54lj_541c9102-8d1d-437b-89e8-ff9dff6a8a1e/nginx/0.log" Jul 01 18:42:30.208212 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:30.208186 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-92gld_5035ec09-82f8-4fe7-8fbb-2541d3943b68/manager/0.log" Jul 01 18:42:30.333094 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:30.333067 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-vqvrb_2aaff639-a6e0-4752-b729-9fe401206686/manager/0.log" Jul 01 18:42:30.682564 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:30.682532 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-rb8gj_b03fa292-bcc2-4c28-a1cc-a403c789881e/server/0.log" Jul 01 18:42:30.809797 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:30.809762 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zgd4c_41032492-a629-4387-a668-9e3d3544b685/manager/0.log" Jul 01 18:42:31.057919 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:31.057892 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-wmtzq_ed0423c5-7374-49d0-adc3-2be7918e1a05/copy-manifests/0.log" Jul 01 18:42:31.068241 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:31.068217 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-wmtzq_ed0423c5-7374-49d0-adc3-2be7918e1a05/manager/0.log" Jul 01 18:42:32.709910 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:32.709879 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q8nrv_3dd08d0e-7409-41a5-bfd2-4fe577c3868e/manager/0.log" Jul 01 18:42:32.822145 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:32.822118 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-67x7l_b26ac4cc-c6ea-4235-9935-d5e870c508a3/manager/0.log" Jul 01 18:42:33.053973 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:33.053945 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f2qdg_ed05fd6d-4755-4e84-842b-98f85d92653f/registry-server/0.log" Jul 01 18:42:33.180406 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:33.180264 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h9qp5_37f17845-3667-4738-99d2-b161cda7bb6f/manager/0.log" Jul 01 18:42:33.427062 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:33.426971 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-thxwb_6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7/manager/0.log" Jul 01 18:42:33.772519 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:33.772493 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g789f_d1219490-9452-4877-b2af-68cef9deae02/istio-proxy/0.log" Jul 01 18:42:34.011850 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:34.011819 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-l7625_a3e11a7f-c848-4993-98bf-be483b9880fa/kube-auth-proxy/0.log" Jul 01 18:42:34.243168 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:34.243078 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4dsks_5c9db1a4-8d4f-47c2-85a3-a515231f87b5/istio-proxy/1.log" Jul 01 18:42:35.371431 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:35.371373 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-n45jd_40527605-9d57-4013-9a2f-5e98b4a843cb/main/0.log" Jul 01 18:42:35.487524 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:35.487496 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6cfb9f9b9c-b5cqk_8a380257-0171-4c07-a210-26a35f11106e/main/0.log" Jul 01 18:42:39.302292 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.302257 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ljr9/must-gather-qfl76"] Jul 01 18:42:39.306153 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.306127 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.309589 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.309567 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9ljr9\"/\"default-dockercfg-4r7cl\"" Jul 01 18:42:39.310625 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.310605 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"openshift-service-ca.crt\"" Jul 01 18:42:39.310722 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.310677 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"kube-root-ca.crt\"" Jul 01 18:42:39.318869 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.318848 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/must-gather-qfl76"] Jul 01 18:42:39.428237 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.428207 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csr7w\" (UniqueName: \"kubernetes.io/projected/79942e14-c22a-4015-a528-9a83d679bec8-kube-api-access-csr7w\") pod \"must-gather-qfl76\" (UID: \"79942e14-c22a-4015-a528-9a83d679bec8\") " pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.428420 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.428254 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79942e14-c22a-4015-a528-9a83d679bec8-must-gather-output\") pod \"must-gather-qfl76\" (UID: \"79942e14-c22a-4015-a528-9a83d679bec8\") " pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.492087 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.492060 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:42:39.493116 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.493088 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gmwz_353fcc95-ba74-4841-b484-60d98f3971aa/ovn-acl-logging/0.log" Jul 01 18:42:39.529205 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.529186 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csr7w\" (UniqueName: \"kubernetes.io/projected/79942e14-c22a-4015-a528-9a83d679bec8-kube-api-access-csr7w\") pod \"must-gather-qfl76\" (UID: \"79942e14-c22a-4015-a528-9a83d679bec8\") " pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.529320 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.529218 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79942e14-c22a-4015-a528-9a83d679bec8-must-gather-output\") pod \"must-gather-qfl76\" (UID: \"79942e14-c22a-4015-a528-9a83d679bec8\") " pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.529517 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.529500 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79942e14-c22a-4015-a528-9a83d679bec8-must-gather-output\") pod \"must-gather-qfl76\" (UID: \"79942e14-c22a-4015-a528-9a83d679bec8\") " pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.539073 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.539054 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"kube-root-ca.crt\"" Jul 01 18:42:39.549664 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.549646 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"openshift-service-ca.crt\"" Jul 01 18:42:39.559630 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.559579 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csr7w\" (UniqueName: \"kubernetes.io/projected/79942e14-c22a-4015-a528-9a83d679bec8-kube-api-access-csr7w\") pod \"must-gather-qfl76\" (UID: \"79942e14-c22a-4015-a528-9a83d679bec8\") " pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.619782 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.619761 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9ljr9\"/\"default-dockercfg-4r7cl\"" Jul 01 18:42:39.626524 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.626498 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/must-gather-qfl76" Jul 01 18:42:39.791166 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:39.791137 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/must-gather-qfl76"] Jul 01 18:42:39.792656 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:42:39.792627 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79942e14_c22a_4015_a528_9a83d679bec8.slice/crio-c8a63571f8b1366ed0bcaff7d99820ac1606d179d913d0baa156d5570492b1dd WatchSource:0}: Error finding container c8a63571f8b1366ed0bcaff7d99820ac1606d179d913d0baa156d5570492b1dd: Status 404 returned error can't find the container with id c8a63571f8b1366ed0bcaff7d99820ac1606d179d913d0baa156d5570492b1dd Jul 01 18:42:40.635140 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:40.635088 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/must-gather-qfl76" event={"ID":"79942e14-c22a-4015-a528-9a83d679bec8","Type":"ContainerStarted","Data":"c8a63571f8b1366ed0bcaff7d99820ac1606d179d913d0baa156d5570492b1dd"} Jul 01 18:42:41.643693 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:41.643653 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/must-gather-qfl76" event={"ID":"79942e14-c22a-4015-a528-9a83d679bec8","Type":"ContainerStarted","Data":"f997e0aad307c4dd6ac34f399806a5b76078845c18db8f9c452bf5836dfdb748"} Jul 01 18:42:41.644188 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:41.643729 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/must-gather-qfl76" event={"ID":"79942e14-c22a-4015-a528-9a83d679bec8","Type":"ContainerStarted","Data":"89adce8ffb721ba0651904eede290936fea64edc34455fd4eb6b6b0d02be2270"} Jul 01 18:42:41.662049 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:41.661996 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9ljr9/must-gather-qfl76" podStartSLOduration=1.7249211519999998 podStartE2EDuration="2.661979682s" totalImagesPullingTime="937.05853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:42:41.660861387 +0000 UTC m=+902.639863740" watchObservedRunningTime="2026-07-01 18:42:41.661979682 +0000 UTC m=+902.640982033" Jul 01 18:42:42.477372 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:42.477340 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zl55s_fa514adf-5a6e-4c8e-85be-661f9c10de48/global-pull-secret-syncer/0.log" Jul 01 18:42:42.581651 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:42.581619 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-996n2_555d68e5-e953-48a7-92fe-abd2fc0ca36d/konnectivity-agent/0.log" Jul 01 18:42:42.701744 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:42.701709 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-114.ec2.internal_77380cf742ba9e9737750d6db3ca67d0/haproxy/0.log" Jul 01 18:42:47.321747 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:47.321711 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q8nrv_3dd08d0e-7409-41a5-bfd2-4fe577c3868e/manager/0.log" Jul 01 18:42:47.350769 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:47.350731 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-67x7l_b26ac4cc-c6ea-4235-9935-d5e870c508a3/manager/0.log" Jul 01 18:42:47.411899 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:47.411868 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f2qdg_ed05fd6d-4755-4e84-842b-98f85d92653f/registry-server/0.log" Jul 01 18:42:47.479545 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:47.479513 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h9qp5_37f17845-3667-4738-99d2-b161cda7bb6f/manager/0.log" Jul 01 18:42:47.573055 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:47.572963 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-thxwb_6cc0c5bc-be51-4bfe-b59b-21c8e4bd53c7/manager/0.log" Jul 01 18:42:49.349329 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.349294 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-gc4ps_24813269-84ea-45cf-abaa-61bce0686757/kube-state-metrics/0.log" Jul 01 18:42:49.371337 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.371178 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-gc4ps_24813269-84ea-45cf-abaa-61bce0686757/kube-rbac-proxy-main/0.log" Jul 01 18:42:49.396151 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.396117 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-gc4ps_24813269-84ea-45cf-abaa-61bce0686757/kube-rbac-proxy-self/0.log" Jul 01 18:42:49.757868 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.757822 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s98d6_df5e4c9d-8324-468f-8148-cac3f9fe5609/node-exporter/0.log" Jul 01 18:42:49.784575 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.784520 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s98d6_df5e4c9d-8324-468f-8148-cac3f9fe5609/kube-rbac-proxy/0.log" Jul 01 18:42:49.808977 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.808954 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s98d6_df5e4c9d-8324-468f-8148-cac3f9fe5609/init-textfile/0.log" Jul 01 18:42:49.842805 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.842771 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-q6hgz_90c09e36-8f86-4437-80c0-d19a2ae1a0b6/kube-rbac-proxy-main/0.log" Jul 01 18:42:49.872894 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.872847 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-q6hgz_90c09e36-8f86-4437-80c0-d19a2ae1a0b6/kube-rbac-proxy-self/0.log" Jul 01 18:42:49.898163 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:49.898087 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-q6hgz_90c09e36-8f86-4437-80c0-d19a2ae1a0b6/openshift-state-metrics/0.log" Jul 01 18:42:50.185739 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:50.185659 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-tld8l_bdb71551-0d68-4081-9814-7cab108a8cd2/prometheus-operator-admission-webhook/0.log" Jul 01 18:42:51.632905 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:51.632861 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-x8cwn_4b19ba83-00ae-47f8-a659-34e79d5c1525/networking-console-plugin/0.log" Jul 01 18:42:52.577346 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.577304 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg"] Jul 01 18:42:52.583127 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.583097 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.591757 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.591728 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg"] Jul 01 18:42:52.670024 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.669979 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-podres\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.670622 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.670599 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-sys\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.670753 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.670735 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-lib-modules\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.670952 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.670920 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-proc\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.671090 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.671050 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4bq\" (UniqueName: \"kubernetes.io/projected/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-kube-api-access-9j4bq\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.771781 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.771742 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-podres\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.771965 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.771842 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-sys\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.771965 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.771871 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-lib-modules\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.771965 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.771931 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-proc\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.772122 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.771955 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-sys\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.772122 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.771980 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4bq\" (UniqueName: \"kubernetes.io/projected/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-kube-api-access-9j4bq\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.772122 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.771987 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-podres\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.772122 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.772064 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-proc\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.772122 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.772096 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-lib-modules\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.790205 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.790172 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4bq\" (UniqueName: \"kubernetes.io/projected/8d56868a-43d2-4d21-82fa-a9f4b76d05d1-kube-api-access-9j4bq\") pod \"perf-node-gather-daemonset-7p2hg\" (UID: \"8d56868a-43d2-4d21-82fa-a9f4b76d05d1\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:52.902810 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:52.902717 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:53.084392 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:53.084307 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg"] Jul 01 18:42:53.089318 ip-10-0-133-114 kubenswrapper[2528]: W0701 18:42:53.089275 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d56868a_43d2_4d21_82fa_a9f4b76d05d1.slice/crio-2d71a39db44265cba223ffd6d25ed1a8b1532a026272fce0f6cd37c61c4d27f0 WatchSource:0}: Error finding container 2d71a39db44265cba223ffd6d25ed1a8b1532a026272fce0f6cd37c61c4d27f0: Status 404 returned error can't find the container with id 2d71a39db44265cba223ffd6d25ed1a8b1532a026272fce0f6cd37c61c4d27f0 Jul 01 18:42:53.734910 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:53.734870 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" event={"ID":"8d56868a-43d2-4d21-82fa-a9f4b76d05d1","Type":"ContainerStarted","Data":"f07d52022e3906db8344b47f43b14683d1b6c3fa9de11cbb1b9be1a7849e16dc"} Jul 01 18:42:53.735322 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:53.734941 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" event={"ID":"8d56868a-43d2-4d21-82fa-a9f4b76d05d1","Type":"ContainerStarted","Data":"2d71a39db44265cba223ffd6d25ed1a8b1532a026272fce0f6cd37c61c4d27f0"} Jul 01 18:42:53.735569 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:53.735542 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:42:53.753363 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:53.753305 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" podStartSLOduration=1.75328336 podStartE2EDuration="1.75328336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:42:53.751267725 +0000 UTC m=+914.730270077" watchObservedRunningTime="2026-07-01 18:42:53.75328336 +0000 UTC m=+914.732285715" Jul 01 18:42:54.643461 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:54.643428 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9fw2_d4da1690-8a11-4f38-baf0-49102bf9aab1/dns/0.log" Jul 01 18:42:54.670397 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:54.670357 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9fw2_d4da1690-8a11-4f38-baf0-49102bf9aab1/kube-rbac-proxy/0.log" Jul 01 18:42:54.754797 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:54.754765 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8zgz4_73bf0e9b-9b1b-4c6e-af6b-291cd8440054/dns-node-resolver/0.log" Jul 01 18:42:55.393565 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:55.393531 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jzlrj_730c0b6a-43db-46dc-8734-a13b46596717/node-ca/0.log" Jul 01 18:42:56.370871 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:56.370833 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g789f_d1219490-9452-4877-b2af-68cef9deae02/istio-proxy/0.log" Jul 01 18:42:56.446374 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:56.446329 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-l7625_a3e11a7f-c848-4993-98bf-be483b9880fa/kube-auth-proxy/0.log" Jul 01 18:42:56.508064 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:56.508031 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4dsks_5c9db1a4-8d4f-47c2-85a3-a515231f87b5/istio-proxy/1.log" Jul 01 18:42:56.508398 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:56.508362 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4dsks_5c9db1a4-8d4f-47c2-85a3-a515231f87b5/istio-proxy/0.log" Jul 01 18:42:57.248092 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:57.248067 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r7ls9_df3a5742-26c9-4161-ac23-7c45b90a8f9e/serve-healthcheck-canary/0.log" Jul 01 18:42:57.892791 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:57.892760 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmblh_9177dafa-20be-48cc-95c4-4377d2536ea6/kube-rbac-proxy/0.log" Jul 01 18:42:57.913885 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:57.913857 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmblh_9177dafa-20be-48cc-95c4-4377d2536ea6/exporter/0.log" Jul 01 18:42:57.937329 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:57.937293 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmblh_9177dafa-20be-48cc-95c4-4377d2536ea6/extractor/0.log" Jul 01 18:42:59.752790 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:42:59.752763 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-7p2hg" Jul 01 18:43:00.133689 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:00.133658 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84b695bfbb-v54lj_541c9102-8d1d-437b-89e8-ff9dff6a8a1e/nginx/0.log" Jul 01 18:43:00.159156 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:00.159125 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-92gld_5035ec09-82f8-4fe7-8fbb-2541d3943b68/manager/0.log" Jul 01 18:43:00.199412 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:00.199360 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-vqvrb_2aaff639-a6e0-4752-b729-9fe401206686/manager/0.log" Jul 01 18:43:00.273187 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:00.273159 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-rb8gj_b03fa292-bcc2-4c28-a1cc-a403c789881e/server/0.log" Jul 01 18:43:00.343487 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:00.343453 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zgd4c_41032492-a629-4387-a668-9e3d3544b685/manager/0.log" Jul 01 18:43:00.437913 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:00.437821 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-wmtzq_ed0423c5-7374-49d0-adc3-2be7918e1a05/manager/0.log" Jul 01 18:43:00.458105 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:00.458073 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-wmtzq_ed0423c5-7374-49d0-adc3-2be7918e1a05/copy-manifests/0.log" Jul 01 18:43:02.189000 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:02.188966 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ttf4w_abf6e9ea-a4ea-4858-a177-f03299cd699d/openshift-lws-operator/0.log" Jul 01 18:43:02.682819 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:02.682789 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g789f_d1219490-9452-4877-b2af-68cef9deae02/istio-proxy/0.log" Jul 01 18:43:02.735144 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:02.735066 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-l7625_a3e11a7f-c848-4993-98bf-be483b9880fa/kube-auth-proxy/0.log" Jul 01 18:43:02.773887 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:02.773855 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4dsks_5c9db1a4-8d4f-47c2-85a3-a515231f87b5/istio-proxy/1.log" Jul 01 18:43:02.774301 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:02.774286 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4dsks_5c9db1a4-8d4f-47c2-85a3-a515231f87b5/istio-proxy/0.log" Jul 01 18:43:03.881551 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:03.881521 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g789f_d1219490-9452-4877-b2af-68cef9deae02/istio-proxy/0.log" Jul 01 18:43:03.927369 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:03.927287 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-l7625_a3e11a7f-c848-4993-98bf-be483b9880fa/kube-auth-proxy/0.log" Jul 01 18:43:03.971038 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:03.971003 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4dsks_5c9db1a4-8d4f-47c2-85a3-a515231f87b5/istio-proxy/1.log" Jul 01 18:43:03.971296 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:03.971261 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4dsks_5c9db1a4-8d4f-47c2-85a3-a515231f87b5/istio-proxy/0.log" Jul 01 18:43:07.701123 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:07.701083 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-k8jkb_144cb6a8-2ea3-4e98-8f81-865406276623/kube-storage-version-migrator-operator/1.log" Jul 01 18:43:07.702664 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:07.702604 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-k8jkb_144cb6a8-2ea3-4e98-8f81-865406276623/kube-storage-version-migrator-operator/0.log" Jul 01 18:43:08.801655 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.801622 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-64mdz_3a223020-b30b-4c4d-a467-91cd848a0944/kube-multus/0.log" Jul 01 18:43:08.826740 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.826716 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g9cg_31b2e3bc-3f08-47a7-ac4a-361b7749430d/kube-multus-additional-cni-plugins/0.log" Jul 01 18:43:08.848961 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.848942 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g9cg_31b2e3bc-3f08-47a7-ac4a-361b7749430d/egress-router-binary-copy/0.log" Jul 01 18:43:08.871605 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.871582 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g9cg_31b2e3bc-3f08-47a7-ac4a-361b7749430d/cni-plugins/0.log" Jul 01 18:43:08.898441 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.898421 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g9cg_31b2e3bc-3f08-47a7-ac4a-361b7749430d/bond-cni-plugin/0.log" Jul 01 18:43:08.925254 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.925234 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g9cg_31b2e3bc-3f08-47a7-ac4a-361b7749430d/routeoverride-cni/0.log" Jul 01 18:43:08.948591 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.948567 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g9cg_31b2e3bc-3f08-47a7-ac4a-361b7749430d/whereabouts-cni-bincopy/0.log" Jul 01 18:43:08.972676 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:08.972656 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g9cg_31b2e3bc-3f08-47a7-ac4a-361b7749430d/whereabouts-cni/0.log" Jul 01 18:43:09.378558 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:09.378526 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5j9jb_2811d697-4951-498a-9f2a-9b24db3d320d/network-metrics-daemon/0.log" Jul 01 18:43:09.400359 ip-10-0-133-114 kubenswrapper[2528]: I0701 18:43:09.400338 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5j9jb_2811d697-4951-498a-9f2a-9b24db3d320d/kube-rbac-proxy/0.log"