Sep 10 00:50:18.202117 ip-10-0-131-63 systemd[1]: Starting Kubernetes Kubelet... Sep 10 00:50:18.611764 ip-10-0-131-63 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:50:18.611764 ip-10-0-131-63 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 00:50:18.611764 ip-10-0-131-63 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:50:18.611764 ip-10-0-131-63 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 00:50:18.611764 ip-10-0-131-63 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:50:18.612518 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.611815 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 00:50:18.615494 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615474 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:18.615494 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615490 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:18.615494 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615495 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:18.615494 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615499 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615504 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615509 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615513 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615517 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615521 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615525 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615529 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615533 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615537 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615541 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615545 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615549 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615553 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615557 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615561 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615564 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615568 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615578 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615582 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:18.615728 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615586 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615589 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615593 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615597 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615601 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615605 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615609 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615613 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615617 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615620 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615625 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615630 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615634 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615638 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615643 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615647 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615652 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615659 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615665 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:18.616524 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615670 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615674 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615679 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615685 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615689 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615693 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615697 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615701 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615706 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615712 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615718 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615723 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615728 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615733 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615737 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615741 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615745 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615749 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615753 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615757 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:18.617351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615761 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615765 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615769 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615774 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615778 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615782 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615786 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615791 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615795 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615799 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615803 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615807 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615811 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615815 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615820 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615825 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615828 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615833 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615837 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615855 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:18.618033 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615863 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615867 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615871 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615875 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615879 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615884 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615891 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615897 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615902 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615906 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615910 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615915 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615919 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615924 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615928 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615932 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.615936 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618078 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618091 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:18.618511 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618095 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618098 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618101 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618104 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618109 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618113 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618117 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618120 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618122 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618126 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618131 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618134 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618137 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618140 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618143 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618146 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618148 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618151 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618154 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:18.619005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618157 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618159 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618162 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618165 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618167 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618170 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618173 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618176 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618178 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618182 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618185 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618188 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618192 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618194 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618197 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618200 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618202 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618205 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618207 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618209 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:18.619541 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618212 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618214 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618217 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618219 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618222 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618224 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618226 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618230 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618232 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618242 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618244 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618247 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618249 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618252 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618254 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618257 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618260 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618262 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618265 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:18.620060 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618267 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618270 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618272 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618275 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618277 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618282 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618284 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618287 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618289 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618292 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618294 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618297 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618299 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618302 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618304 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618307 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618309 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618312 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618316 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618318 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:18.620502 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618321 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618323 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618326 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618334 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618337 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618339 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618342 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618345 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618347 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618350 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618354 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618357 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618359 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618362 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618365 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618367 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618370 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618374 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618377 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:18.621020 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618755 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618759 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618762 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618765 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618768 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618770 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618773 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618776 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618778 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618781 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618784 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618786 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618788 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618791 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618793 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618796 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618806 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618809 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618812 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:18.621484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618814 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618817 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618820 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618822 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618825 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618827 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618830 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618832 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618835 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618837 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618840 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618856 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618859 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618862 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618864 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618867 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618869 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618872 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618874 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618877 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:18.621971 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618880 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618882 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618885 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618887 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618890 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618892 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618895 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618897 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618900 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618902 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618911 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618913 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618916 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618918 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618921 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618924 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618928 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618931 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618934 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:18.622439 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618937 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618942 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618945 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618948 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618951 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618954 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618956 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618959 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618961 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618964 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618966 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618969 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618972 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618974 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618977 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618979 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618982 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618984 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618987 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618989 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:18.622896 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618992 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618994 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.618997 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619000 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619008 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619011 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619013 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619017 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619020 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619023 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619025 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619028 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619030 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619032 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619035 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619038 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619041 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619043 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619046 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:18.623353 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619049 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619051 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619126 2573 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619160 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619169 2573 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619174 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619177 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619181 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619185 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619188 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619191 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619194 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619198 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619201 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619204 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619207 2573 flags.go:64] FLAG: --cgroup-root="" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619209 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619212 2573 flags.go:64] FLAG: --client-ca-file="" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619221 2573 flags.go:64] FLAG: --cloud-provider="external" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619226 2573 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619233 2573 flags.go:64] FLAG: --cluster-domain="" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619236 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619239 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619242 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 00:50:18.623801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619245 2573 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619249 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619252 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619255 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619259 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619262 2573 flags.go:64] FLAG: --contention-profiling="false" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619264 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619267 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619270 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619273 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619277 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619280 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619283 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619286 2573 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619289 2573 flags.go:64] FLAG: --enable-server="true" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619291 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619298 2573 flags.go:64] FLAG: --event-burst="100" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619301 2573 flags.go:64] FLAG: --event-qps="50" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619304 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619307 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619310 2573 flags.go:64] FLAG: --eviction-hard="" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619314 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619316 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619320 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619323 2573 flags.go:64] FLAG: --eviction-soft="" Sep 10 00:50:18.624368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619325 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619328 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619339 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619342 2573 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619345 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619348 2573 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619351 2573 flags.go:64] FLAG: --feature-gates="" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619355 2573 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619358 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619361 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619364 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619367 2573 flags.go:64] FLAG: --healthz-port="10248" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619370 2573 flags.go:64] FLAG: --help="false" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619372 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619376 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619378 2573 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619382 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619385 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619389 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619391 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619394 2573 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619397 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619400 2573 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 00:50:18.624976 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619402 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619405 2573 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619408 2573 flags.go:64] FLAG: --kube-reserved="" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619411 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619414 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619416 2573 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619419 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619422 2573 flags.go:64] FLAG: --lock-file="" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619424 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619427 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619430 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619437 2573 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619446 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619450 2573 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619452 2573 flags.go:64] FLAG: --logging-format="text" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619455 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619458 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619461 2573 flags.go:64] FLAG: --manifest-url="" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619464 2573 flags.go:64] FLAG: --manifest-url-header="" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619468 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619471 2573 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619474 2573 flags.go:64] FLAG: --max-pods="110" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619477 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619480 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619483 2573 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 00:50:18.625572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619486 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619489 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619491 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619494 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619501 2573 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619504 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619507 2573 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619509 2573 flags.go:64] FLAG: --pod-cidr="" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619512 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619518 2573 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619520 2573 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619523 2573 flags.go:64] FLAG: --pods-per-core="0" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619526 2573 flags.go:64] FLAG: --port="10250" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619529 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619532 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa4b6f37e001d8ba" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619535 2573 flags.go:64] FLAG: --qos-reserved="" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619537 2573 flags.go:64] FLAG: --read-only-port="10255" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619540 2573 flags.go:64] FLAG: --register-node="true" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619543 2573 flags.go:64] FLAG: --register-with-taints="" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619549 2573 flags.go:64] FLAG: --registry-burst="10" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619558 2573 flags.go:64] FLAG: --registry-qps="5" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619560 2573 flags.go:64] FLAG: --reserved-cpus="" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619563 2573 flags.go:64] FLAG: --reserved-memory="" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619567 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619570 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 00:50:18.626200 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619573 2573 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619575 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619578 2573 flags.go:64] FLAG: --runonce="false" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619581 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619584 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619587 2573 flags.go:64] FLAG: --seccomp-default="false" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619590 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619593 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619595 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619598 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619601 2573 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619604 2573 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619606 2573 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619609 2573 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619611 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619614 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619617 2573 flags.go:64] FLAG: --system-cgroups="" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619620 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619625 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619628 2573 flags.go:64] FLAG: --tls-cert-file="" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619630 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619636 2573 flags.go:64] FLAG: --tls-min-version="" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619639 2573 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619642 2573 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619644 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 00:50:18.626784 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619647 2573 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619652 2573 flags.go:64] FLAG: --v="2" Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619656 2573 flags.go:64] FLAG: --version="false" Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619665 2573 flags.go:64] FLAG: --vmodule="" Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619668 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.619671 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619776 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619780 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619783 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619786 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619789 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619792 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619794 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619796 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619799 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619801 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619804 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619808 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619812 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619815 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619818 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:18.627377 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619820 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619823 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619825 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619828 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619830 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619833 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619835 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619838 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619840 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619858 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619861 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619864 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619868 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619871 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619874 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619882 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619885 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619888 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619890 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619893 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:18.627885 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619896 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619898 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619900 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619904 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619906 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619910 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619913 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619916 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619919 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619922 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619925 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619927 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619930 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619932 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619935 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619938 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619940 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619943 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619945 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:18.628351 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619950 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619954 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619958 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619962 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619966 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619970 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619973 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619975 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619978 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619986 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619989 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619991 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619994 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619996 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.619999 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620002 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620004 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620007 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620009 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620012 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:18.628876 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620014 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620017 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620019 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620021 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620024 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620026 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620029 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620031 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620034 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620036 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620039 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620041 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620043 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620046 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620048 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620051 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620053 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620057 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620059 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620062 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:18.629354 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620065 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620067 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620076 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620079 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.620081 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.620641 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.627805 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.627818 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.627836 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.627841 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627917 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627922 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627926 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627929 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627932 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:18.629834 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627935 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627937 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627940 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627943 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627945 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627948 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627952 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627956 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627959 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627962 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627965 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627967 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627970 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627973 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627977 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627981 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627984 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627987 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627989 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:18.630223 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627995 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.627998 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628001 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628003 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628007 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628010 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628014 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628017 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628020 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628023 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628025 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628028 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628031 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628033 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628036 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628039 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628041 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628044 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628046 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:18.630656 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628049 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628051 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628054 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628057 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628059 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628062 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628064 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628066 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628069 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628072 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628074 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628077 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628079 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628082 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628085 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628087 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628090 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628093 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628096 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628099 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:18.631113 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628114 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628118 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628121 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628124 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628126 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628129 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628132 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628134 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628137 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628139 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628142 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628145 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628147 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628150 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628152 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628155 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628157 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628160 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628163 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628165 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:18.631585 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628168 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628170 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628173 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628175 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628178 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628180 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628183 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628186 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628188 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628191 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628194 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628197 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628200 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628202 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628205 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:18.632091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628207 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.628212 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628321 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628325 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628328 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628331 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628334 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628337 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628340 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628343 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628345 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628348 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628352 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628356 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628359 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:18.632447 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628362 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628365 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628369 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628372 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628375 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628378 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628381 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628384 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628387 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628390 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628393 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628396 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628400 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628404 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628406 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628409 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628411 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628414 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628417 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:18.632831 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628419 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628421 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628424 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628426 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628429 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628431 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628434 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628437 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628439 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628442 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628444 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628447 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628450 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628453 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628456 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628458 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628461 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628463 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628466 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628468 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:18.633301 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628471 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628473 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628476 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628478 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628481 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628484 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628486 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628489 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628492 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628494 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628497 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628499 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628502 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628504 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628507 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628510 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628512 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628515 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628517 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628520 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:18.633782 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628522 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628525 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628527 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628530 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628532 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628535 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628537 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628540 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628542 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628545 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628547 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628549 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628552 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628554 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628557 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628559 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628562 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628565 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628568 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:18.634265 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628571 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628574 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628576 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628579 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628581 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628584 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628586 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:18.628589 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.628594 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.628690 2573 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.630680 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.631658 2573 server.go:1019] "Starting client certificate rotation" Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.631753 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 00:50:18.634723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.631782 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 00:50:18.635047 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.633786 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 00:50:18.636229 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.636212 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 00:50:18.648223 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.648205 2573 log.go:25] "Validated CRI v1 runtime API" Sep 10 00:50:18.650794 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.650776 2573 log.go:25] "Validated CRI v1 image API" Sep 10 00:50:18.653151 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.653123 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 00:50:18.660499 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.660477 2573 fs.go:135] Filesystem UUIDs: map[2ee47c6a-4083-481a-8cbf-0000119ca649:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90e887b4-31a8-4f5e-82aa-8e8738799b74:/dev/nvme0n1p4] Sep 10 00:50:18.660569 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.660498 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 00:50:18.665805 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.665783 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 00:50:18.666040 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.665925 2573 manager.go:216] Machine: {Timestamp:2026-09-10 00:50:18.664912509 +0000 UTC m=+0.347002302 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3208480 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2edf6cc007ca595746ae204411bc41 SystemUUID:ec2edf6c-c007-ca59-5746-ae204411bc41 BootID:41271854-7626-4427-af65-53e509a24fd0 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:73:99:61:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:73:99:61:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:2c:42:7e:77:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 00:50:18.666040 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.666038 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 00:50:18.666151 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.666140 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 00:50:18.667106 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.667083 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 00:50:18.667230 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.667109 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 00:50:18.667695 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.667686 2573 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 00:50:18.667723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.667698 2573 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 00:50:18.667723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.667706 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 00:50:18.668341 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.668331 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 00:50:18.669161 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.669152 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 00:50:18.672650 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.672639 2573 state_mem.go:36] "Initialized new in-memory state store" Sep 10 00:50:18.672791 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.672782 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 00:50:18.672821 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.672809 2573 kubelet.go:486] "Attempting to sync node with API server" Sep 10 00:50:18.672860 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.672827 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 00:50:18.672860 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.672837 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 00:50:18.672920 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.672862 2573 kubelet.go:398] "Adding apiserver pod source" Sep 10 00:50:18.672920 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.672871 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 00:50:18.673214 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.673202 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 00:50:18.673251 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.673222 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 00:50:18.675381 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.675363 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 00:50:18.677390 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.677373 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 00:50:18.677476 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.677411 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 00:50:18.678396 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678384 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 00:50:18.678460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678402 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 00:50:18.678460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678411 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 00:50:18.678460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678418 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 00:50:18.678460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678430 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 00:50:18.678460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678439 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 00:50:18.678460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678458 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 00:50:18.678653 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678467 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 00:50:18.678653 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678478 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 00:50:18.678653 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678486 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 00:50:18.678653 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678499 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 00:50:18.678653 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.678507 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 00:50:18.679888 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.679877 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 00:50:18.679942 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.679891 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 00:50:18.681523 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.681495 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 00:50:18.681612 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.681539 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 00:50:18.681612 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.681560 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 00:50:18.683617 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.683602 2573 server.go:1268] "Started kubelet" Sep 10 00:50:18.683711 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.683670 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 00:50:18.683763 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.683694 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 00:50:18.683804 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.683763 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 00:50:18.684427 ip-10-0-131-63 systemd[1]: Started Kubernetes Kubelet. Sep 10 00:50:18.684893 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.684874 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 00:50:18.685592 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.685578 2573 server.go:310] "Adding debug handlers to kubelet server" Sep 10 00:50:18.688532 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.688514 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dlj5b" Sep 10 00:50:18.691718 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.690092 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 00:50:18.691718 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.690155 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 00:50:18.691718 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.690669 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 00:50:18.691718 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.691525 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:18.691919 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.691720 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 00:50:18.691919 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.691722 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 00:50:18.691919 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.691747 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 00:50:18.691919 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.691863 2573 reconstruct.go:97] "Volume reconstruction finished" Sep 10 00:50:18.691919 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.691872 2573 reconciler.go:29] "Reconciler: start to sync state" Sep 10 00:50:18.692086 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.691999 2573 factory.go:55] Registering systemd factory Sep 10 00:50:18.692086 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.692014 2573 factory.go:223] Registration of the systemd container factory successfully Sep 10 00:50:18.692325 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.692309 2573 factory.go:153] Registering CRI-O factory Sep 10 00:50:18.692382 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.692329 2573 factory.go:223] Registration of the crio container factory successfully Sep 10 00:50:18.692442 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.692404 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 00:50:18.692493 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.692453 2573 factory.go:103] Registering Raw factory Sep 10 00:50:18.692493 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.692468 2573 manager.go:1196] Started watching for new ooms in manager Sep 10 00:50:18.693108 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.693089 2573 manager.go:349] Starting recovery of all containers Sep 10 00:50:18.694068 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.694044 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dlj5b" Sep 10 00:50:18.695152 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.695125 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 00:50:18.695480 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.695456 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 00:50:18.696527 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.695549 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-63.ec2.internal.18d3cf4fcf4df26b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-63.ec2.internal,UID:ip-10-0-131-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-63.ec2.internal,},FirstTimestamp:2026-09-10 00:50:18.683576939 +0000 UTC m=+0.365666731,LastTimestamp:2026-09-10 00:50:18.683576939 +0000 UTC m=+0.365666731,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-63.ec2.internal,}" Sep 10 00:50:18.703260 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.703199 2573 manager.go:354] Recovery completed Sep 10 00:50:18.708176 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.708164 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:18.710507 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.710494 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:18.710585 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.710519 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:18.710585 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.710533 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:18.711176 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.711159 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:18.711876 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.711860 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 00:50:18.711876 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.711874 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 00:50:18.712000 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.711891 2573 state_mem.go:36] "Initialized new in-memory state store" Sep 10 00:50:18.712214 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.712197 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:18.712263 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.712226 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:18.712263 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.712240 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:18.713147 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.713072 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-63.ec2.internal.18d3cf4fd0e8ddcd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-63.ec2.internal,UID:ip-10-0-131-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-63.ec2.internal,},FirstTimestamp:2026-09-10 00:50:18.710506957 +0000 UTC m=+0.392596749,LastTimestamp:2026-09-10 00:50:18.710506957 +0000 UTC m=+0.392596749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-63.ec2.internal,}" Sep 10 00:50:18.713864 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.713830 2573 policy_none.go:49] "None policy: Start" Sep 10 00:50:18.713929 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.713872 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 00:50:18.713929 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.713884 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 00:50:18.715786 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.715773 2573 policy_none.go:47] "Start" Sep 10 00:50:18.747479 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.747464 2573 manager.go:337] "Starting Device Plugin manager" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.747506 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.747519 2573 server.go:87] "Starting device plugin registration server" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.747815 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.747828 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.747917 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.748001 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.748010 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.748446 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 00:50:18.762913 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.748494 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:18.815877 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.815822 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 00:50:18.817054 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.817035 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 00:50:18.817141 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.817086 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 00:50:18.817141 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.817111 2573 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 00:50:18.817234 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.817155 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 00:50:18.819754 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.819736 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:18.848113 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.848100 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:18.848895 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.848880 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:18.848973 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.848911 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:18.848973 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.848921 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:18.848973 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.848945 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.857130 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.857117 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.857185 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.857136 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-63.ec2.internal\": node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:18.872914 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.872834 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:18.917783 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.917750 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal"] Sep 10 00:50:18.917892 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.917819 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:18.919174 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.919160 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:18.919243 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.919189 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:18.919243 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.919199 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:18.921384 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.921371 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:18.921894 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.921880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.922384 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.922012 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:18.922488 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.922471 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:18.922545 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.922529 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:18.922589 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.922548 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:18.923754 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.923023 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:18.923754 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.923060 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:18.923754 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.923075 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:18.924941 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.924923 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.925006 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.924951 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:18.925576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.925560 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:18.925661 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.925587 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:18.925661 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.925601 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:18.950400 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.950377 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-63.ec2.internal\" not found" node="ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.954545 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.954527 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-63.ec2.internal\" not found" node="ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.973677 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:18.973659 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:18.994028 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.994011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15207f7ec76bc3ba21ea601cf90f7b11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal\" (UID: \"15207f7ec76bc3ba21ea601cf90f7b11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.994084 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.994033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15207f7ec76bc3ba21ea601cf90f7b11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal\" (UID: \"15207f7ec76bc3ba21ea601cf90f7b11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:18.994084 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:18.994048 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afb1c523a0c5b188374be40b94f8933b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-63.ec2.internal\" (UID: \"afb1c523a0c5b188374be40b94f8933b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.074367 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:19.074342 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:19.094789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.094768 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afb1c523a0c5b188374be40b94f8933b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-63.ec2.internal\" (UID: \"afb1c523a0c5b188374be40b94f8933b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.094791 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afb1c523a0c5b188374be40b94f8933b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-63.ec2.internal\" (UID: \"afb1c523a0c5b188374be40b94f8933b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.094829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15207f7ec76bc3ba21ea601cf90f7b11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal\" (UID: \"15207f7ec76bc3ba21ea601cf90f7b11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.094861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15207f7ec76bc3ba21ea601cf90f7b11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal\" (UID: \"15207f7ec76bc3ba21ea601cf90f7b11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.094961 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.094893 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15207f7ec76bc3ba21ea601cf90f7b11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal\" (UID: \"15207f7ec76bc3ba21ea601cf90f7b11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.094961 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.094921 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15207f7ec76bc3ba21ea601cf90f7b11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal\" (UID: \"15207f7ec76bc3ba21ea601cf90f7b11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.175110 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:19.175078 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:19.252472 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.252448 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.257546 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:19.257391 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" Sep 10 00:50:19.276036 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:19.276019 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:20.767724 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:20.767704 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:20.868255 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:20.868209 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:20.968684 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:20.968661 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-63.ec2.internal\" not found" Sep 10 00:50:21.012213 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.012193 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:21.023270 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.023256 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 00:50:21.023368 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.023352 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 00:50:21.023415 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.023398 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 00:50:21.064554 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.064534 2573 apiserver.go:52] "Watching apiserver" Sep 10 00:50:21.081769 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.081747 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 00:50:21.081873 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.081745 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 00:50:21.082115 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.082094 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-z6256","openshift-multus/multus-km6nq","openshift-ovn-kubernetes/ovnkube-node-j5fjt","kube-system/global-pull-secret-syncer-q5bvn","kube-system/konnectivity-agent-kfsrs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l","openshift-dns/node-resolver-j6l5k","openshift-multus/multus-additional-cni-plugins-xbx6s","openshift-multus/network-metrics-daemon-zpzbn","openshift-network-diagnostics/network-check-target-tfbb8","openshift-network-operator/iptables-alerter-wmtsr","openshift-cluster-node-tuning-operator/tuned-fsfjn"] Sep 10 00:50:21.083099 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.083082 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" Sep 10 00:50:21.084953 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.084939 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.087538 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.087524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.087722 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.087704 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 00:50:21.087879 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.087866 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fv4tk\"" Sep 10 00:50:21.087975 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.087893 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 00:50:21.088226 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.088212 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 00:50:21.089258 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.089242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2937f26-1d68-47c9-92d4-979f1ed3a5be-serviceca\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.089334 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.089271 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh75x\" (UniqueName: \"kubernetes.io/projected/a2937f26-1d68-47c9-92d4-979f1ed3a5be-kube-api-access-mh75x\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.089367 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.089329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2937f26-1d68-47c9-92d4-979f1ed3a5be-host\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.090081 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090064 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 00:50:21.090146 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090129 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 00:50:21.090221 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090197 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 00:45:20 +0000 UTC" deadline="2028-03-24 17:07:45.254533715 +0000 UTC" Sep 10 00:50:21.090325 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090223 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13480h17m24.164314347s" Sep 10 00:50:21.090325 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090240 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.090433 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090393 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 00:50:21.090610 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090594 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4755t\"" Sep 10 00:50:21.090712 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.090596 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 00:50:21.092329 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.092315 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.092498 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.092369 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:21.092852 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.092838 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l7rtj\"" Sep 10 00:50:21.094140 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.094120 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 00:50:21.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.094424 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 00:50:21.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.094504 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 00:50:21.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.094529 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 00:50:21.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.094594 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 00:50:21.094868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.094778 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 00:50:21.095179 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.095027 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 00:50:21.095476 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.095460 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 00:50:21.095547 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.095535 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" Sep 10 00:50:21.096686 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.095851 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.098303 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.098282 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.098440 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.098303 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 00:50:21.098523 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.098509 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rwhjs\"" Sep 10 00:50:21.098660 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.098648 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 00:50:21.100450 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.100437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.100743 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.100727 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g7x29\"" Sep 10 00:50:21.100861 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.100734 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 00:50:21.100974 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.100960 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 00:50:21.101242 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.101226 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 00:50:21.102705 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.102687 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.103185 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.103167 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 00:50:21.103185 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.103185 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 00:50:21.103185 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.103205 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ft7rp\"" Sep 10 00:50:21.104941 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.104928 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:21.105010 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.104984 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:21.105288 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.105265 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 00:50:21.105430 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.105415 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zdqf5\"" Sep 10 00:50:21.105608 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.105586 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 00:50:21.105717 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.105697 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 00:50:21.107285 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.107273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:21.107341 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.107326 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:21.109418 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.109401 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.111701 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.111685 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal"] Sep 10 00:50:21.111783 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.111718 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal"] Sep 10 00:50:21.111843 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.111792 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.112004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.111988 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:21.112260 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.112241 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 00:50:21.112364 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.112349 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-88wmw\"" Sep 10 00:50:21.112428 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.112246 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 00:50:21.114490 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.114469 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q7qsm\"" Sep 10 00:50:21.114810 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.114752 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 00:50:21.114810 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.114806 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:21.122266 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.122223 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bcgvm" Sep 10 00:50:21.130616 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.130600 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bcgvm" Sep 10 00:50:21.183725 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.183590 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 00:50:21.190015 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.189997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmx2n\" (UniqueName: \"kubernetes.io/projected/623d66b0-4f95-47e4-acd9-3d5e4e717e36-kube-api-access-qmx2n\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.190148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-cnibin\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.190148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2552efdc-0ea2-41f8-9750-6b41238557d4-dbus\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.190148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovnkube-config\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.190148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovn-node-metrics-cert\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.190148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190134 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-sys\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.190313 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-cni-bin\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.190313 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.190313 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt6z2\" (UniqueName: \"kubernetes.io/projected/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-kube-api-access-kt6z2\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:21.190313 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-systemd\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.190313 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-host\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovnkube-script-lib\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-kubernetes\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190372 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-kubelet\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-systemd-units\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-cni-binary-copy\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysconfig\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-host-slash\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-sys-fs\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.190576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-run-netns\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-etc-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-run\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2937f26-1d68-47c9-92d4-979f1ed3a5be-host\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-system-cni-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-conf-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffb2w\" (UniqueName: \"kubernetes.io/projected/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-kube-api-access-ffb2w\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-cnibin\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190843 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2937f26-1d68-47c9-92d4-979f1ed3a5be-host\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-kubelet\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-node-log\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-socket-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190930 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-var-lib-kubelet\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190952 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-iptables-alerter-script\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dls\" (UniqueName: \"kubernetes.io/projected/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-kube-api-access-k8dls\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.191004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.190995 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-cni-bin\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-hosts-file\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-system-cni-dir\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktfvs\" (UniqueName: \"kubernetes.io/projected/ba8abea1-b389-4512-a555-536b8bb3c476-kube-api-access-ktfvs\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-socket-dir-parent\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-k8s-cni-cncf-io\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-multus-certs\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-systemd\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-tmp-dir\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-modprobe-d\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba8abea1-b389-4512-a555-536b8bb3c476-etc-tuned\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-slash\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-var-lib-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-ovn\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-log-socket\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.191785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2552efdc-0ea2-41f8-9750-6b41238557d4-kubelet-config\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191475 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-cni-binary-copy\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-cni-multus\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-cni-netd\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysctl-conf\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba8abea1-b389-4512-a555-536b8bb3c476-tmp\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-netns\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-daemon-config\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-env-overrides\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hmzr\" (UniqueName: \"kubernetes.io/projected/293375e1-ca1f-4dd0-9b72-c3f53239616e-kube-api-access-9hmzr\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-etc-kubernetes\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.192566 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-registration-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysctl-d\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0461365-5833-4fa2-9f41-61e18362440e-konnectivity-ca\") pod \"konnectivity-agent-kfsrs\" (UID: \"b0461365-5833-4fa2-9f41-61e18362440e\") " pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.191985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2937f26-1d68-47c9-92d4-979f1ed3a5be-serviceca\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192026 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-cni-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-hostroot\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-device-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6hps\" (UniqueName: \"kubernetes.io/projected/3620729c-b4c0-4373-8f03-952db98d5586-kube-api-access-h6hps\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0461365-5833-4fa2-9f41-61e18362440e-agent-certs\") pod \"konnectivity-agent-kfsrs\" (UID: \"b0461365-5833-4fa2-9f41-61e18362440e\") " pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh75x\" (UniqueName: \"kubernetes.io/projected/a2937f26-1d68-47c9-92d4-979f1ed3a5be-kube-api-access-mh75x\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-lib-modules\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7dkj\" (UniqueName: \"kubernetes.io/projected/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-kube-api-access-c7dkj\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.193075 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.192463 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2937f26-1d68-47c9-92d4-979f1ed3a5be-serviceca\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.198971 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.198951 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 00:50:21.202182 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.202165 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh75x\" (UniqueName: \"kubernetes.io/projected/a2937f26-1d68-47c9-92d4-979f1ed3a5be-kube-api-access-mh75x\") pod \"node-ca-z6256\" (UID: \"a2937f26-1d68-47c9-92d4-979f1ed3a5be\") " pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.237156 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.237120 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb1c523a0c5b188374be40b94f8933b.slice/crio-a6bd378c6eb883e94b5db1e54513b996a510055cdbd14495a07f01f645c27c23 WatchSource:0}: Error finding container a6bd378c6eb883e94b5db1e54513b996a510055cdbd14495a07f01f645c27c23: Status 404 returned error can't find the container with id a6bd378c6eb883e94b5db1e54513b996a510055cdbd14495a07f01f645c27c23 Sep 10 00:50:21.240221 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.240206 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:50:21.292707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-multus-certs\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.292777 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-systemd\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.292777 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.292777 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-tmp-dir\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.292777 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-modprobe-d\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.292777 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292764 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba8abea1-b389-4512-a555-536b8bb3c476-etc-tuned\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-slash\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292785 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-systemd\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-var-lib-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292805 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-multus-certs\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-ovn\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292840 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-slash\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-log-socket\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292866 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-var-lib-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292870 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-modprobe-d\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292913 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292915 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-log-socket\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292915 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-run-ovn\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292937 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2552efdc-0ea2-41f8-9750-6b41238557d4-kubelet-config\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.292986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-cni-binary-copy\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.293030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293004 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2552efdc-0ea2-41f8-9750-6b41238557d4-kubelet-config\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-cni-multus\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-cni-netd\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293161 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-cni-multus\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293163 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-tmp-dir\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysctl-conf\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293217 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-cni-netd\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba8abea1-b389-4512-a555-536b8bb3c476-tmp\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293317 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysctl-conf\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-netns\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-daemon-config\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293407 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-netns\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-env-overrides\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293478 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hmzr\" (UniqueName: \"kubernetes.io/projected/293375e1-ca1f-4dd0-9b72-c3f53239616e-kube-api-access-9hmzr\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293514 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.293789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293533 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-cni-binary-copy\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-etc-kubernetes\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-registration-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysctl-d\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0461365-5833-4fa2-9f41-61e18362440e-konnectivity-ca\") pod \"konnectivity-agent-kfsrs\" (UID: \"b0461365-5833-4fa2-9f41-61e18362440e\") " pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-cni-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-hostroot\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293731 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-device-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6hps\" (UniqueName: \"kubernetes.io/projected/3620729c-b4c0-4373-8f03-952db98d5586-kube-api-access-h6hps\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293803 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0461365-5833-4fa2-9f41-61e18362440e-agent-certs\") pod \"konnectivity-agent-kfsrs\" (UID: \"b0461365-5833-4fa2-9f41-61e18362440e\") " pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-lib-modules\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293833 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-daemon-config\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7dkj\" (UniqueName: \"kubernetes.io/projected/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-kube-api-access-c7dkj\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.294563 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmx2n\" (UniqueName: \"kubernetes.io/projected/623d66b0-4f95-47e4-acd9-3d5e4e717e36-kube-api-access-qmx2n\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293897 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-cnibin\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2552efdc-0ea2-41f8-9750-6b41238557d4-dbus\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovnkube-config\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293957 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293973 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-env-overrides\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293978 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.293971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovn-node-metrics-cert\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294037 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-hostroot\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.294041 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294079 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-registration-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294110 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-device-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.294123 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs podName:41146b11-bf1d-412b-85cf-83cd0b4fc7cf nodeName:}" failed. No retries permitted until 2026-09-10 00:50:21.79410318 +0000 UTC m=+2.084988359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs") pod "network-metrics-daemon-zpzbn" (UID: "41146b11-bf1d-412b-85cf-83cd0b4fc7cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294158 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-cni-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-sys\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-cni-bin\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.295369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt6z2\" (UniqueName: \"kubernetes.io/projected/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-kube-api-access-kt6z2\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294288 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-cnibin\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294331 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-sys\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294337 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-systemd\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294332 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0461365-5833-4fa2-9f41-61e18362440e-konnectivity-ca\") pod \"konnectivity-agent-kfsrs\" (UID: \"b0461365-5833-4fa2-9f41-61e18362440e\") " pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294381 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-cni-bin\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294412 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2552efdc-0ea2-41f8-9750-6b41238557d4-dbus\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-systemd\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-host\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294530 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovnkube-script-lib\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-kubernetes\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294574 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-kubelet\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-systemd-units\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.294653 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294666 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-cni-binary-copy\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.296037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysconfig\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.294703 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret podName:2552efdc-0ea2-41f8-9750-6b41238557d4 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:21.794687744 +0000 UTC m=+2.085572923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret") pod "global-pull-secret-syncer-q5bvn" (UID: "2552efdc-0ea2-41f8-9750-6b41238557d4") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-host-slash\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294733 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysconfig\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-sys-fs\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-run-netns\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294771 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-kubelet\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-etc-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294828 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-systemd-units\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294864 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294880 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294909 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovnkube-config\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294931 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-run\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294979 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-host\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294982 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-sys-fs\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295016 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-run-netns\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.296576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295076 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-etc-openvswitch\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.294885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-run\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-system-cni-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-conf-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295169 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffb2w\" (UniqueName: \"kubernetes.io/projected/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-kube-api-access-ffb2w\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295194 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-cnibin\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-kubelet\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-node-log\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295260 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-socket-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-var-lib-kubelet\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295320 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-iptables-alerter-script\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295338 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3620729c-b4c0-4373-8f03-952db98d5586-cni-binary-copy\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295344 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dls\" (UniqueName: \"kubernetes.io/projected/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-kube-api-access-k8dls\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295381 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-kubernetes\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-cni-bin\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-hosts-file\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295427 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-etc-kubernetes\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295443 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovnkube-script-lib\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295443 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-system-cni-dir\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295478 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3620729c-b4c0-4373-8f03-952db98d5586-system-cni-dir\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295488 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktfvs\" (UniqueName: \"kubernetes.io/projected/ba8abea1-b389-4512-a555-536b8bb3c476-kube-api-access-ktfvs\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295505 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-lib-modules\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-socket-dir-parent\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-k8s-cni-cncf-io\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295550 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-hosts-file\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295558 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba8abea1-b389-4512-a555-536b8bb3c476-tmp\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295576 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-node-log\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295552 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/293375e1-ca1f-4dd0-9b72-c3f53239616e-host-kubelet\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295594 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-system-cni-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295623 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-host-slash\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295643 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-cnibin\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295648 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-etc-sysctl-d\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295516 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-var-lib-cni-bin\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295702 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-socket-dir-parent\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295707 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-host-run-k8s-cni-cncf-io\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.297558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295764 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-multus-conf-dir\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.298030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295792 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/623d66b0-4f95-47e4-acd9-3d5e4e717e36-socket-dir\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.298030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.295811 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8abea1-b389-4512-a555-536b8bb3c476-var-lib-kubelet\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.298030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.296166 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-iptables-alerter-script\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.298030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.296209 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba8abea1-b389-4512-a555-536b8bb3c476-etc-tuned\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.298030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.296460 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/293375e1-ca1f-4dd0-9b72-c3f53239616e-ovn-node-metrics-cert\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.298030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.296810 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0461365-5833-4fa2-9f41-61e18362440e-agent-certs\") pod \"konnectivity-agent-kfsrs\" (UID: \"b0461365-5833-4fa2-9f41-61e18362440e\") " pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.301100 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.301083 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:21.301185 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.301106 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:21.301185 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.301119 2573 projected.go:196] Error preparing data for projected volume kube-api-access-69kvw for pod openshift-network-diagnostics/network-check-target-tfbb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:21.301185 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.301183 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw podName:0e9a721c-3e04-4772-8554-341c06b38a5d nodeName:}" failed. No retries permitted until 2026-09-10 00:50:21.801168769 +0000 UTC m=+2.092053956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-69kvw" (UniqueName: "kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw") pod "network-check-target-tfbb8" (UID: "0e9a721c-3e04-4772-8554-341c06b38a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:21.303343 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.303320 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7dkj\" (UniqueName: \"kubernetes.io/projected/1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c-kube-api-access-c7dkj\") pod \"multus-km6nq\" (UID: \"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c\") " pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.305136 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.304206 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt6z2\" (UniqueName: \"kubernetes.io/projected/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-kube-api-access-kt6z2\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:21.305136 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.304760 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffb2w\" (UniqueName: \"kubernetes.io/projected/6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d-kube-api-access-ffb2w\") pod \"node-resolver-j6l5k\" (UID: \"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d\") " pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.306361 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.305773 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6hps\" (UniqueName: \"kubernetes.io/projected/3620729c-b4c0-4373-8f03-952db98d5586-kube-api-access-h6hps\") pod \"multus-additional-cni-plugins-xbx6s\" (UID: \"3620729c-b4c0-4373-8f03-952db98d5586\") " pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.306361 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.305970 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmx2n\" (UniqueName: \"kubernetes.io/projected/623d66b0-4f95-47e4-acd9-3d5e4e717e36-kube-api-access-qmx2n\") pod \"aws-ebs-csi-driver-node-6qn7l\" (UID: \"623d66b0-4f95-47e4-acd9-3d5e4e717e36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.307010 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.306988 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktfvs\" (UniqueName: \"kubernetes.io/projected/ba8abea1-b389-4512-a555-536b8bb3c476-kube-api-access-ktfvs\") pod \"tuned-fsfjn\" (UID: \"ba8abea1-b389-4512-a555-536b8bb3c476\") " pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.307010 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.307001 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hmzr\" (UniqueName: \"kubernetes.io/projected/293375e1-ca1f-4dd0-9b72-c3f53239616e-kube-api-access-9hmzr\") pod \"ovnkube-node-j5fjt\" (UID: \"293375e1-ca1f-4dd0-9b72-c3f53239616e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.307117 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.307094 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dls\" (UniqueName: \"kubernetes.io/projected/f47e64a1-02c8-4dd6-953d-3ec5ede0f927-kube-api-access-k8dls\") pod \"iptables-alerter-wmtsr\" (UID: \"f47e64a1-02c8-4dd6-953d-3ec5ede0f927\") " pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.367248 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.367229 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:21.423560 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.423510 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z6256" Sep 10 00:50:21.433311 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.433288 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2937f26_1d68_47c9_92d4_979f1ed3a5be.slice/crio-a7850aecd3fc3261f599b6037de07469534849ee6817d49b98b2bd3d858eb89c WatchSource:0}: Error finding container a7850aecd3fc3261f599b6037de07469534849ee6817d49b98b2bd3d858eb89c: Status 404 returned error can't find the container with id a7850aecd3fc3261f599b6037de07469534849ee6817d49b98b2bd3d858eb89c Sep 10 00:50:21.437828 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.437814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-km6nq" Sep 10 00:50:21.443859 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.443845 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:21.445080 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.445061 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf268dd_5e37_4ba3_bc59_6c3f7d5b945c.slice/crio-a89756cf909925f9528382f752a5c06bc11c69958ed03f4f466d7a8fc49f76a7 WatchSource:0}: Error finding container a89756cf909925f9528382f752a5c06bc11c69958ed03f4f466d7a8fc49f76a7: Status 404 returned error can't find the container with id a89756cf909925f9528382f752a5c06bc11c69958ed03f4f466d7a8fc49f76a7 Sep 10 00:50:21.451251 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.451235 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293375e1_ca1f_4dd0_9b72_c3f53239616e.slice/crio-864c516c05f63c5930360dddffe2c327f134616b80939e1d4ef05d44fa776425 WatchSource:0}: Error finding container 864c516c05f63c5930360dddffe2c327f134616b80939e1d4ef05d44fa776425: Status 404 returned error can't find the container with id 864c516c05f63c5930360dddffe2c327f134616b80939e1d4ef05d44fa776425 Sep 10 00:50:21.469381 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.469362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:21.476735 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.476713 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0461365_5833_4fa2_9f41_61e18362440e.slice/crio-645a4ba50c074a07dbbf4eef9b97e48c9d81bb5d8eab6c405d1f6304cebfb104 WatchSource:0}: Error finding container 645a4ba50c074a07dbbf4eef9b97e48c9d81bb5d8eab6c405d1f6304cebfb104: Status 404 returned error can't find the container with id 645a4ba50c074a07dbbf4eef9b97e48c9d81bb5d8eab6c405d1f6304cebfb104 Sep 10 00:50:21.483031 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.483016 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" Sep 10 00:50:21.489701 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.489688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6l5k" Sep 10 00:50:21.490696 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.490679 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623d66b0_4f95_47e4_acd9_3d5e4e717e36.slice/crio-423cbbfe4bf258e226dab004fa150d8ee78084482c292706957643071e629190 WatchSource:0}: Error finding container 423cbbfe4bf258e226dab004fa150d8ee78084482c292706957643071e629190: Status 404 returned error can't find the container with id 423cbbfe4bf258e226dab004fa150d8ee78084482c292706957643071e629190 Sep 10 00:50:21.497476 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.497460 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8f6ba2_5c51_4da2_bdc5_99b3bd806d4d.slice/crio-16a0d67582fe286fac68b329fa54aa355154b674667a9c034dd823f54716cb90 WatchSource:0}: Error finding container 16a0d67582fe286fac68b329fa54aa355154b674667a9c034dd823f54716cb90: Status 404 returned error can't find the container with id 16a0d67582fe286fac68b329fa54aa355154b674667a9c034dd823f54716cb90 Sep 10 00:50:21.508257 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.508242 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" Sep 10 00:50:21.515478 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.515458 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3620729c_b4c0_4373_8f03_952db98d5586.slice/crio-b860bb7a23de27156a4387d6f8d5d821a132f81f9c6bbf990a2363d2a3a4b9aa WatchSource:0}: Error finding container b860bb7a23de27156a4387d6f8d5d821a132f81f9c6bbf990a2363d2a3a4b9aa: Status 404 returned error can't find the container with id b860bb7a23de27156a4387d6f8d5d821a132f81f9c6bbf990a2363d2a3a4b9aa Sep 10 00:50:21.521317 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.521298 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wmtsr" Sep 10 00:50:21.526323 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.526310 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" Sep 10 00:50:21.528484 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.528463 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47e64a1_02c8_4dd6_953d_3ec5ede0f927.slice/crio-a137c104ce9112bfca14ccd1650ea992366aa39a6458f7e6339cc4c6c60e7932 WatchSource:0}: Error finding container a137c104ce9112bfca14ccd1650ea992366aa39a6458f7e6339cc4c6c60e7932: Status 404 returned error can't find the container with id a137c104ce9112bfca14ccd1650ea992366aa39a6458f7e6339cc4c6c60e7932 Sep 10 00:50:21.547326 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.547307 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8abea1_b389_4512_a555_536b8bb3c476.slice/crio-c30d305efe85798527fbc2cfd98714ef8a0991cec6a20b518cae4ae17c7ccee1 WatchSource:0}: Error finding container c30d305efe85798527fbc2cfd98714ef8a0991cec6a20b518cae4ae17c7ccee1: Status 404 returned error can't find the container with id c30d305efe85798527fbc2cfd98714ef8a0991cec6a20b518cae4ae17c7ccee1 Sep 10 00:50:21.549259 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:21.549236 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15207f7ec76bc3ba21ea601cf90f7b11.slice/crio-cd3d152271343e4c5cd2f57d5f735ed8637ece32a7acbf8f0748b740b09a0628 WatchSource:0}: Error finding container cd3d152271343e4c5cd2f57d5f735ed8637ece32a7acbf8f0748b740b09a0628: Status 404 returned error can't find the container with id cd3d152271343e4c5cd2f57d5f735ed8637ece32a7acbf8f0748b740b09a0628 Sep 10 00:50:21.663465 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.663447 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:21.799644 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.799581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:21.799764 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.799663 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:21.799764 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.799720 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:21.799837 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.799774 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:21.799837 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.799786 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret podName:2552efdc-0ea2-41f8-9750-6b41238557d4 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:22.799767419 +0000 UTC m=+3.090652588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret") pod "global-pull-secret-syncer-q5bvn" (UID: "2552efdc-0ea2-41f8-9750-6b41238557d4") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:21.799837 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.799817 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs podName:41146b11-bf1d-412b-85cf-83cd0b4fc7cf nodeName:}" failed. No retries permitted until 2026-09-10 00:50:22.799804515 +0000 UTC m=+3.090689680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs") pod "network-metrics-daemon-zpzbn" (UID: "41146b11-bf1d-412b-85cf-83cd0b4fc7cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:21.900223 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:21.900191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:21.900384 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.900343 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:21.900384 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.900365 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:21.900384 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.900374 2573 projected.go:196] Error preparing data for projected volume kube-api-access-69kvw for pod openshift-network-diagnostics/network-check-target-tfbb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:21.900546 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:21.900418 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw podName:0e9a721c-3e04-4772-8554-341c06b38a5d nodeName:}" failed. No retries permitted until 2026-09-10 00:50:22.900402742 +0000 UTC m=+3.191287913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-69kvw" (UniqueName: "kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw") pod "network-check-target-tfbb8" (UID: "0e9a721c-3e04-4772-8554-341c06b38a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:22.126861 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.126780 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:22.133247 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.133191 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 00:45:21 +0000 UTC" deadline="2028-02-04 23:19:48.971792288 +0000 UTC" Sep 10 00:50:22.133247 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.133248 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12310h29m26.838548448s" Sep 10 00:50:22.210319 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.210289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:22.210469 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.210421 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:22.219353 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.219298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" event={"ID":"15207f7ec76bc3ba21ea601cf90f7b11","Type":"ContainerStarted","Data":"cd3d152271343e4c5cd2f57d5f735ed8637ece32a7acbf8f0748b740b09a0628"} Sep 10 00:50:22.225490 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.225463 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" event={"ID":"ba8abea1-b389-4512-a555-536b8bb3c476","Type":"ContainerStarted","Data":"c30d305efe85798527fbc2cfd98714ef8a0991cec6a20b518cae4ae17c7ccee1"} Sep 10 00:50:22.228699 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.228675 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wmtsr" event={"ID":"f47e64a1-02c8-4dd6-953d-3ec5ede0f927","Type":"ContainerStarted","Data":"a137c104ce9112bfca14ccd1650ea992366aa39a6458f7e6339cc4c6c60e7932"} Sep 10 00:50:22.231870 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.231849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerStarted","Data":"b860bb7a23de27156a4387d6f8d5d821a132f81f9c6bbf990a2363d2a3a4b9aa"} Sep 10 00:50:22.243622 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.243598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"864c516c05f63c5930360dddffe2c327f134616b80939e1d4ef05d44fa776425"} Sep 10 00:50:22.256394 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.256352 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" event={"ID":"afb1c523a0c5b188374be40b94f8933b","Type":"ContainerStarted","Data":"a6bd378c6eb883e94b5db1e54513b996a510055cdbd14495a07f01f645c27c23"} Sep 10 00:50:22.262326 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.262302 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6l5k" event={"ID":"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d","Type":"ContainerStarted","Data":"16a0d67582fe286fac68b329fa54aa355154b674667a9c034dd823f54716cb90"} Sep 10 00:50:22.264129 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.264107 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" event={"ID":"623d66b0-4f95-47e4-acd9-3d5e4e717e36","Type":"ContainerStarted","Data":"423cbbfe4bf258e226dab004fa150d8ee78084482c292706957643071e629190"} Sep 10 00:50:22.267451 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.267429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfsrs" event={"ID":"b0461365-5833-4fa2-9f41-61e18362440e","Type":"ContainerStarted","Data":"645a4ba50c074a07dbbf4eef9b97e48c9d81bb5d8eab6c405d1f6304cebfb104"} Sep 10 00:50:22.272595 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.272573 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-km6nq" event={"ID":"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c","Type":"ContainerStarted","Data":"a89756cf909925f9528382f752a5c06bc11c69958ed03f4f466d7a8fc49f76a7"} Sep 10 00:50:22.285130 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.285094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z6256" event={"ID":"a2937f26-1d68-47c9-92d4-979f1ed3a5be","Type":"ContainerStarted","Data":"a7850aecd3fc3261f599b6037de07469534849ee6817d49b98b2bd3d858eb89c"} Sep 10 00:50:22.808038 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.808003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:22.808220 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.808092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:22.808296 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.808270 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:22.808351 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.808331 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret podName:2552efdc-0ea2-41f8-9750-6b41238557d4 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:24.8083139 +0000 UTC m=+5.099199068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret") pod "global-pull-secret-syncer-q5bvn" (UID: "2552efdc-0ea2-41f8-9750-6b41238557d4") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:22.808724 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.808706 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:22.808800 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.808762 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs podName:41146b11-bf1d-412b-85cf-83cd0b4fc7cf nodeName:}" failed. No retries permitted until 2026-09-10 00:50:24.808746454 +0000 UTC m=+5.099631620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs") pod "network-metrics-daemon-zpzbn" (UID: "41146b11-bf1d-412b-85cf-83cd0b4fc7cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:22.908887 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:22.908850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:22.909086 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.909028 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:22.909086 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.909071 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:22.909086 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.909085 2573 projected.go:196] Error preparing data for projected volume kube-api-access-69kvw for pod openshift-network-diagnostics/network-check-target-tfbb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:22.909264 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:22.909157 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw podName:0e9a721c-3e04-4772-8554-341c06b38a5d nodeName:}" failed. No retries permitted until 2026-09-10 00:50:24.909139169 +0000 UTC m=+5.200024341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-69kvw" (UniqueName: "kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw") pod "network-check-target-tfbb8" (UID: "0e9a721c-3e04-4772-8554-341c06b38a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:23.134037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:23.133997 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 00:45:21 +0000 UTC" deadline="2028-02-19 07:56:30.287927394 +0000 UTC" Sep 10 00:50:23.134037 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:23.134036 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12655h6m7.15389537s" Sep 10 00:50:23.208534 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:23.208502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:23.208714 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:23.208675 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:23.209087 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:23.209068 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:23.209209 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:23.209190 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:23.915303 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:23.915275 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:24.208719 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:24.208505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:24.208719 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.208627 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:24.830025 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:24.829993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:24.830206 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:24.830038 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:24.830206 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.830181 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:24.830206 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.830195 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:24.830338 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.830239 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret podName:2552efdc-0ea2-41f8-9750-6b41238557d4 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:28.830220503 +0000 UTC m=+9.121105670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret") pod "global-pull-secret-syncer-q5bvn" (UID: "2552efdc-0ea2-41f8-9750-6b41238557d4") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:24.830338 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.830274 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs podName:41146b11-bf1d-412b-85cf-83cd0b4fc7cf nodeName:}" failed. No retries permitted until 2026-09-10 00:50:28.830255295 +0000 UTC m=+9.121140478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs") pod "network-metrics-daemon-zpzbn" (UID: "41146b11-bf1d-412b-85cf-83cd0b4fc7cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:24.930857 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:24.930821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:24.931025 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.930995 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:24.931025 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.931014 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:24.931146 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.931026 2573 projected.go:196] Error preparing data for projected volume kube-api-access-69kvw for pod openshift-network-diagnostics/network-check-target-tfbb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:24.931146 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:24.931096 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw podName:0e9a721c-3e04-4772-8554-341c06b38a5d nodeName:}" failed. No retries permitted until 2026-09-10 00:50:28.931077742 +0000 UTC m=+9.221962922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-69kvw" (UniqueName: "kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw") pod "network-check-target-tfbb8" (UID: "0e9a721c-3e04-4772-8554-341c06b38a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:25.209194 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:25.208734 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:25.209194 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:25.208866 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:25.209194 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:25.209012 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:25.209194 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:25.209126 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:26.209247 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:26.209211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:26.209701 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:26.209336 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:27.209213 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:27.209180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:27.209387 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:27.209324 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:27.209742 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:27.209178 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:27.209801 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:27.209739 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:28.212785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:28.212758 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:28.213292 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.212878 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:28.865463 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:28.865211 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:28.865463 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:28.865276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:28.865463 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.865375 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:28.865463 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.865406 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:28.865463 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.865446 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs podName:41146b11-bf1d-412b-85cf-83cd0b4fc7cf nodeName:}" failed. No retries permitted until 2026-09-10 00:50:36.865425081 +0000 UTC m=+17.156310259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs") pod "network-metrics-daemon-zpzbn" (UID: "41146b11-bf1d-412b-85cf-83cd0b4fc7cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:28.865463 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.865467 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret podName:2552efdc-0ea2-41f8-9750-6b41238557d4 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:36.865456345 +0000 UTC m=+17.156341524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret") pod "global-pull-secret-syncer-q5bvn" (UID: "2552efdc-0ea2-41f8-9750-6b41238557d4") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:28.966139 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:28.966102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:28.966308 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.966291 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:28.966377 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.966311 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:28.966377 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.966323 2573 projected.go:196] Error preparing data for projected volume kube-api-access-69kvw for pod openshift-network-diagnostics/network-check-target-tfbb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:28.966484 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:28.966377 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw podName:0e9a721c-3e04-4772-8554-341c06b38a5d nodeName:}" failed. No retries permitted until 2026-09-10 00:50:36.966359683 +0000 UTC m=+17.257244855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-69kvw" (UniqueName: "kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw") pod "network-check-target-tfbb8" (UID: "0e9a721c-3e04-4772-8554-341c06b38a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:29.209633 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:29.209139 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:29.209633 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:29.209284 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:29.209633 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:29.209523 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:29.209633 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:29.209613 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:30.209983 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:30.209902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:30.210395 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:30.210010 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:31.209511 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:31.209482 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:31.209649 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:31.209482 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:31.209649 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:31.209584 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:31.209725 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:31.209651 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:32.209234 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:32.209196 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:32.209760 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:32.209318 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:33.209463 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:33.209432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:33.209910 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:33.209571 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:33.209910 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:33.209625 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:33.209910 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:33.209728 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:34.209330 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:34.209291 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:34.209492 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:34.209426 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:35.209212 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:35.209180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:35.209394 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:35.209189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:35.209394 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:35.209274 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:35.209505 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:35.209391 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:36.208732 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:36.208694 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:36.208908 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:36.208826 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:36.922786 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:36.922749 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:36.923253 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:36.922809 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:36.923253 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:36.922908 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:36.923253 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:36.922927 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:36.923253 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:36.922980 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret podName:2552efdc-0ea2-41f8-9750-6b41238557d4 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:52.922961354 +0000 UTC m=+33.213846526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret") pod "global-pull-secret-syncer-q5bvn" (UID: "2552efdc-0ea2-41f8-9750-6b41238557d4") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:36.923253 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:36.922998 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs podName:41146b11-bf1d-412b-85cf-83cd0b4fc7cf nodeName:}" failed. No retries permitted until 2026-09-10 00:50:52.922988134 +0000 UTC m=+33.213873322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs") pod "network-metrics-daemon-zpzbn" (UID: "41146b11-bf1d-412b-85cf-83cd0b4fc7cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:37.023991 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:37.023960 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:37.024149 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:37.024129 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:37.024211 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:37.024160 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:37.024211 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:37.024174 2573 projected.go:196] Error preparing data for projected volume kube-api-access-69kvw for pod openshift-network-diagnostics/network-check-target-tfbb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:37.024294 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:37.024234 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw podName:0e9a721c-3e04-4772-8554-341c06b38a5d nodeName:}" failed. No retries permitted until 2026-09-10 00:50:53.024219124 +0000 UTC m=+33.315104289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-69kvw" (UniqueName: "kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw") pod "network-check-target-tfbb8" (UID: "0e9a721c-3e04-4772-8554-341c06b38a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:37.209428 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:37.209355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:37.209428 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:37.209404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:37.209624 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:37.209495 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:37.209624 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:37.209613 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:38.209182 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:38.209151 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:38.209637 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:38.209267 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:39.208800 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:39.208760 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:39.208800 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:39.208795 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:39.209027 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:39.208877 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:39.209027 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:39.209004 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:40.210033 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.209880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:40.210291 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:40.210135 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:40.330713 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.330403 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" event={"ID":"ba8abea1-b389-4512-a555-536b8bb3c476","Type":"ContainerStarted","Data":"9a2a04aad44365d9520a1652cebe18d7a30e4bbb9080ec69a48ea9f55e045131"} Sep 10 00:50:40.336586 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.335593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"aa86ba41f9f80d888e7b4004349edc0a2d6f6ff71ccfe553d793ac8990f19242"} Sep 10 00:50:40.343441 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.343389 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" event={"ID":"afb1c523a0c5b188374be40b94f8933b","Type":"ContainerStarted","Data":"0a5cc128df9e7be4edfb0d4945e339bc1de5ffc532543fbf095020feb07de4c4"} Sep 10 00:50:40.347580 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.346737 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fsfjn" podStartSLOduration=1.835132199 podStartE2EDuration="20.346720501s" totalImagesPullingTime="18.511588302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:40.346028688 +0000 UTC m=+20.636913875" watchObservedRunningTime="2026-09-10 00:50:40.346720501 +0000 UTC m=+20.637605690" Sep 10 00:50:40.358230 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.357492 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-km6nq" event={"ID":"1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c","Type":"ContainerStarted","Data":"42115027e1c1f99fe09f6f95cd4cfa98e25d3d2d19f551713170a771494dc32c"} Sep 10 00:50:40.358874 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.358801 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-63.ec2.internal" podStartSLOduration=19.358783161 podStartE2EDuration="19.358783161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:40.358103339 +0000 UTC m=+20.648988529" watchObservedRunningTime="2026-09-10 00:50:40.358783161 +0000 UTC m=+20.649668351" Sep 10 00:50:40.373842 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:40.373786 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-km6nq" podStartSLOduration=1.727351177 podStartE2EDuration="20.373767072s" totalImagesPullingTime="18.646415895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:40.373324678 +0000 UTC m=+20.664209866" watchObservedRunningTime="2026-09-10 00:50:40.373767072 +0000 UTC m=+20.664652263" Sep 10 00:50:41.209443 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.209247 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:41.209587 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.209299 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:41.209587 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:41.209551 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:41.209682 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:41.209594 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:41.361344 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.361309 2573 generic.go:356] "Generic (PLEG): container finished" podID="15207f7ec76bc3ba21ea601cf90f7b11" containerID="2d9ba38795f9c549be09b5772a1e03c8bd0d8568feef9df76cc62f9f2994a605" exitCode=0 Sep 10 00:50:41.362201 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.361394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" event={"ID":"15207f7ec76bc3ba21ea601cf90f7b11","Type":"ContainerDied","Data":"2d9ba38795f9c549be09b5772a1e03c8bd0d8568feef9df76cc62f9f2994a605"} Sep 10 00:50:41.363064 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.363028 2573 generic.go:356] "Generic (PLEG): container finished" podID="3620729c-b4c0-4373-8f03-952db98d5586" containerID="175a17acda843b5724e26cb5db2343e4cfd32f59329ba37acc055996a14f8066" exitCode=0 Sep 10 00:50:41.363130 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.363078 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerDied","Data":"175a17acda843b5724e26cb5db2343e4cfd32f59329ba37acc055996a14f8066"} Sep 10 00:50:41.366646 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.366620 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 00:50:41.367266 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.367245 2573 generic.go:356] "Generic (PLEG): container finished" podID="293375e1-ca1f-4dd0-9b72-c3f53239616e" containerID="74a7baf1036e04e83290d2d01e15ee9454339884f35a63d8bc1294074a7c0898" exitCode=1 Sep 10 00:50:41.367348 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.367317 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerDied","Data":"74a7baf1036e04e83290d2d01e15ee9454339884f35a63d8bc1294074a7c0898"} Sep 10 00:50:41.367419 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.367402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"0b0c837b3dd79b65cfed0062e97ce83c8009f28ecb385a041119ab15eb7ee065"} Sep 10 00:50:41.367478 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.367460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"ee57bf6428ed9a7621589aa510f70a899f0c61d833e4ad0e7c573aa364e3e6d1"} Sep 10 00:50:41.367572 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.367554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"2ca08665a6f2f92dff40a7abad93fc1338fb7f07cf8104972634c50fc60a0f95"} Sep 10 00:50:41.367634 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.367612 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"cd86021d8dce6c44f970bd35835b7389bcbb9b450497921a2c1f105ee86dadb8"} Sep 10 00:50:41.368970 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.368948 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6l5k" event={"ID":"6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d","Type":"ContainerStarted","Data":"1ea9ae402f815031aa0d0b1ae2f2012f2150d2714122022c0473deb10239e45e"} Sep 10 00:50:41.373590 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.373570 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" event={"ID":"623d66b0-4f95-47e4-acd9-3d5e4e717e36","Type":"ContainerStarted","Data":"454135fdccbf520cd24f348e5b20c63d4d33eb0d55e4ff602449ebd6ff864651"} Sep 10 00:50:41.375160 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.375134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfsrs" event={"ID":"b0461365-5833-4fa2-9f41-61e18362440e","Type":"ContainerStarted","Data":"24afa5881fc8ddec0736835cdde08c3d668c3f7331ce4d782b31b76a030f848d"} Sep 10 00:50:41.376788 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.376767 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z6256" event={"ID":"a2937f26-1d68-47c9-92d4-979f1ed3a5be","Type":"ContainerStarted","Data":"939b9329f86ca6add0212682256562c931247eefdde37e2181bd68b389184709"} Sep 10 00:50:41.406310 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.406268 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j6l5k" podStartSLOduration=3.043425796 podStartE2EDuration="21.406251287s" totalImagesPullingTime="18.362825491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:41.387906064 +0000 UTC m=+21.678791251" watchObservedRunningTime="2026-09-10 00:50:41.406251287 +0000 UTC m=+21.697136466" Sep 10 00:50:41.418175 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.418137 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kfsrs" podStartSLOduration=6.896244288 podStartE2EDuration="21.41811955s" totalImagesPullingTime="14.521875262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:41.417682593 +0000 UTC m=+21.708567784" watchObservedRunningTime="2026-09-10 00:50:41.41811955 +0000 UTC m=+21.709004739" Sep 10 00:50:41.430458 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.430421 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z6256" podStartSLOduration=2.807841191 podStartE2EDuration="21.430409718s" totalImagesPullingTime="18.622568527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:41.429917179 +0000 UTC m=+21.720802367" watchObservedRunningTime="2026-09-10 00:50:41.430409718 +0000 UTC m=+21.721294905" Sep 10 00:50:41.516140 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.515974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:41.591541 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.591518 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:41.627304 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:41.627238 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 00:50:42.151026 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.150884 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T00:50:41.627254135Z","UUID":"197e1ac0-b40e-41e5-a0bd-e6666ecbca4a","Handler":null,"Name":"","Endpoint":""} Sep 10 00:50:42.152516 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.152496 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 00:50:42.152651 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.152528 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 00:50:42.208983 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.208954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:42.209162 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:42.209102 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:42.382569 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.382526 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" event={"ID":"623d66b0-4f95-47e4-acd9-3d5e4e717e36","Type":"ContainerStarted","Data":"6bef47db6e3f64c267566bcf8898ade11f3ae55d8584627fe1cc382e6622c421"} Sep 10 00:50:42.385285 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.385256 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" event={"ID":"15207f7ec76bc3ba21ea601cf90f7b11","Type":"ContainerStarted","Data":"a917d6e461dadbc4cb67afdde4dded3827be40e2d5f456a3fdbf97a23f897052"} Sep 10 00:50:42.387016 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.386986 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wmtsr" event={"ID":"f47e64a1-02c8-4dd6-953d-3ec5ede0f927","Type":"ContainerStarted","Data":"d01f7274dafd35d5e0dcc571f4e838e2e0f89957d2a9c44f11d8319b215c2632"} Sep 10 00:50:42.429905 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.429813 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-63.ec2.internal" podStartSLOduration=21.429798233 podStartE2EDuration="21.429798233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:42.407854183 +0000 UTC m=+22.698739373" watchObservedRunningTime="2026-09-10 00:50:42.429798233 +0000 UTC m=+22.720683398" Sep 10 00:50:42.430925 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.430869 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wmtsr" podStartSLOduration=4.103716689 podStartE2EDuration="22.430847851s" totalImagesPullingTime="18.327131162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:42.429772689 +0000 UTC m=+22.720657878" watchObservedRunningTime="2026-09-10 00:50:42.430847851 +0000 UTC m=+22.721733034" Sep 10 00:50:42.545485 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.545451 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:42.646482 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:42.646447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:43.209164 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:43.209132 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:43.209371 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:43.209168 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:43.209371 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:43.209284 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:43.209466 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:43.209388 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:43.395953 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:43.395933 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 00:50:43.396435 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:43.396411 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"34f3a92a59820da54add8464e5e5a0c0cdda0c923abfb143eb4d176a91049bff"} Sep 10 00:50:44.209062 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:44.209030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:44.209338 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:44.209179 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:44.400735 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:44.400699 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" event={"ID":"623d66b0-4f95-47e4-acd9-3d5e4e717e36","Type":"ContainerStarted","Data":"fe5ed704e412fa0db1f32c24bc82ce31b8c0efff9947f54a45a6d90c5a43d71e"} Sep 10 00:50:44.421387 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:44.421340 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qn7l" podStartSLOduration=3.5108323500000003 podStartE2EDuration="24.421311059s" totalImagesPullingTime="20.910478709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:44.421161861 +0000 UTC m=+24.712047049" watchObservedRunningTime="2026-09-10 00:50:44.421311059 +0000 UTC m=+24.712196248" Sep 10 00:50:44.532222 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:44.532127 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:44.633414 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:44.633375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:44.890091 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:44.890063 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:44.891288 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:44.891266 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:45.209374 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.209305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:45.209511 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:45.209396 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:45.209511 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.209449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:45.209591 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:45.209536 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:45.407455 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.407333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 00:50:45.407880 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.407793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"7cac85dc7b43857d3600be0c28cbd4ccd78c91ca2b64f2d71efef166bb36b767"} Sep 10 00:50:45.408376 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.408301 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:45.408567 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.408551 2573 scope.go:117] "RemoveContainer" containerID="74a7baf1036e04e83290d2d01e15ee9454339884f35a63d8bc1294074a7c0898" Sep 10 00:50:45.408626 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.408573 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kfsrs" Sep 10 00:50:45.491425 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:45.491402 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:46.059179 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.059148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:46.208783 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.208750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:46.208936 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:46.208850 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:46.411639 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.411609 2573 generic.go:356] "Generic (PLEG): container finished" podID="3620729c-b4c0-4373-8f03-952db98d5586" containerID="ec0b3bf64bd525321254448045d66723d35077dcb53e4a394fb1a6b00e6cedc3" exitCode=0 Sep 10 00:50:46.412183 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.411692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerDied","Data":"ec0b3bf64bd525321254448045d66723d35077dcb53e4a394fb1a6b00e6cedc3"} Sep 10 00:50:46.415663 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.415646 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 00:50:46.416023 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.415989 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" event={"ID":"293375e1-ca1f-4dd0-9b72-c3f53239616e","Type":"ContainerStarted","Data":"4749711a3d0c6fec0eadee1c75023d05333577b4af3b36a8f11c416f9a41a938"} Sep 10 00:50:46.416180 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.416162 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:46.416257 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.416249 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:46.416311 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.416295 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:46.431092 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.431068 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:46.434581 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.434550 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:50:46.455808 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:46.455768 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" podStartSLOduration=7.735513436 podStartE2EDuration="26.455755166s" totalImagesPullingTime="18.72024173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:46.45544566 +0000 UTC m=+26.746330849" watchObservedRunningTime="2026-09-10 00:50:46.455755166 +0000 UTC m=+26.746640353" Sep 10 00:50:47.208830 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.208715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:47.208988 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:47.208839 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:47.208988 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.208940 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:47.209094 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:47.209035 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:47.274160 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.274129 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q5bvn"] Sep 10 00:50:47.274301 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.274261 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:47.274385 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:47.274362 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:47.276941 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.276909 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zpzbn"] Sep 10 00:50:47.288185 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.288120 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfbb8"] Sep 10 00:50:47.422803 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.422648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:47.423432 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:47.422863 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:47.423432 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.422695 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerStarted","Data":"b17c96d1a1b6bbaca707ce00699dce699cfc39c762c6ef7b7a2ec4cda4e24553"} Sep 10 00:50:47.423432 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:47.423079 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:47.423432 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:47.423179 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:48.426591 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:48.426562 2573 generic.go:356] "Generic (PLEG): container finished" podID="3620729c-b4c0-4373-8f03-952db98d5586" containerID="b17c96d1a1b6bbaca707ce00699dce699cfc39c762c6ef7b7a2ec4cda4e24553" exitCode=0 Sep 10 00:50:48.426991 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:48.426638 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerDied","Data":"b17c96d1a1b6bbaca707ce00699dce699cfc39c762c6ef7b7a2ec4cda4e24553"} Sep 10 00:50:49.020722 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:49.019266 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:49.209338 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:49.209305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:49.209338 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:49.209333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:49.209550 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:49.209321 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:49.209550 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:49.209435 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:49.209550 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:49.209517 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:49.209696 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:49.209605 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:49.431896 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:49.431863 2573 generic.go:356] "Generic (PLEG): container finished" podID="3620729c-b4c0-4373-8f03-952db98d5586" containerID="0abfafa33ed692abfd29eb76184c6e03a5e1b5d0be564359dcb797aa25ce34bb" exitCode=0 Sep 10 00:50:49.432264 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:49.431930 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerDied","Data":"0abfafa33ed692abfd29eb76184c6e03a5e1b5d0be564359dcb797aa25ce34bb"} Sep 10 00:50:51.209077 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:51.209028 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:51.209735 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:51.209095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:51.209735 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:51.209175 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpzbn" podUID="41146b11-bf1d-412b-85cf-83cd0b4fc7cf" Sep 10 00:50:51.209735 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:51.209549 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:51.209735 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:51.209641 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q5bvn" podUID="2552efdc-0ea2-41f8-9750-6b41238557d4" Sep 10 00:50:51.209735 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:51.209719 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfbb8" podUID="0e9a721c-3e04-4772-8554-341c06b38a5d" Sep 10 00:50:51.982343 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:51.982312 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:52.051807 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:52.051774 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:52.134310 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:52.134280 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:52.188644 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:52.188585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:52.937670 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:52.937645 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:52.937974 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:52.937699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:52.937974 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:52.937788 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:52.937974 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:52.937795 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:52.937974 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:52.937837 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs podName:41146b11-bf1d-412b-85cf-83cd0b4fc7cf nodeName:}" failed. No retries permitted until 2026-09-10 00:51:24.937823419 +0000 UTC m=+65.228708599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs") pod "network-metrics-daemon-zpzbn" (UID: "41146b11-bf1d-412b-85cf-83cd0b4fc7cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:52.937974 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:52.937850 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret podName:2552efdc-0ea2-41f8-9750-6b41238557d4 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:24.937844346 +0000 UTC m=+65.228729512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret") pod "global-pull-secret-syncer-q5bvn" (UID: "2552efdc-0ea2-41f8-9750-6b41238557d4") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:52.989474 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:52.989377 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-63.ec2.internal" event="NodeReady" Sep 10 00:50:52.989585 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:52.989491 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 00:50:53.032791 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.032764 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l5hsw"] Sep 10 00:50:53.038537 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.038509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:53.038729 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.038663 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:53.038729 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.038681 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:53.038729 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.038691 2573 projected.go:196] Error preparing data for projected volume kube-api-access-69kvw for pod openshift-network-diagnostics/network-check-target-tfbb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:53.038897 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.038736 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw podName:0e9a721c-3e04-4772-8554-341c06b38a5d nodeName:}" failed. No retries permitted until 2026-09-10 00:51:25.038723303 +0000 UTC m=+65.329608473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-69kvw" (UniqueName: "kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw") pod "network-check-target-tfbb8" (UID: "0e9a721c-3e04-4772-8554-341c06b38a5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:53.058577 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.058551 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gchmg"] Sep 10 00:50:53.058720 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.058707 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.062528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.061459 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fhnl9\"" Sep 10 00:50:53.062528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.061708 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 00:50:53.062698 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.062676 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 00:50:53.072609 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.072587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5hsw"] Sep 10 00:50:53.072707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.072626 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gchmg"] Sep 10 00:50:53.072707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.072680 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.077791 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.077774 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 00:50:53.078357 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.078339 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j4fzs\"" Sep 10 00:50:53.078583 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.078568 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 00:50:53.078663 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.078589 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 00:50:53.139392 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.139368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlfqb\" (UniqueName: \"kubernetes.io/projected/82991ee5-f130-4fab-8fd0-d6b59755e2f2-kube-api-access-tlfqb\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.139527 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.139416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82991ee5-f130-4fab-8fd0-d6b59755e2f2-tmp-dir\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.139527 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.139441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.139527 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.139500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82991ee5-f130-4fab-8fd0-d6b59755e2f2-config-volume\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.190154 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.190124 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:53.209165 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.209142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:50:53.209165 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.209142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:50:53.209358 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.209144 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:50:53.212542 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.212519 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 00:50:53.212542 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.212532 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 00:50:53.212542 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.212524 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 00:50:53.212758 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.212707 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rcm88\"" Sep 10 00:50:53.212981 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.212962 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 00:50:53.212981 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.212972 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mhb4c\"" Sep 10 00:50:53.240380 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfqb\" (UniqueName: \"kubernetes.io/projected/82991ee5-f130-4fab-8fd0-d6b59755e2f2-kube-api-access-tlfqb\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.240380 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19aa8118-a6a3-49e8-b252-d02cbea109dd-cert\") pod \"ingress-canary-gchmg\" (UID: \"19aa8118-a6a3-49e8-b252-d02cbea109dd\") " pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.240528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82991ee5-f130-4fab-8fd0-d6b59755e2f2-tmp-dir\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.240528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.240528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsr5g\" (UniqueName: \"kubernetes.io/projected/19aa8118-a6a3-49e8-b252-d02cbea109dd-kube-api-access-lsr5g\") pod \"ingress-canary-gchmg\" (UID: \"19aa8118-a6a3-49e8-b252-d02cbea109dd\") " pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.240622 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.240556 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:53.240622 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82991ee5-f130-4fab-8fd0-d6b59755e2f2-config-volume\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.240622 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.240614 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls podName:82991ee5-f130-4fab-8fd0-d6b59755e2f2 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:53.740595899 +0000 UTC m=+34.031481080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls") pod "dns-default-l5hsw" (UID: "82991ee5-f130-4fab-8fd0-d6b59755e2f2") : secret "dns-default-metrics-tls" not found Sep 10 00:50:53.240786 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240768 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82991ee5-f130-4fab-8fd0-d6b59755e2f2-tmp-dir\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.241001 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.240986 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82991ee5-f130-4fab-8fd0-d6b59755e2f2-config-volume\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.251640 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.251620 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlfqb\" (UniqueName: \"kubernetes.io/projected/82991ee5-f130-4fab-8fd0-d6b59755e2f2-kube-api-access-tlfqb\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.252947 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.252921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:53.341886 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.341855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsr5g\" (UniqueName: \"kubernetes.io/projected/19aa8118-a6a3-49e8-b252-d02cbea109dd-kube-api-access-lsr5g\") pod \"ingress-canary-gchmg\" (UID: \"19aa8118-a6a3-49e8-b252-d02cbea109dd\") " pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.342077 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.341959 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19aa8118-a6a3-49e8-b252-d02cbea109dd-cert\") pod \"ingress-canary-gchmg\" (UID: \"19aa8118-a6a3-49e8-b252-d02cbea109dd\") " pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.345311 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.345287 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19aa8118-a6a3-49e8-b252-d02cbea109dd-cert\") pod \"ingress-canary-gchmg\" (UID: \"19aa8118-a6a3-49e8-b252-d02cbea109dd\") " pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.351518 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.351491 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsr5g\" (UniqueName: \"kubernetes.io/projected/19aa8118-a6a3-49e8-b252-d02cbea109dd-kube-api-access-lsr5g\") pod \"ingress-canary-gchmg\" (UID: \"19aa8118-a6a3-49e8-b252-d02cbea109dd\") " pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.380534 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.380508 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gchmg" Sep 10 00:50:53.702131 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.702102 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gchmg"] Sep 10 00:50:53.705770 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:53.705742 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19aa8118_a6a3_49e8_b252_d02cbea109dd.slice/crio-620e06b69d39e0c888e4a93688df3ecda82d9eed723b3295c77d3f2f96d76261 WatchSource:0}: Error finding container 620e06b69d39e0c888e4a93688df3ecda82d9eed723b3295c77d3f2f96d76261: Status 404 returned error can't find the container with id 620e06b69d39e0c888e4a93688df3ecda82d9eed723b3295c77d3f2f96d76261 Sep 10 00:50:53.744196 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:53.744167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:53.744312 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.744283 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:53.744372 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:53.744347 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls podName:82991ee5-f130-4fab-8fd0-d6b59755e2f2 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:54.744328079 +0000 UTC m=+35.035213245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls") pod "dns-default-l5hsw" (UID: "82991ee5-f130-4fab-8fd0-d6b59755e2f2") : secret "dns-default-metrics-tls" not found Sep 10 00:50:54.447111 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:54.447073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gchmg" event={"ID":"19aa8118-a6a3-49e8-b252-d02cbea109dd","Type":"ContainerStarted","Data":"620e06b69d39e0c888e4a93688df3ecda82d9eed723b3295c77d3f2f96d76261"} Sep 10 00:50:54.752271 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:54.752188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:54.752443 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:54.752342 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:54.752443 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:54.752403 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls podName:82991ee5-f130-4fab-8fd0-d6b59755e2f2 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:56.752388528 +0000 UTC m=+37.043273693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls") pod "dns-default-l5hsw" (UID: "82991ee5-f130-4fab-8fd0-d6b59755e2f2") : secret "dns-default-metrics-tls" not found Sep 10 00:50:54.971589 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:54.971560 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:55.073726 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:55.073670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:56.454393 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:56.454361 2573 generic.go:356] "Generic (PLEG): container finished" podID="3620729c-b4c0-4373-8f03-952db98d5586" containerID="4d51a5f94f9b25455fc6b010a19fee27e3a5486c91afd3194b419e3177f2e518" exitCode=0 Sep 10 00:50:56.454979 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:56.454420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerDied","Data":"4d51a5f94f9b25455fc6b010a19fee27e3a5486c91afd3194b419e3177f2e518"} Sep 10 00:50:56.771531 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:56.771493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:50:56.771680 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:56.771635 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:56.771721 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:56.771695 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls podName:82991ee5-f130-4fab-8fd0-d6b59755e2f2 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:00.771678103 +0000 UTC m=+41.062563281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls") pod "dns-default-l5hsw" (UID: "82991ee5-f130-4fab-8fd0-d6b59755e2f2") : secret "dns-default-metrics-tls" not found Sep 10 00:50:57.418121 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:57.418093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:57.460110 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:57.460081 2573 generic.go:356] "Generic (PLEG): container finished" podID="3620729c-b4c0-4373-8f03-952db98d5586" containerID="4cad682920c513b8fc1c2f8b9b4d858f7b4e96b60e312de458a90ecd2527c6fd" exitCode=0 Sep 10 00:50:57.460420 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:57.460124 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerDied","Data":"4cad682920c513b8fc1c2f8b9b4d858f7b4e96b60e312de458a90ecd2527c6fd"} Sep 10 00:50:57.520280 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:57.520244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:58.467131 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.466954 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" event={"ID":"3620729c-b4c0-4373-8f03-952db98d5586","Type":"ContainerStarted","Data":"b6fa237228f7c39a5e68bade61ac5eaecf10470383c9b5eef38988bfa1776ec0"} Sep 10 00:50:58.468522 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.468458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gchmg" event={"ID":"19aa8118-a6a3-49e8-b252-d02cbea109dd","Type":"ContainerStarted","Data":"bd1fb2fb6bcbe3ed2257a25c40ee040a68a5462ba3da9156091b63b073c7d844"} Sep 10 00:50:58.491292 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.491238 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xbx6s" podStartSLOduration=8.232249388 podStartE2EDuration="38.49122477s" totalImagesPullingTime="30.258975382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:58.48953781 +0000 UTC m=+38.780422996" watchObservedRunningTime="2026-09-10 00:50:58.49122477 +0000 UTC m=+38.782109956" Sep 10 00:50:58.506785 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.506734 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gchmg" podStartSLOduration=1.808603707 podStartE2EDuration="5.50671843s" totalImagesPullingTime="3.698114723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:58.505967341 +0000 UTC m=+38.796852528" watchObservedRunningTime="2026-09-10 00:50:58.50671843 +0000 UTC m=+38.797603616" Sep 10 00:50:58.555666 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.555627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:58.660770 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.660737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:58.717018 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.716980 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:58.979670 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.979640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:58.996319 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:58.996291 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qcxbl"] Sep 10 00:50:59.031128 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.031097 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcxbl"] Sep 10 00:50:59.031251 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.031203 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.033847 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.033823 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 00:50:59.033847 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.033835 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 00:50:59.034011 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.033861 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 00:50:59.034011 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.033838 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rgq8h\"" Sep 10 00:50:59.034173 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.034159 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 00:50:59.043236 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.043217 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:59.189856 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.189816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.189988 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.189866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.189988 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.189937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6576704f-06e3-4b94-8081-9c09fe114efb-data-volume\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.189988 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.189966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6576704f-06e3-4b94-8081-9c09fe114efb-crio-socket\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.189988 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.189986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl8pv\" (UniqueName: \"kubernetes.io/projected/6576704f-06e3-4b94-8081-9c09fe114efb-kube-api-access-kl8pv\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.291197 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.291114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.291197 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.291170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.291403 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.291236 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:50:59.291403 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.291282 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.291403 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.291298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6576704f-06e3-4b94-8081-9c09fe114efb-data-volume\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.291403 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.291315 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.791300385 +0000 UTC m=+40.082185550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : configmap "kube-rbac-proxy" not found Sep 10 00:50:59.291403 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.291339 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.791324161 +0000 UTC m=+40.082209339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.291403 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.291366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6576704f-06e3-4b94-8081-9c09fe114efb-crio-socket\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.291403 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.291394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl8pv\" (UniqueName: \"kubernetes.io/projected/6576704f-06e3-4b94-8081-9c09fe114efb-kube-api-access-kl8pv\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.291721 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.291572 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6576704f-06e3-4b94-8081-9c09fe114efb-crio-socket\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.291721 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.291588 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6576704f-06e3-4b94-8081-9c09fe114efb-data-volume\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.303894 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.303871 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl8pv\" (UniqueName: \"kubernetes.io/projected/6576704f-06e3-4b94-8081-9c09fe114efb-kube-api-access-kl8pv\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.334029 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.334003 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:59.363947 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.363919 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p"] Sep 10 00:50:59.388373 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.388348 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p"] Sep 10 00:50:59.388477 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.388434 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" Sep 10 00:50:59.390943 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.390926 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kn27b\"" Sep 10 00:50:59.391218 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.391196 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:59.391261 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.391218 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 10 00:50:59.406455 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.406434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:59.459913 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.459878 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:59.493254 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.493225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtlk\" (UniqueName: \"kubernetes.io/projected/0311f807-7e59-493f-a2fd-a84618615a20-kube-api-access-nbtlk\") pod \"migrator-fdbb8fdff-kfd5p\" (UID: \"0311f807-7e59-493f-a2fd-a84618615a20\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" Sep 10 00:50:59.593925 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.593885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtlk\" (UniqueName: \"kubernetes.io/projected/0311f807-7e59-493f-a2fd-a84618615a20-kube-api-access-nbtlk\") pod \"migrator-fdbb8fdff-kfd5p\" (UID: \"0311f807-7e59-493f-a2fd-a84618615a20\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" Sep 10 00:50:59.601597 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.601564 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtlk\" (UniqueName: \"kubernetes.io/projected/0311f807-7e59-493f-a2fd-a84618615a20-kube-api-access-nbtlk\") pod \"migrator-fdbb8fdff-kfd5p\" (UID: \"0311f807-7e59-493f-a2fd-a84618615a20\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" Sep 10 00:50:59.656672 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.656649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:59.696407 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.696389 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" Sep 10 00:50:59.754990 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.754947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:50:59.795229 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.795165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.795229 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.795215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:50:59.795421 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.795285 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:50:59.795421 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.795365 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:00.795343746 +0000 UTC m=+41.086228928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : configmap "kube-rbac-proxy" not found Sep 10 00:50:59.795421 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.795380 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.795526 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:50:59.795427 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:00.795416578 +0000 UTC m=+41.086301747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.981910 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:50:59.981843 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p"] Sep 10 00:50:59.986153 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:50:59.986129 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0311f807_7e59_493f_a2fd_a84618615a20.slice/crio-f78890e82cd235a546478b45aecad0565b5d6cd13ad77b63bc7b12160a6380ca WatchSource:0}: Error finding container f78890e82cd235a546478b45aecad0565b5d6cd13ad77b63bc7b12160a6380ca: Status 404 returned error can't find the container with id f78890e82cd235a546478b45aecad0565b5d6cd13ad77b63bc7b12160a6380ca Sep 10 00:51:00.473323 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:00.473288 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" event={"ID":"0311f807-7e59-493f-a2fd-a84618615a20","Type":"ContainerStarted","Data":"f78890e82cd235a546478b45aecad0565b5d6cd13ad77b63bc7b12160a6380ca"} Sep 10 00:51:00.805195 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:00.805104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:51:00.805195 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:00.805165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:00.805647 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:00.805219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:00.805647 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:00.805269 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:51:00.805647 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:00.805295 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:51:00.805647 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:00.805350 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:00.805647 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:00.805384 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls podName:82991ee5-f130-4fab-8fd0-d6b59755e2f2 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:08.805363582 +0000 UTC m=+49.096248763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls") pod "dns-default-l5hsw" (UID: "82991ee5-f130-4fab-8fd0-d6b59755e2f2") : secret "dns-default-metrics-tls" not found Sep 10 00:51:00.805647 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:00.805405 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:02.805395548 +0000 UTC m=+43.096280721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:00.805647 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:00.805422 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:02.805413269 +0000 UTC m=+43.096298439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : configmap "kube-rbac-proxy" not found Sep 10 00:51:00.946966 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:00.946939 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6l5k_6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d/dns-node-resolver/0.log" Sep 10 00:51:01.253726 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.253686 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l6rwn"] Sep 10 00:51:01.271955 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.271932 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l6rwn"] Sep 10 00:51:01.272096 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.272040 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.275001 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.274969 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 00:51:01.275145 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.275008 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 00:51:01.275145 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.275042 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 00:51:01.276000 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.275986 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 00:51:01.276065 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.276019 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-92cmf\"" Sep 10 00:51:01.291681 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.291655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:01.409557 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.409520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81538e4a-5554-4532-8ba5-c5141a9187f9-signing-cabundle\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.409557 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.409559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwg9l\" (UniqueName: \"kubernetes.io/projected/81538e4a-5554-4532-8ba5-c5141a9187f9-kube-api-access-gwg9l\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.409786 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.409642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81538e4a-5554-4532-8ba5-c5141a9187f9-signing-key\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.510704 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.510630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81538e4a-5554-4532-8ba5-c5141a9187f9-signing-key\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.510849 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.510806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81538e4a-5554-4532-8ba5-c5141a9187f9-signing-cabundle\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.510849 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.510843 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwg9l\" (UniqueName: \"kubernetes.io/projected/81538e4a-5554-4532-8ba5-c5141a9187f9-kube-api-access-gwg9l\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.511457 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.511437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/81538e4a-5554-4532-8ba5-c5141a9187f9-signing-cabundle\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.512965 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.512948 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/81538e4a-5554-4532-8ba5-c5141a9187f9-signing-key\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.518759 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.518740 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwg9l\" (UniqueName: \"kubernetes.io/projected/81538e4a-5554-4532-8ba5-c5141a9187f9-kube-api-access-gwg9l\") pod \"service-ca-75d99c484-l6rwn\" (UID: \"81538e4a-5554-4532-8ba5-c5141a9187f9\") " pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.580712 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.580690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-l6rwn" Sep 10 00:51:01.863758 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:01.863608 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l6rwn"] Sep 10 00:51:01.866005 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:01.865983 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81538e4a_5554_4532_8ba5_c5141a9187f9.slice/crio-302226c2299b925df8f3363648fc2d6960a97c4636be45b53e5a3c1343c10d6a WatchSource:0}: Error finding container 302226c2299b925df8f3363648fc2d6960a97c4636be45b53e5a3c1343c10d6a: Status 404 returned error can't find the container with id 302226c2299b925df8f3363648fc2d6960a97c4636be45b53e5a3c1343c10d6a Sep 10 00:51:02.148728 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.148699 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z6256_a2937f26-1d68-47c9-92d4-979f1ed3a5be/node-ca/0.log" Sep 10 00:51:02.172846 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.172819 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:02.480923 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.480780 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" event={"ID":"0311f807-7e59-493f-a2fd-a84618615a20","Type":"ContainerStarted","Data":"f2e71d2d5afbb4c5aed77f1ea8d02b5066887846d4a2fb800235c61aa8bd62b9"} Sep 10 00:51:02.480923 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.480904 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" event={"ID":"0311f807-7e59-493f-a2fd-a84618615a20","Type":"ContainerStarted","Data":"af28a020b6398a1f744f53a56b0e684132060ad65c74cb96cba7abccde900a80"} Sep 10 00:51:02.482794 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.482521 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-l6rwn" event={"ID":"81538e4a-5554-4532-8ba5-c5141a9187f9","Type":"ContainerStarted","Data":"302226c2299b925df8f3363648fc2d6960a97c4636be45b53e5a3c1343c10d6a"} Sep 10 00:51:02.498865 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.498816 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kfd5p" podStartSLOduration=1.918535254 podStartE2EDuration="3.49880094s" totalImagesPullingTime="1.580265686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:02.497918146 +0000 UTC m=+42.788803334" watchObservedRunningTime="2026-09-10 00:51:02.49880094 +0000 UTC m=+42.789686126" Sep 10 00:51:02.747366 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.747289 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gchmg_19aa8118-a6a3-49e8-b252-d02cbea109dd/serve-healthcheck-canary/0.log" Sep 10 00:51:02.824788 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.824740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:02.824970 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:02.824821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:02.824970 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:02.824844 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:51:02.824970 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:02.824915 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:06.82489531 +0000 UTC m=+47.115780475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : configmap "kube-rbac-proxy" not found Sep 10 00:51:02.825164 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:02.824980 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:02.825164 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:02.825044 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:06.825026556 +0000 UTC m=+47.115911740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:04.489718 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:04.489687 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-l6rwn" event={"ID":"81538e4a-5554-4532-8ba5-c5141a9187f9","Type":"ContainerStarted","Data":"2d4cc03b0049ed3388c480ade00e914a8968eec004d2881736036defcad293cb"} Sep 10 00:51:04.507491 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:04.507443 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-l6rwn" podStartSLOduration=1.083251053 podStartE2EDuration="3.507426103s" totalImagesPullingTime="2.42417505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:04.506656935 +0000 UTC m=+44.797542122" watchObservedRunningTime="2026-09-10 00:51:04.507426103 +0000 UTC m=+44.798311289" Sep 10 00:51:04.893103 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:04.893069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:05.756559 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:05.756522 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:05.859298 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:05.859261 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:05.957600 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:05.957562 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:06.020536 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:06.020429 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:06.272826 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:06.272737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:06.406231 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:06.406200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:06.521593 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:06.521559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:06.855922 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:06.855893 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:06.856366 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:06.855964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:06.856366 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:06.856023 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:51:06.856366 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:06.856082 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:06.856366 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:06.856091 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:14.856078391 +0000 UTC m=+55.146963556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : configmap "kube-rbac-proxy" not found Sep 10 00:51:06.856366 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:06.856156 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:14.856140205 +0000 UTC m=+55.147025375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:07.464406 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:07.464377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:07.663292 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:07.663261 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:07.860328 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:07.860298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:08.175367 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:08.175293 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:08.260313 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:08.260279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:08.869310 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:08.869274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:51:08.871439 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:08.871420 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82991ee5-f130-4fab-8fd0-d6b59755e2f2-metrics-tls\") pod \"dns-default-l5hsw\" (UID: \"82991ee5-f130-4fab-8fd0-d6b59755e2f2\") " pod="openshift-dns/dns-default-l5hsw" Sep 10 00:51:08.970661 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:08.970632 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5hsw" Sep 10 00:51:09.066395 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.066364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:09.266645 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.266548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:09.269950 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.269928 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5hsw"] Sep 10 00:51:09.273478 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:09.273454 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82991ee5_f130_4fab_8fd0_d6b59755e2f2.slice/crio-5aabc27b51630067866f3706f5d28d6feb6766cf71a6a9934b840cd42d1b3468 WatchSource:0}: Error finding container 5aabc27b51630067866f3706f5d28d6feb6766cf71a6a9934b840cd42d1b3468: Status 404 returned error can't find the container with id 5aabc27b51630067866f3706f5d28d6feb6766cf71a6a9934b840cd42d1b3468 Sep 10 00:51:09.459268 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.459241 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:09.504213 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.504178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5hsw" event={"ID":"82991ee5-f130-4fab-8fd0-d6b59755e2f2","Type":"ContainerStarted","Data":"5aabc27b51630067866f3706f5d28d6feb6766cf71a6a9934b840cd42d1b3468"} Sep 10 00:51:09.650664 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.650630 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:09.703916 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.703892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:09.868143 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:09.868101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:10.280728 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:10.280688 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:10.354898 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:10.354864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:11.067440 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:11.067392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:11.265031 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:11.264997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:11.661638 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:11.661613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:11.856721 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:11.856689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:11.962273 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:11.962249 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:12.160616 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.160532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:12.267598 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.267563 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:12.513136 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.513061 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5hsw" event={"ID":"82991ee5-f130-4fab-8fd0-d6b59755e2f2","Type":"ContainerStarted","Data":"c2a07c71837c3df0c163abe8f9b05b0bbf94f6250bf3013c72e2b4f759caffb2"} Sep 10 00:51:12.513136 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.513114 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5hsw" event={"ID":"82991ee5-f130-4fab-8fd0-d6b59755e2f2","Type":"ContainerStarted","Data":"4598f339acccac069c5f7ffb9f1933dd6a60ace71530bf9652d3d39cbbe873ad"} Sep 10 00:51:12.513435 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.513201 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l5hsw" Sep 10 00:51:12.528972 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.528927 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l5hsw" podStartSLOduration=17.30189798 podStartE2EDuration="19.528913862s" totalImagesPullingTime="2.227015882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:12.528486438 +0000 UTC m=+52.819371625" watchObservedRunningTime="2026-09-10 00:51:12.528913862 +0000 UTC m=+52.819799042" Sep 10 00:51:12.894884 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.894851 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:12.951020 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:12.950991 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:13.057193 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:13.057163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:13.261616 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:13.261537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:13.659549 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:13.659517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:13.858612 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:13.858579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:14.468294 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:14.468265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:14.667480 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:14.667446 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:14.911686 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:14.911654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:14.911883 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:14.911707 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:14.911883 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:14.911843 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:14.911998 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:51:14.911919 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls podName:6576704f-06e3-4b94-8081-9c09fe114efb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:30.911901831 +0000 UTC m=+71.202787001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcxbl" (UID: "6576704f-06e3-4b94-8081-9c09fe114efb") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:14.912176 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:14.912157 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6576704f-06e3-4b94-8081-9c09fe114efb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:15.060762 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:15.060727 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:15.859294 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:15.859263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:16.059925 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:16.059894 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:16.256161 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:16.256079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:16.462138 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:16.462106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:16.952649 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:16.952615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:17.071990 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:17.071960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:17.241210 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:17.241143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:17.621839 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:17.621810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:17.676093 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:17.676068 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:18.031732 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:18.031664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:18.436780 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:18.436752 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5fjt" Sep 10 00:51:18.750373 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:18.750293 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:19.391379 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:19.391343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:19.492741 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:19.492707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:19.634485 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:19.634454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:19.688208 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:19.688144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:22.519991 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:22.519958 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l5hsw" Sep 10 00:51:24.780528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.780495 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f"] Sep 10 00:51:24.783172 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.783154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:24.784635 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.784613 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg"] Sep 10 00:51:24.786142 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.786122 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 00:51:24.786321 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.786305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.787257 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.787239 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 00:51:24.787349 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.787290 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 00:51:24.787515 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.787497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 00:51:24.787703 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.787691 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-f8499\"" Sep 10 00:51:24.788923 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.788905 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 10 00:51:24.789187 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.789168 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 10 00:51:24.789384 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.789367 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 10 00:51:24.789468 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.789451 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 10 00:51:24.797631 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.797611 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f"] Sep 10 00:51:24.803508 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.803482 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg"] Sep 10 00:51:24.883950 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.883914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcbe8523-8abf-4c20-8627-31c6e3e6939a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7659d9d-ft85f\" (UID: \"bcbe8523-8abf-4c20-8627-31c6e3e6939a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:24.884129 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.883984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7efbb39-f148-408a-88e3-ad3273be1630-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.884129 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.884070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.884129 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.884105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-ca\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.884129 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.884122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwpxd\" (UniqueName: \"kubernetes.io/projected/e7efbb39-f148-408a-88e3-ad3273be1630-kube-api-access-pwpxd\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.884294 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.884139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-hub\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.884294 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.884194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8j4\" (UniqueName: \"kubernetes.io/projected/bcbe8523-8abf-4c20-8627-31c6e3e6939a-kube-api-access-2v8j4\") pod \"managed-serviceaccount-addon-agent-7fb7659d9d-ft85f\" (UID: \"bcbe8523-8abf-4c20-8627-31c6e3e6939a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:24.884294 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.884266 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.905385 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.905358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:24.985199 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcbe8523-8abf-4c20-8627-31c6e3e6939a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7659d9d-ft85f\" (UID: \"bcbe8523-8abf-4c20-8627-31c6e3e6939a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:24.985350 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7efbb39-f148-408a-88e3-ad3273be1630-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.985350 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:51:24.985350 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.985350 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-ca\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.985528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwpxd\" (UniqueName: \"kubernetes.io/projected/e7efbb39-f148-408a-88e3-ad3273be1630-kube-api-access-pwpxd\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.985528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-hub\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.985528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985441 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:51:24.985528 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8j4\" (UniqueName: \"kubernetes.io/projected/bcbe8523-8abf-4c20-8627-31c6e3e6939a-kube-api-access-2v8j4\") pod \"managed-serviceaccount-addon-agent-7fb7659d9d-ft85f\" (UID: \"bcbe8523-8abf-4c20-8627-31c6e3e6939a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:24.985706 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.985579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.986064 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.986026 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7efbb39-f148-408a-88e3-ad3273be1630-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.987929 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.987902 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.988109 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.988093 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-ca\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.988255 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.988230 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 00:51:24.988372 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.988261 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 00:51:24.988372 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.988287 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-hub\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.988372 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.988343 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcbe8523-8abf-4c20-8627-31c6e3e6939a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7659d9d-ft85f\" (UID: \"bcbe8523-8abf-4c20-8627-31c6e3e6939a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:24.988490 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.988386 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7efbb39-f148-408a-88e3-ad3273be1630-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:24.998215 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.998195 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2552efdc-0ea2-41f8-9750-6b41238557d4-original-pull-secret\") pod \"global-pull-secret-syncer-q5bvn\" (UID: \"2552efdc-0ea2-41f8-9750-6b41238557d4\") " pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:51:24.998488 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.998472 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41146b11-bf1d-412b-85cf-83cd0b4fc7cf-metrics-certs\") pod \"network-metrics-daemon-zpzbn\" (UID: \"41146b11-bf1d-412b-85cf-83cd0b4fc7cf\") " pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:51:24.998865 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.998845 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8j4\" (UniqueName: \"kubernetes.io/projected/bcbe8523-8abf-4c20-8627-31c6e3e6939a-kube-api-access-2v8j4\") pod \"managed-serviceaccount-addon-agent-7fb7659d9d-ft85f\" (UID: \"bcbe8523-8abf-4c20-8627-31c6e3e6939a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:24.998977 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:24.998959 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwpxd\" (UniqueName: \"kubernetes.io/projected/e7efbb39-f148-408a-88e3-ad3273be1630-kube-api-access-pwpxd\") pod \"cluster-proxy-proxy-agent-77f94b5888-kxzsg\" (UID: \"e7efbb39-f148-408a-88e3-ad3273be1630\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:25.023218 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.023197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mhb4c\"" Sep 10 00:51:25.027645 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.027629 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q5bvn" Sep 10 00:51:25.031979 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.031934 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpzbn" Sep 10 00:51:25.086529 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.086501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:51:25.089384 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.089166 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 00:51:25.100178 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.100134 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 00:51:25.108521 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.108349 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" Sep 10 00:51:25.111360 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.111312 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kvw\" (UniqueName: \"kubernetes.io/projected/0e9a721c-3e04-4772-8554-341c06b38a5d-kube-api-access-69kvw\") pod \"network-check-target-tfbb8\" (UID: \"0e9a721c-3e04-4772-8554-341c06b38a5d\") " pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:51:25.114767 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.114580 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" Sep 10 00:51:25.244486 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.244457 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:25.296983 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.296915 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q5bvn"] Sep 10 00:51:25.299814 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.299790 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zpzbn"] Sep 10 00:51:25.300916 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:25.300892 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2552efdc_0ea2_41f8_9750_6b41238557d4.slice/crio-ae18eba22f700a282184196d2b06685f811bc421f1d322c8e27bc2f9a06e2db5 WatchSource:0}: Error finding container ae18eba22f700a282184196d2b06685f811bc421f1d322c8e27bc2f9a06e2db5: Status 404 returned error can't find the container with id ae18eba22f700a282184196d2b06685f811bc421f1d322c8e27bc2f9a06e2db5 Sep 10 00:51:25.302517 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:25.302499 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41146b11_bf1d_412b_85cf_83cd0b4fc7cf.slice/crio-c1de024fb8c9f37bd4b8521534081e67736852927e1fb7fc4da13c259f4f262c WatchSource:0}: Error finding container c1de024fb8c9f37bd4b8521534081e67736852927e1fb7fc4da13c259f4f262c: Status 404 returned error can't find the container with id c1de024fb8c9f37bd4b8521534081e67736852927e1fb7fc4da13c259f4f262c Sep 10 00:51:25.336166 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.336140 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rcm88\"" Sep 10 00:51:25.344449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.344430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:51:25.377774 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.377743 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f"] Sep 10 00:51:25.381512 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:25.381473 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcbe8523_8abf_4c20_8627_31c6e3e6939a.slice/crio-ffbf307f860506d4e0d3372b2a47ef4513b23964f5df4dd0603d79885beb01b6 WatchSource:0}: Error finding container ffbf307f860506d4e0d3372b2a47ef4513b23964f5df4dd0603d79885beb01b6: Status 404 returned error can't find the container with id ffbf307f860506d4e0d3372b2a47ef4513b23964f5df4dd0603d79885beb01b6 Sep 10 00:51:25.385591 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.385570 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg"] Sep 10 00:51:25.387729 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:25.387701 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7efbb39_f148_408a_88e3_ad3273be1630.slice/crio-f0cc689c37ac762fe15ce60eed917eff990a4a6dbc7c96f0a205f5fc7cb7c886 WatchSource:0}: Error finding container f0cc689c37ac762fe15ce60eed917eff990a4a6dbc7c96f0a205f5fc7cb7c886: Status 404 returned error can't find the container with id f0cc689c37ac762fe15ce60eed917eff990a4a6dbc7c96f0a205f5fc7cb7c886 Sep 10 00:51:25.556416 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.556309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" event={"ID":"bcbe8523-8abf-4c20-8627-31c6e3e6939a","Type":"ContainerStarted","Data":"ffbf307f860506d4e0d3372b2a47ef4513b23964f5df4dd0603d79885beb01b6"} Sep 10 00:51:25.557495 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.557466 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q5bvn" event={"ID":"2552efdc-0ea2-41f8-9750-6b41238557d4","Type":"ContainerStarted","Data":"ae18eba22f700a282184196d2b06685f811bc421f1d322c8e27bc2f9a06e2db5"} Sep 10 00:51:25.558601 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.558579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zpzbn" event={"ID":"41146b11-bf1d-412b-85cf-83cd0b4fc7cf","Type":"ContainerStarted","Data":"c1de024fb8c9f37bd4b8521534081e67736852927e1fb7fc4da13c259f4f262c"} Sep 10 00:51:25.559659 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.559639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" event={"ID":"e7efbb39-f148-408a-88e3-ad3273be1630","Type":"ContainerStarted","Data":"f0cc689c37ac762fe15ce60eed917eff990a4a6dbc7c96f0a205f5fc7cb7c886"} Sep 10 00:51:25.613583 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:25.613558 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfbb8"] Sep 10 00:51:25.617320 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:25.617298 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9a721c_3e04_4772_8554_341c06b38a5d.slice/crio-404737e4156ccffb8a4ee485e0ce06b540eea3602c6353425543a9bdac4c08bc WatchSource:0}: Error finding container 404737e4156ccffb8a4ee485e0ce06b540eea3602c6353425543a9bdac4c08bc: Status 404 returned error can't find the container with id 404737e4156ccffb8a4ee485e0ce06b540eea3602c6353425543a9bdac4c08bc Sep 10 00:51:26.568603 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:26.567793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zpzbn" event={"ID":"41146b11-bf1d-412b-85cf-83cd0b4fc7cf","Type":"ContainerStarted","Data":"dc61979100f21dad5d8d81cef269f5edbbedf89210c59181794e824eeeb817b3"} Sep 10 00:51:26.568603 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:26.567868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zpzbn" event={"ID":"41146b11-bf1d-412b-85cf-83cd0b4fc7cf","Type":"ContainerStarted","Data":"0b4a3cda8dc5e75fb4378d269590e074d4efe6a5dd9ccb7ed91b096dcf11da5a"} Sep 10 00:51:26.570790 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:26.570741 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfbb8" event={"ID":"0e9a721c-3e04-4772-8554-341c06b38a5d","Type":"ContainerStarted","Data":"404737e4156ccffb8a4ee485e0ce06b540eea3602c6353425543a9bdac4c08bc"} Sep 10 00:51:26.585482 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:26.584319 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zpzbn" podStartSLOduration=65.683329402 podStartE2EDuration="1m6.584298519s" totalImagesPullingTime="900.969117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:26.582979022 +0000 UTC m=+66.873864207" watchObservedRunningTime="2026-09-10 00:51:26.584298519 +0000 UTC m=+66.875183709" Sep 10 00:51:26.669752 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:26.669638 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:26.771325 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:26.771251 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:26.894745 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:26.894586 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:27.262880 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:27.262700 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:27.323556 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:27.323452 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:27.654552 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:27.654486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:27.754575 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:27.754539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:29.062334 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:29.062287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:29.166529 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:29.166496 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:30.932100 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:30.932066 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:30.934314 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:30.934289 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6576704f-06e3-4b94-8081-9c09fe114efb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcxbl\" (UID: \"6576704f-06e3-4b94-8081-9c09fe114efb\") " pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:31.141852 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:31.141819 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rgq8h\"" Sep 10 00:51:31.150009 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:31.149976 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcxbl" Sep 10 00:51:32.081514 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:32.081481 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:32.146476 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:32.146444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:32.296243 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:32.296213 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:33.537425 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.537354 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcxbl"] Sep 10 00:51:33.541242 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:33.541208 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6576704f_06e3_4b94_8081_9c09fe114efb.slice/crio-6ba42f7c3d15afdd755215b4794e93c0b2dd9e16734d897737c6f35474dd048e WatchSource:0}: Error finding container 6ba42f7c3d15afdd755215b4794e93c0b2dd9e16734d897737c6f35474dd048e: Status 404 returned error can't find the container with id 6ba42f7c3d15afdd755215b4794e93c0b2dd9e16734d897737c6f35474dd048e Sep 10 00:51:33.606335 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.606305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" event={"ID":"e7efbb39-f148-408a-88e3-ad3273be1630","Type":"ContainerStarted","Data":"14e9daa36c0c48fb4c8ba762a9283a8de7905d97cbecdc62e919ebec03b2ddd6"} Sep 10 00:51:33.606488 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.606350 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" event={"ID":"e7efbb39-f148-408a-88e3-ad3273be1630","Type":"ContainerStarted","Data":"228f08e2adce8eaea5f6b19e6e09999ba4b3ba149133bb27457429e7b8a65faa"} Sep 10 00:51:33.606488 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.606367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" event={"ID":"e7efbb39-f148-408a-88e3-ad3273be1630","Type":"ContainerStarted","Data":"c05e264d8d28d39c170c065d8b40cd40e4c941d355287d3beb36ab46b1d0e535"} Sep 10 00:51:33.608508 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.608455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" event={"ID":"bcbe8523-8abf-4c20-8627-31c6e3e6939a","Type":"ContainerStarted","Data":"d359f9edb4179dc24a28603afcf631644ee0d025de7779b2a3bd741926df71e2"} Sep 10 00:51:33.610078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.610033 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfbb8" event={"ID":"0e9a721c-3e04-4772-8554-341c06b38a5d","Type":"ContainerStarted","Data":"43373203091da8107c33716533ec231f3122e36ab10673e087d9f6dae28c2116"} Sep 10 00:51:33.610212 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.610189 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:51:33.611589 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.611566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcxbl" event={"ID":"6576704f-06e3-4b94-8081-9c09fe114efb","Type":"ContainerStarted","Data":"df8426618e8faba5a4ee40e6d396e60ef6ae03a88f1afe44eb65b35c83f41322"} Sep 10 00:51:33.611676 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.611618 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcxbl" event={"ID":"6576704f-06e3-4b94-8081-9c09fe114efb","Type":"ContainerStarted","Data":"6ba42f7c3d15afdd755215b4794e93c0b2dd9e16734d897737c6f35474dd048e"} Sep 10 00:51:33.612829 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.612808 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q5bvn" event={"ID":"2552efdc-0ea2-41f8-9750-6b41238557d4","Type":"ContainerStarted","Data":"8e928940cf7d341bafbedcdbfd39b2880ffb40a244d5f95920ff9cdafe52515a"} Sep 10 00:51:33.624331 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.624279 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f94b5888-kxzsg" podStartSLOduration=1.728749383 podStartE2EDuration="9.624259983s" totalImagesPullingTime="7.8955106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:33.623584762 +0000 UTC m=+73.914469951" watchObservedRunningTime="2026-09-10 00:51:33.624259983 +0000 UTC m=+73.915145172" Sep 10 00:51:33.637594 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.637557 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q5bvn" podStartSLOduration=65.665238319 podStartE2EDuration="1m13.637543935s" totalImagesPullingTime="7.972305616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:33.637335542 +0000 UTC m=+73.928220732" watchObservedRunningTime="2026-09-10 00:51:33.637543935 +0000 UTC m=+73.928429120" Sep 10 00:51:33.651737 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.651700 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tfbb8" podStartSLOduration=66.001715894 podStartE2EDuration="1m13.651688134s" totalImagesPullingTime="7.64997224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:33.651480128 +0000 UTC m=+73.942365318" watchObservedRunningTime="2026-09-10 00:51:33.651688134 +0000 UTC m=+73.942573321" Sep 10 00:51:33.665828 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.665784 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7659d9d-ft85f" podStartSLOduration=1.786883596 podStartE2EDuration="9.665772896s" totalImagesPullingTime="7.8788893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:33.6649825 +0000 UTC m=+73.955867691" watchObservedRunningTime="2026-09-10 00:51:33.665772896 +0000 UTC m=+73.956658091" Sep 10 00:51:33.868119 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.868080 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:33.968798 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:33.968763 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:34.026545 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:34.026510 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:34.592257 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:34.592219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:34.617816 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:34.617778 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcxbl" event={"ID":"6576704f-06e3-4b94-8081-9c09fe114efb","Type":"ContainerStarted","Data":"4c5a6c248bd1b4a4c439b29b45b9dda007d9c2ddea58bec0fdaec041eb975ac4"} Sep 10 00:51:34.652469 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:34.652438 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:35.627233 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:35.627198 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcxbl" event={"ID":"6576704f-06e3-4b94-8081-9c09fe114efb","Type":"ContainerStarted","Data":"38c5dfdb301bd9337be83451a86f244dc5b23cdc8e8e174d78cc886c3b9723c6"} Sep 10 00:51:35.645949 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:35.645905 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qcxbl" podStartSLOduration=35.768444167 podStartE2EDuration="37.645890933s" totalImagesPullingTime="1.877446766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:35.644709403 +0000 UTC m=+75.935594592" watchObservedRunningTime="2026-09-10 00:51:35.645890933 +0000 UTC m=+75.936776120" Sep 10 00:51:36.225513 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.225477 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:36.416299 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.416264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:36.489409 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.489314 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mdfdv"] Sep 10 00:51:36.491659 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.491643 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.494319 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.494285 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 00:51:36.494499 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.494479 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 00:51:36.494660 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.494631 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 00:51:36.494768 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.494713 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 00:51:36.495542 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.495509 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gs6kj\"" Sep 10 00:51:36.495650 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.495509 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 00:51:36.495650 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.495559 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 00:51:36.517982 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.517947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:36.572039 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-sys\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572226 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-tls\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572226 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572226 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-accelerators-collector-config\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572226 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-wtmp\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572393 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/429a2d43-ce4c-420a-a7ae-214b5b90c64b-metrics-client-ca\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572393 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-root\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572393 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsccb\" (UniqueName: \"kubernetes.io/projected/429a2d43-ce4c-420a-a7ae-214b5b90c64b-kube-api-access-xsccb\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.572500 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.572412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-textfile\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.587235 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.587200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:36.673035 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.672998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsccb\" (UniqueName: \"kubernetes.io/projected/429a2d43-ce4c-420a-a7ae-214b5b90c64b-kube-api-access-xsccb\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673486 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673066 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-textfile\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673486 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673097 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-sys\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673486 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-tls\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673486 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673486 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673252 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-sys\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673741 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673516 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-textfile\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673741 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-accelerators-collector-config\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673741 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-wtmp\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673741 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673629 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/429a2d43-ce4c-420a-a7ae-214b5b90c64b-metrics-client-ca\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.673741 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.673691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-root\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.674206 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.674184 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-wtmp\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.674326 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.674196 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-accelerators-collector-config\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.674482 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.674457 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/429a2d43-ce4c-420a-a7ae-214b5b90c64b-root\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.674630 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.674612 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/429a2d43-ce4c-420a-a7ae-214b5b90c64b-metrics-client-ca\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.675818 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.675786 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-tls\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.675972 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.675955 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/429a2d43-ce4c-420a-a7ae-214b5b90c64b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.682185 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.682153 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsccb\" (UniqueName: \"kubernetes.io/projected/429a2d43-ce4c-420a-a7ae-214b5b90c64b-kube-api-access-xsccb\") pod \"node-exporter-mdfdv\" (UID: \"429a2d43-ce4c-420a-a7ae-214b5b90c64b\") " pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.802529 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.802443 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mdfdv" Sep 10 00:51:36.812527 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:36.812495 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429a2d43_ce4c_420a_a7ae_214b5b90c64b.slice/crio-7a646ad29c3b4840a1add3d33aac47b746ece27c67af362d35f3713f7770ae2a WatchSource:0}: Error finding container 7a646ad29c3b4840a1add3d33aac47b746ece27c67af362d35f3713f7770ae2a: Status 404 returned error can't find the container with id 7a646ad29c3b4840a1add3d33aac47b746ece27c67af362d35f3713f7770ae2a Sep 10 00:51:36.826252 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.826225 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:36.926403 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:36.926371 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:37.076519 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:37.076487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:37.636404 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:37.636374 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mdfdv" event={"ID":"429a2d43-ce4c-420a-a7ae-214b5b90c64b","Type":"ContainerStarted","Data":"7a646ad29c3b4840a1add3d33aac47b746ece27c67af362d35f3713f7770ae2a"} Sep 10 00:51:37.813257 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:37.813199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:37.912661 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:37.912554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:38.013400 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:38.013363 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:38.643520 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:38.643483 2573 generic.go:356] "Generic (PLEG): container finished" podID="429a2d43-ce4c-420a-a7ae-214b5b90c64b" containerID="3ed7bdfdbc69945d024adadaaf4fb9748c72df9553e28137e9769dae0bc37953" exitCode=0 Sep 10 00:51:38.643679 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:38.643548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mdfdv" event={"ID":"429a2d43-ce4c-420a-a7ae-214b5b90c64b","Type":"ContainerDied","Data":"3ed7bdfdbc69945d024adadaaf4fb9748c72df9553e28137e9769dae0bc37953"} Sep 10 00:51:39.475946 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:39.475915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:39.580189 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:39.580156 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:39.650233 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:39.650197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mdfdv" event={"ID":"429a2d43-ce4c-420a-a7ae-214b5b90c64b","Type":"ContainerStarted","Data":"5c9c8e33abd806fd65be5a215de193cf781c3412ad27e2be1f67cbddbf04c547"} Sep 10 00:51:39.650416 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:39.650301 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mdfdv" event={"ID":"429a2d43-ce4c-420a-a7ae-214b5b90c64b","Type":"ContainerStarted","Data":"2f93859ce5861412c069b1860645b6c59b20bea4a16e679b63fb2984787651d1"} Sep 10 00:51:39.671824 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:39.671771 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mdfdv" podStartSLOduration=2.509130507 podStartE2EDuration="3.67175738s" totalImagesPullingTime="1.100277559s" totalInitContainerRuntime="62.349314ms" isStatefulPod=true podCreationTimestamp="2026-09-10 00:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:39.670042666 +0000 UTC m=+79.960927869" watchObservedRunningTime="2026-09-10 00:51:39.67175738 +0000 UTC m=+79.962642567" Sep 10 00:51:39.895797 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:39.895764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:39.996385 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:39.996347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:40.277253 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:40.277165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:40.377537 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:40.377507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:41.246465 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.246437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:41.258066 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.258018 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr"] Sep 10 00:51:41.260629 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.260613 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.263148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.263127 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 00:51:41.263252 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.263183 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hxpgl\"" Sep 10 00:51:41.268962 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.268943 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr"] Sep 10 00:51:41.304402 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.304368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvnp\" (UniqueName: \"kubernetes.io/projected/7b6c3b73-0062-4352-8f1e-f460603f639c-kube-api-access-wmvnp\") pod \"monitoring-plugin-85bbbbbf4-8qjbr\" (UID: \"7b6c3b73-0062-4352-8f1e-f460603f639c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.304599 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.304418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b6c3b73-0062-4352-8f1e-f460603f639c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8qjbr\" (UID: \"7b6c3b73-0062-4352-8f1e-f460603f639c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.349138 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.349103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:41.404884 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.404853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvnp\" (UniqueName: \"kubernetes.io/projected/7b6c3b73-0062-4352-8f1e-f460603f639c-kube-api-access-wmvnp\") pod \"monitoring-plugin-85bbbbbf4-8qjbr\" (UID: \"7b6c3b73-0062-4352-8f1e-f460603f639c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.405031 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.404908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b6c3b73-0062-4352-8f1e-f460603f639c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8qjbr\" (UID: \"7b6c3b73-0062-4352-8f1e-f460603f639c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.407468 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.407441 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b6c3b73-0062-4352-8f1e-f460603f639c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8qjbr\" (UID: \"7b6c3b73-0062-4352-8f1e-f460603f639c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.413332 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.413306 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvnp\" (UniqueName: \"kubernetes.io/projected/7b6c3b73-0062-4352-8f1e-f460603f639c-kube-api-access-wmvnp\") pod \"monitoring-plugin-85bbbbbf4-8qjbr\" (UID: \"7b6c3b73-0062-4352-8f1e-f460603f639c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.444511 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.444482 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:41.569734 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.569701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:41.838746 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:41.838676 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr"] Sep 10 00:51:41.841469 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:51:41.841444 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6c3b73_0062_4352_8f1e_f460603f639c.slice/crio-995e88af6d1a617a64e4b75ed1c8b8aac03b7d8257f7d0fcdd03fea647bf9f02 WatchSource:0}: Error finding container 995e88af6d1a617a64e4b75ed1c8b8aac03b7d8257f7d0fcdd03fea647bf9f02: Status 404 returned error can't find the container with id 995e88af6d1a617a64e4b75ed1c8b8aac03b7d8257f7d0fcdd03fea647bf9f02 Sep 10 00:51:42.662142 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:42.662071 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" event={"ID":"7b6c3b73-0062-4352-8f1e-f460603f639c","Type":"ContainerStarted","Data":"995e88af6d1a617a64e4b75ed1c8b8aac03b7d8257f7d0fcdd03fea647bf9f02"} Sep 10 00:51:42.696201 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:42.696167 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:43.024066 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:43.023954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:43.123462 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:43.123429 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:43.667996 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:43.667962 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" event={"ID":"7b6c3b73-0062-4352-8f1e-f460603f639c","Type":"ContainerStarted","Data":"e4babb00b5b3a4ba2bc5c7d18a1822393b53fffd7fb014cf40d09ee166b37907"} Sep 10 00:51:43.668469 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:43.668155 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:43.672618 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:43.672591 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" Sep 10 00:51:43.689326 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:43.689284 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8qjbr" podStartSLOduration=1.356001258 podStartE2EDuration="2.689270794s" totalImagesPullingTime="1.333269536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:43.689150465 +0000 UTC m=+83.980035655" watchObservedRunningTime="2026-09-10 00:51:43.689270794 +0000 UTC m=+83.980155987" Sep 10 00:51:44.763795 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:44.763744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:44.819243 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:44.819203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:46.680601 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:46.680565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:46.780409 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:46.780377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:46.953284 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:46.953194 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:47.054915 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:47.054888 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:50.088857 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:50.088825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:50.190358 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:50.190323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:50.291745 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:50.291716 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:55.121131 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:55.121098 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:55.216198 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:55.216162 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:55.648473 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:55.648444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:55.701735 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:55.701702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:55.800321 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:55.800286 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:55.899100 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:55.899011 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:55.956282 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:55.956251 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:57.888275 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:57.888241 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:51:57.948135 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:51:57.948108 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:03.298623 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:03.298583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:03.360147 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:03.360116 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:04.054203 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:04.054165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:04.105237 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:04.105202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:04.607481 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:04.607456 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gchmg_19aa8118-a6a3-49e8-b252-d02cbea109dd/serve-healthcheck-canary/0.log" Sep 10 00:52:04.620547 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:04.620521 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tfbb8" Sep 10 00:52:05.055240 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:05.055163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:05.162185 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:05.162154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:06.942530 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:06.942492 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:07.043030 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:07.042974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:07.096814 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:07.096786 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:12.888455 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:12.888422 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:12.941172 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:12.941140 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:15.032124 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:15.032091 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:15.130593 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:15.130562 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:27.891783 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:27.891746 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:27.949714 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:27.949680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:52.581616 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:52.581581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:52:52.681718 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:52:52.681681 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:04.469548 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:04.469515 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:04.526174 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:04.526128 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:12.893973 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:12.893903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:12.994327 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:12.994300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:13.163629 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:13.163553 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:13.218822 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:13.218792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:23.665602 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:23.665564 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:23.718606 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:23.718539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:23.768577 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:23.768548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:34.752967 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:34.752930 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:34.810819 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:34.810787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:53.817506 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:53.817468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:54.084250 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:54.084169 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:53:54.180283 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:53:54.180248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:15.695302 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:15.695260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:16.486029 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:16.485993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:17.527981 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:17.527946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:19.301042 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:19.301007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:19.402137 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:19.402105 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:21.030648 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:21.030611 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:21.153428 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:21.153396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:21.267864 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:21.267830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:23.411400 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.411371 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:23.649181 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.649151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:23.797350 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.797273 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9cbww"] Sep 10 00:54:23.800227 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.800212 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:23.803948 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.803926 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 00:54:23.805022 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.805002 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rbmzh\"" Sep 10 00:54:23.805141 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.805024 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 00:54:23.809096 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.809076 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9cbww"] Sep 10 00:54:23.902591 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.902558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ljjd\" (UniqueName: \"kubernetes.io/projected/9b4b55f5-c316-45a9-b4b1-dec40b928d43-kube-api-access-7ljjd\") pod \"cert-manager-cainjector-559cdd8c87-9cbww\" (UID: \"9b4b55f5-c316-45a9-b4b1-dec40b928d43\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:23.902753 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:23.902603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b4b55f5-c316-45a9-b4b1-dec40b928d43-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9cbww\" (UID: \"9b4b55f5-c316-45a9-b4b1-dec40b928d43\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:24.003640 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:24.003611 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ljjd\" (UniqueName: \"kubernetes.io/projected/9b4b55f5-c316-45a9-b4b1-dec40b928d43-kube-api-access-7ljjd\") pod \"cert-manager-cainjector-559cdd8c87-9cbww\" (UID: \"9b4b55f5-c316-45a9-b4b1-dec40b928d43\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:24.003797 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:24.003724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b4b55f5-c316-45a9-b4b1-dec40b928d43-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9cbww\" (UID: \"9b4b55f5-c316-45a9-b4b1-dec40b928d43\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:24.013590 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:24.013559 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b4b55f5-c316-45a9-b4b1-dec40b928d43-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9cbww\" (UID: \"9b4b55f5-c316-45a9-b4b1-dec40b928d43\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:24.014098 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:24.014081 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ljjd\" (UniqueName: \"kubernetes.io/projected/9b4b55f5-c316-45a9-b4b1-dec40b928d43-kube-api-access-7ljjd\") pod \"cert-manager-cainjector-559cdd8c87-9cbww\" (UID: \"9b4b55f5-c316-45a9-b4b1-dec40b928d43\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:24.109342 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:24.109317 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" Sep 10 00:54:24.375450 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:24.375376 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9cbww"] Sep 10 00:54:24.378660 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:54:24.378632 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b4b55f5_c316_45a9_b4b1_dec40b928d43.slice/crio-519f00d93c914c4269becb804f91e667dbd0920d2784c7b20a501112702c6b0d WatchSource:0}: Error finding container 519f00d93c914c4269becb804f91e667dbd0920d2784c7b20a501112702c6b0d: Status 404 returned error can't find the container with id 519f00d93c914c4269becb804f91e667dbd0920d2784c7b20a501112702c6b0d Sep 10 00:54:25.190752 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:25.190693 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" event={"ID":"9b4b55f5-c316-45a9-b4b1-dec40b928d43","Type":"ContainerStarted","Data":"519f00d93c914c4269becb804f91e667dbd0920d2784c7b20a501112702c6b0d"} Sep 10 00:54:26.092894 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:26.092848 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:26.146934 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:26.146902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:28.966289 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:28.966254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:29.067166 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:29.067131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:29.207032 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:29.206995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" event={"ID":"9b4b55f5-c316-45a9-b4b1-dec40b928d43","Type":"ContainerStarted","Data":"f9e08941cd8a958bfdec7d615e36296319c675e3ca62d54724cfcc35da5218c2"} Sep 10 00:54:29.222576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:29.222465 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cbww" podStartSLOduration=2.413226743 podStartE2EDuration="6.222448563s" totalImagesPullingTime="3.80922182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:54:29.221665758 +0000 UTC m=+249.512550946" watchObservedRunningTime="2026-09-10 00:54:29.222448563 +0000 UTC m=+249.513333750" Sep 10 00:54:30.622809 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:30.622771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:32.510755 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:32.510725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:32.610469 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:32.610439 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:34.536175 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.536141 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6"] Sep 10 00:54:34.539228 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.539212 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:34.541947 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.541915 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 00:54:34.541947 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.541915 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:54:34.542872 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.542859 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-748rz\"" Sep 10 00:54:34.547167 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.547146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6"] Sep 10 00:54:34.682815 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.682771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70db01a3-a3ca-433d-b708-9656b9f73039-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vzmd6\" (UID: \"70db01a3-a3ca-433d-b708-9656b9f73039\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:34.682815 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.682806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnlws\" (UniqueName: \"kubernetes.io/projected/70db01a3-a3ca-433d-b708-9656b9f73039-kube-api-access-dnlws\") pod \"openshift-lws-operator-fd8ccff4c-vzmd6\" (UID: \"70db01a3-a3ca-433d-b708-9656b9f73039\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:34.783857 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.783819 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70db01a3-a3ca-433d-b708-9656b9f73039-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vzmd6\" (UID: \"70db01a3-a3ca-433d-b708-9656b9f73039\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:34.783857 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.783859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnlws\" (UniqueName: \"kubernetes.io/projected/70db01a3-a3ca-433d-b708-9656b9f73039-kube-api-access-dnlws\") pod \"openshift-lws-operator-fd8ccff4c-vzmd6\" (UID: \"70db01a3-a3ca-433d-b708-9656b9f73039\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:34.784223 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.784200 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70db01a3-a3ca-433d-b708-9656b9f73039-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vzmd6\" (UID: \"70db01a3-a3ca-433d-b708-9656b9f73039\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:34.792065 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.792006 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnlws\" (UniqueName: \"kubernetes.io/projected/70db01a3-a3ca-433d-b708-9656b9f73039-kube-api-access-dnlws\") pod \"openshift-lws-operator-fd8ccff4c-vzmd6\" (UID: \"70db01a3-a3ca-433d-b708-9656b9f73039\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:34.847986 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:34.847951 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" Sep 10 00:54:35.114852 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:35.114822 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6"] Sep 10 00:54:35.118461 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:54:35.118435 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70db01a3_a3ca_433d_b708_9656b9f73039.slice/crio-54dd02e645ba39e6acc35a192f0d97675613bb66f99daae5ce5ccbd44919f36b WatchSource:0}: Error finding container 54dd02e645ba39e6acc35a192f0d97675613bb66f99daae5ce5ccbd44919f36b: Status 404 returned error can't find the container with id 54dd02e645ba39e6acc35a192f0d97675613bb66f99daae5ce5ccbd44919f36b Sep 10 00:54:35.225795 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:35.225760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" event={"ID":"70db01a3-a3ca-433d-b708-9656b9f73039","Type":"ContainerStarted","Data":"54dd02e645ba39e6acc35a192f0d97675613bb66f99daae5ce5ccbd44919f36b"} Sep 10 00:54:38.239109 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:38.239070 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" event={"ID":"70db01a3-a3ca-433d-b708-9656b9f73039","Type":"ContainerStarted","Data":"588b9afac67330043f6392d92c9bc1cd1bd9c3f1971d11551e93bbdc5d40a960"} Sep 10 00:54:38.255564 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:38.255514 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vzmd6" podStartSLOduration=2.003832083 podStartE2EDuration="4.255495039s" totalImagesPullingTime="2.251662956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:54:38.253777037 +0000 UTC m=+258.544662224" watchObservedRunningTime="2026-09-10 00:54:38.255495039 +0000 UTC m=+258.546380228" Sep 10 00:54:38.900573 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:38.900539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:39.001195 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:39.001155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:40.622194 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:40.622165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:53.407990 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:53.407897 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:53.508384 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:53.508351 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.034839 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.034810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.264787 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.264748 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.363460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.363431 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.419654 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.419627 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv"] Sep 10 00:54:54.424387 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.424371 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.427674 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.427654 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 00:54:54.427815 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.427800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 00:54:54.428021 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.428006 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 00:54:54.428359 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.428344 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8jt9s\"" Sep 10 00:54:54.428912 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.428897 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 00:54:54.445732 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.445712 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv"] Sep 10 00:54:54.517715 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.517681 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe06bd9c-7090-4c93-85f4-0af63e5e0122-tmp\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.517837 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.517730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe06bd9c-7090-4c93-85f4-0af63e5e0122-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.517837 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.517750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525px\" (UniqueName: \"kubernetes.io/projected/fe06bd9c-7090-4c93-85f4-0af63e5e0122-kube-api-access-525px\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.517837 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.517767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe06bd9c-7090-4c93-85f4-0af63e5e0122-manifests\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.517837 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.517787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe06bd9c-7090-4c93-85f4-0af63e5e0122-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.584912 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.584853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.619068 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.618987 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe06bd9c-7090-4c93-85f4-0af63e5e0122-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.619068 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.619019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-525px\" (UniqueName: \"kubernetes.io/projected/fe06bd9c-7090-4c93-85f4-0af63e5e0122-kube-api-access-525px\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.619068 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.619066 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe06bd9c-7090-4c93-85f4-0af63e5e0122-manifests\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.619283 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.619103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe06bd9c-7090-4c93-85f4-0af63e5e0122-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.619283 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.619149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe06bd9c-7090-4c93-85f4-0af63e5e0122-tmp\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.619519 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.619494 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe06bd9c-7090-4c93-85f4-0af63e5e0122-manifests\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.621362 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.621344 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe06bd9c-7090-4c93-85f4-0af63e5e0122-tmp\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.621624 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.621603 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe06bd9c-7090-4c93-85f4-0af63e5e0122-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.621687 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.621635 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe06bd9c-7090-4c93-85f4-0af63e5e0122-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.630928 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.630906 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-525px\" (UniqueName: \"kubernetes.io/projected/fe06bd9c-7090-4c93-85f4-0af63e5e0122-kube-api-access-525px\") pod \"opendatahub-operator-controller-manager-5dc88f9465-8kqzv\" (UID: \"fe06bd9c-7090-4c93-85f4-0af63e5e0122\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.684142 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.684118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.734334 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.734312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:54:54.786838 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.786805 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.886232 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.886166 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:54.967406 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:54.967376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:54:55.021863 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:55.021815 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv"] Sep 10 00:54:55.026114 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:54:55.026044 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe06bd9c_7090_4c93_85f4_0af63e5e0122.slice/crio-0377537e817a9776ba6fa0bde7ed119f744d7efedda85411c2ebc23ca25bb7de WatchSource:0}: Error finding container 0377537e817a9776ba6fa0bde7ed119f744d7efedda85411c2ebc23ca25bb7de: Status 404 returned error can't find the container with id 0377537e817a9776ba6fa0bde7ed119f744d7efedda85411c2ebc23ca25bb7de Sep 10 00:54:55.292716 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:55.292641 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" event={"ID":"fe06bd9c-7090-4c93-85f4-0af63e5e0122","Type":"ContainerStarted","Data":"0377537e817a9776ba6fa0bde7ed119f744d7efedda85411c2ebc23ca25bb7de"} Sep 10 00:54:58.307198 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:58.307163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" event={"ID":"fe06bd9c-7090-4c93-85f4-0af63e5e0122","Type":"ContainerStarted","Data":"455dc9411e6cc00410408ffd402d06c9ac82eeeea2c409b351365c262f9ebf46"} Sep 10 00:54:59.312996 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:59.312961 2573 generic.go:356] "Generic (PLEG): container finished" podID="fe06bd9c-7090-4c93-85f4-0af63e5e0122" containerID="455dc9411e6cc00410408ffd402d06c9ac82eeeea2c409b351365c262f9ebf46" exitCode=0 Sep 10 00:54:59.313363 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:54:59.313063 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" event={"ID":"fe06bd9c-7090-4c93-85f4-0af63e5e0122","Type":"ContainerDied","Data":"455dc9411e6cc00410408ffd402d06c9ac82eeeea2c409b351365c262f9ebf46"} Sep 10 00:55:00.318442 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:00.318402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" event={"ID":"fe06bd9c-7090-4c93-85f4-0af63e5e0122","Type":"ContainerStarted","Data":"a7c729c22c02190a891e74f34bd3190e2b6bfc13d9df75568141508413117c30"} Sep 10 00:55:00.318816 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:00.318500 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:55:00.339328 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:00.339258 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" podStartSLOduration=1.767472564 podStartE2EDuration="6.339240536s" totalImagesPullingTime="3.480713569s" totalInitContainerRuntime="1.091054403s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:54:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:00.337929901 +0000 UTC m=+280.628815091" watchObservedRunningTime="2026-09-10 00:55:00.339240536 +0000 UTC m=+280.630125737" Sep 10 00:55:00.906414 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:00.906385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:01.015709 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:01.015670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:04.845271 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:04.845244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:04.947019 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:04.946991 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:11.325444 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:11.325414 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-8kqzv" Sep 10 00:55:11.500781 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:11.500745 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:11.602263 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:11.602180 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:13.650166 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:13.650134 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:13.815959 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:13.815926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:14.059779 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.059678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:14.108680 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.108648 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r"] Sep 10 00:55:14.111632 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.111617 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.114480 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.114432 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 00:55:14.114603 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.114566 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 00:55:14.115813 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.115790 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 00:55:14.115921 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.115827 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 00:55:14.115921 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.115828 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jsfzc\"" Sep 10 00:55:14.124678 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.124655 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r"] Sep 10 00:55:14.158458 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.158421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2486d521-7105-45c6-a871-0a9b0546eac5-tls-certs\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.158611 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.158478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv5qd\" (UniqueName: \"kubernetes.io/projected/2486d521-7105-45c6-a871-0a9b0546eac5-kube-api-access-bv5qd\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.158611 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.158498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2486d521-7105-45c6-a871-0a9b0546eac5-tmp\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.187160 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.187121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:14.259649 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.259620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv5qd\" (UniqueName: \"kubernetes.io/projected/2486d521-7105-45c6-a871-0a9b0546eac5-kube-api-access-bv5qd\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.259821 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.259653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2486d521-7105-45c6-a871-0a9b0546eac5-tmp\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.259821 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.259703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2486d521-7105-45c6-a871-0a9b0546eac5-tls-certs\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.262142 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.262121 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2486d521-7105-45c6-a871-0a9b0546eac5-tmp\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.262361 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.262342 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2486d521-7105-45c6-a871-0a9b0546eac5-tls-certs\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.273472 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.273449 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv5qd\" (UniqueName: \"kubernetes.io/projected/2486d521-7105-45c6-a871-0a9b0546eac5-kube-api-access-bv5qd\") pod \"kube-auth-proxy-569dfc5d57-nr99r\" (UID: \"2486d521-7105-45c6-a871-0a9b0546eac5\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.421757 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.421731 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" Sep 10 00:55:14.692524 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:14.692448 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r"] Sep 10 00:55:14.695698 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:55:14.695669 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2486d521_7105_45c6_a871_0a9b0546eac5.slice/crio-cd513840b9a9a382f82a55ef00fc7ae5deda0b070e1e92e411206480fe6d1186 WatchSource:0}: Error finding container cd513840b9a9a382f82a55ef00fc7ae5deda0b070e1e92e411206480fe6d1186: Status 404 returned error can't find the container with id cd513840b9a9a382f82a55ef00fc7ae5deda0b070e1e92e411206480fe6d1186 Sep 10 00:55:15.372621 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:15.372584 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" event={"ID":"2486d521-7105-45c6-a871-0a9b0546eac5","Type":"ContainerStarted","Data":"cd513840b9a9a382f82a55ef00fc7ae5deda0b070e1e92e411206480fe6d1186"} Sep 10 00:55:15.379019 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:15.378999 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:15.450060 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:15.450029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:16.277269 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:16.277230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:18.386298 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:18.386262 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" event={"ID":"2486d521-7105-45c6-a871-0a9b0546eac5","Type":"ContainerStarted","Data":"3c1cbdec083deb03c2ddd3850f582cd863c1892c429c593c510e6d2d5a2d44f8"} Sep 10 00:55:18.402821 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:18.402776 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-nr99r" podStartSLOduration=1.43857079 podStartE2EDuration="4.402762082s" totalImagesPullingTime="2.964191292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:18.401333301 +0000 UTC m=+298.692218487" watchObservedRunningTime="2026-09-10 00:55:18.402762082 +0000 UTC m=+298.693647303" Sep 10 00:55:20.112087 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.112041 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 00:55:20.112491 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.112057 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 00:55:20.114874 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.114854 2573 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 00:55:20.394036 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.393963 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:20.966592 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.966561 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz"] Sep 10 00:55:20.969454 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.969430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:20.972305 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.972283 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 00:55:20.972409 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.972330 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wwmbv\"" Sep 10 00:55:20.981926 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:20.981903 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz"] Sep 10 00:55:21.006793 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.006760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.006891 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.006809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.006891 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.006838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw6gj\" (UniqueName: \"kubernetes.io/projected/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-kube-api-access-nw6gj\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.006891 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.006865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.007009 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.006898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.007009 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.006948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.007009 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.007001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.007144 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.007039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.007144 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.007078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108086 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108037 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108191 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108091 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108191 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108191 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108310 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108203 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108310 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108310 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108455 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108455 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw6gj\" (UniqueName: \"kubernetes.io/projected/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-kube-api-access-nw6gj\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108557 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108486 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108706 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108686 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108795 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108774 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.108998 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.108969 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.109265 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.109242 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.110497 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.110474 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.110979 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.110959 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.122221 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.122202 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw6gj\" (UniqueName: \"kubernetes.io/projected/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-kube-api-access-nw6gj\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.122579 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.122494 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aac8806-bc43-4bb0-b18f-8f2b9f80a926-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777w9rhz\" (UID: \"4aac8806-bc43-4bb0-b18f-8f2b9f80a926\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.279742 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.279674 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:21.552941 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.552914 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz"] Sep 10 00:55:21.555085 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:55:21.555060 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aac8806_bc43_4bb0_b18f_8f2b9f80a926.slice/crio-df871f33f8d9340b418b0121cb2cb1e10566b026996a2fc2661694281147bc1d WatchSource:0}: Error finding container df871f33f8d9340b418b0121cb2cb1e10566b026996a2fc2661694281147bc1d: Status 404 returned error can't find the container with id df871f33f8d9340b418b0121cb2cb1e10566b026996a2fc2661694281147bc1d Sep 10 00:55:21.557097 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.557083 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:55:21.669362 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:21.669313 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:22.403799 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:22.403758 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" event={"ID":"4aac8806-bc43-4bb0-b18f-8f2b9f80a926","Type":"ContainerStarted","Data":"df871f33f8d9340b418b0121cb2cb1e10566b026996a2fc2661694281147bc1d"} Sep 10 00:55:24.557028 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:24.556962 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:55:24.557378 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:24.557105 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:55:24.557378 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:24.557138 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:55:24.905879 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:24.905842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:25.006236 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:25.006199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:25.108127 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:25.108088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:25.208799 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:25.208712 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:25.420573 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:25.420538 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" event={"ID":"4aac8806-bc43-4bb0-b18f-8f2b9f80a926","Type":"ContainerStarted","Data":"02b3027a0ed93f4c99d567fbdf521a33fe11280bed6652283bebd69ac172c5ab"} Sep 10 00:55:25.454832 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:25.454784 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" podStartSLOduration=2.455288953 podStartE2EDuration="5.454768916s" totalImagesPullingTime="2.999479963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:25.452876306 +0000 UTC m=+305.743761495" watchObservedRunningTime="2026-09-10 00:55:25.454768916 +0000 UTC m=+305.745654102" Sep 10 00:55:25.468668 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:25.468600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:25.732247 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:25.732172 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:26.280420 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:26.280379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:26.284742 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:26.284716 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:26.425723 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:26.425695 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:26.426856 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:26.426832 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777w9rhz" Sep 10 00:55:31.315011 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.314978 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm"] Sep 10 00:55:31.325725 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.325701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.328504 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.328481 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 00:55:31.328504 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.328498 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 00:55:31.328707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.328497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xntfg\"" Sep 10 00:55:31.332021 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.332000 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 00:55:31.333295 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.333003 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm"] Sep 10 00:55:31.385317 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.385296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.385429 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.385325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.385429 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.385343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db7p5\" (UniqueName: \"kubernetes.io/projected/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-kube-api-access-db7p5\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.385429 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.385362 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.385530 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.385443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.385530 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.385496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.385530 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.385525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.486734 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.486694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.486926 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.486744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.486926 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.486773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.486926 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.486790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.486926 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.486813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.486926 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.486836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db7p5\" (UniqueName: \"kubernetes.io/projected/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-kube-api-access-db7p5\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.486926 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.486866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.487877 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.487844 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.489699 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.489594 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.489809 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.489742 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.490476 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.490452 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.490658 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.490636 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.496640 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.496614 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db7p5\" (UniqueName: \"kubernetes.io/projected/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-kube-api-access-db7p5\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.496781 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.496760 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1c0a70-76fb-4d44-9ef2-d3ac222cf391-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t92vm\" (UID: \"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.636021 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.635934 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:31.911329 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:31.911263 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm"] Sep 10 00:55:31.914520 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:55:31.914489 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1c0a70_76fb_4d44_9ef2_d3ac222cf391.slice/crio-4366b55c4cf64284f29aa75380aeabcb9aa066638585c87d9d396eeb4b627f41 WatchSource:0}: Error finding container 4366b55c4cf64284f29aa75380aeabcb9aa066638585c87d9d396eeb4b627f41: Status 404 returned error can't find the container with id 4366b55c4cf64284f29aa75380aeabcb9aa066638585c87d9d396eeb4b627f41 Sep 10 00:55:32.452363 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:32.452329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" event={"ID":"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391","Type":"ContainerStarted","Data":"4366b55c4cf64284f29aa75380aeabcb9aa066638585c87d9d396eeb4b627f41"} Sep 10 00:55:33.960631 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:33.960591 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:34.112791 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:34.112745 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:34.239588 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:34.239483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:34.586185 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:34.586150 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:55:34.586312 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:34.586228 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:55:34.831754 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:34.831709 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:35.292099 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:35.292069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:35.394460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:35.394426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:35.468530 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:35.468501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" event={"ID":"5a1c0a70-76fb-4d44-9ef2-d3ac222cf391","Type":"ContainerStarted","Data":"218b252e3f5116d01e75f999558a8a6c0455a15ad15503542ecd5fef6bcc9dfa"} Sep 10 00:55:35.468694 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:35.468648 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:35.470170 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:35.470146 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" Sep 10 00:55:35.492876 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:35.492834 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t92vm" podStartSLOduration=1.823842012 podStartE2EDuration="4.492820412s" totalImagesPullingTime="2.6689784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:35.491613325 +0000 UTC m=+315.782498524" watchObservedRunningTime="2026-09-10 00:55:35.492820412 +0000 UTC m=+315.783705601" Sep 10 00:55:35.493686 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:35.493662 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:55:43.053437 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:55:43.053400 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:25.774613 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:25.774514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:25.873241 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:25.873208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:34.164105 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:34.164027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:34.268039 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:34.267998 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:34.508729 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:34.508610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:34.578102 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:34.578062 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:35.106261 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:35.106205 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:35.165098 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:35.165033 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:45.116576 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:45.116545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:45.174111 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:45.174081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:45.231067 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:45.231029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:48.121704 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:48.121672 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:48.859093 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:48.859039 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:48.961717 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:48.961685 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:49.683177 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:49.683142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:50.799098 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:50.799046 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:51.927452 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:51.927421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:52.030309 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.030272 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:52.641518 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.641489 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2"] Sep 10 00:56:52.644662 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.644640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:52.647327 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.647308 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 00:56:52.647434 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.647309 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 00:56:52.647434 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.647313 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vh4d4\"" Sep 10 00:56:52.657535 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.657512 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2"] Sep 10 00:56:52.712173 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.712150 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49h4\" (UniqueName: \"kubernetes.io/projected/46768564-573e-49a8-98c5-61aadf936304-kube-api-access-x49h4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:52.712274 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.712185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46768564-573e-49a8-98c5-61aadf936304-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:52.812664 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.812633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49h4\" (UniqueName: \"kubernetes.io/projected/46768564-573e-49a8-98c5-61aadf936304-kube-api-access-x49h4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:52.812664 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.812665 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46768564-573e-49a8-98c5-61aadf936304-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:52.813084 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.813045 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46768564-573e-49a8-98c5-61aadf936304-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:52.830624 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.830603 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49h4\" (UniqueName: \"kubernetes.io/projected/46768564-573e-49a8-98c5-61aadf936304-kube-api-access-x49h4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:52.954880 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:52.954807 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:53.227326 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:53.227235 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2"] Sep 10 00:56:53.231158 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:56:53.231133 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46768564_573e_49a8_98c5_61aadf936304.slice/crio-ef2eb61d2d64fae239c9137fee3543363985f0587ba6dc7c3e79263cfbd7c015 WatchSource:0}: Error finding container ef2eb61d2d64fae239c9137fee3543363985f0587ba6dc7c3e79263cfbd7c015: Status 404 returned error can't find the container with id ef2eb61d2d64fae239c9137fee3543363985f0587ba6dc7c3e79263cfbd7c015 Sep 10 00:56:53.291390 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:53.291366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:53.778573 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:53.778534 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" event={"ID":"46768564-573e-49a8-98c5-61aadf936304","Type":"ContainerStarted","Data":"ef2eb61d2d64fae239c9137fee3543363985f0587ba6dc7c3e79263cfbd7c015"} Sep 10 00:56:54.321652 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:54.321592 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:55.069079 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:55.069024 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:55.499102 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:55.499015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:57.348383 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:57.348345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:57.437504 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:57.437476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:58.087893 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:58.087855 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:56:58.806641 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:58.806549 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" event={"ID":"46768564-573e-49a8-98c5-61aadf936304","Type":"ContainerStarted","Data":"f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42"} Sep 10 00:56:58.807024 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:58.806666 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:56:58.826673 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:58.826589 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" podStartSLOduration=1.660192785 podStartE2EDuration="6.826572646s" totalImagesPullingTime="5.166379861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:56:58.825334856 +0000 UTC m=+399.116220043" watchObservedRunningTime="2026-09-10 00:56:58.826572646 +0000 UTC m=+399.117457828" Sep 10 00:56:59.127295 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:56:59.127261 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:01.179921 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:01.179881 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:01.579867 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:01.579836 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:03.083440 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:03.083404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:03.183997 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:03.183967 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:03.480505 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:03.480432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:03.531933 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:03.531906 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:03.878018 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:03.877981 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:03.934035 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:03.933995 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:09.582686 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:09.582652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:09.676823 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:09.676787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:09.813013 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:09.812983 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:57:11.460642 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.460610 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn"] Sep 10 00:57:11.463842 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.463822 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.483246 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.483215 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn"] Sep 10 00:57:11.570433 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.570396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hctxv\" (UniqueName: \"kubernetes.io/projected/9fa62217-fc2f-44e9-9800-49c71570a386-kube-api-access-hctxv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.570613 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.570447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa62217-fc2f-44e9-9800-49c71570a386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.670910 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.670874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa62217-fc2f-44e9-9800-49c71570a386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.671119 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.670977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hctxv\" (UniqueName: \"kubernetes.io/projected/9fa62217-fc2f-44e9-9800-49c71570a386-kube-api-access-hctxv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.671346 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.671326 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa62217-fc2f-44e9-9800-49c71570a386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.685830 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.685799 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hctxv\" (UniqueName: \"kubernetes.io/projected/9fa62217-fc2f-44e9-9800-49c71570a386-kube-api-access-hctxv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.778668 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.778575 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:11.951376 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.951335 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2"] Sep 10 00:57:11.951610 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.951571 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" podUID="46768564-573e-49a8-98c5-61aadf936304" containerName="manager" containerID="cri-o://f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42" gracePeriod=2 Sep 10 00:57:11.979893 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.979856 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2"] Sep 10 00:57:11.987122 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:11.987081 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"46768564-573e-49a8-98c5-61aadf936304\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\": pods \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:57:11.997641 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.997547 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn"] Sep 10 00:57:11.999501 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.999469 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s"] Sep 10 00:57:11.999903 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.999884 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46768564-573e-49a8-98c5-61aadf936304" containerName="manager" Sep 10 00:57:11.999941 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:11.999908 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46768564-573e-49a8-98c5-61aadf936304" containerName="manager" Sep 10 00:57:12.000029 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.000018 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46768564-573e-49a8-98c5-61aadf936304" containerName="manager" Sep 10 00:57:12.003263 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.003242 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.006666 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:12.006639 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" is forbidden: User \"system:node:ip-10-0-131-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-63.ec2.internal' and this object" podUID="46768564-573e-49a8-98c5-61aadf936304" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:57:12.023788 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.023732 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn"] Sep 10 00:57:12.026823 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.026798 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s"] Sep 10 00:57:12.044243 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.044164 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs"] Sep 10 00:57:12.047889 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.047857 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.055268 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:12.055234 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" is forbidden: User \"system:node:ip-10-0-131-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-63.ec2.internal' and this object" podUID="46768564-573e-49a8-98c5-61aadf936304" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:57:12.072923 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.072882 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs"] Sep 10 00:57:12.175640 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.175607 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-n47zs\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.175840 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.175661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7st8\" (UniqueName: \"kubernetes.io/projected/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-kube-api-access-c7st8\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-n47zs\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.175840 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.175712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-kube-api-access-5lmqc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zg52s\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.175840 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.175762 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zg52s\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.186431 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:12.186392 2573 log.go:32] "RunPodSandbox from runtime service failed" err=< Sep 10 00:57:12.186431 ip-10-0-131-63 kubenswrapper[2573]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-wrnhn_kuadrant-system_9fa62217-fc2f-44e9-9800-49c71570a386_0(8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-wrnhn to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0" Netns:"/var/run/netns/39618be9-c519-41a9-9edf-9459af9f1fef" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-wrnhn;K8S_POD_INFRA_CONTAINER_ID=8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0;K8S_POD_UID=9fa62217-fc2f-44e9-9800-49c71570a386" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn/9fa62217-fc2f-44e9-9800-49c71570a386:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn 8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:15 [10.134.0.21/23] Sep 10 00:57:12.186431 ip-10-0-131-63 kubenswrapper[2573]: ' Sep 10 00:57:12.186431 ip-10-0-131-63 kubenswrapper[2573]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Sep 10 00:57:12.186431 ip-10-0-131-63 kubenswrapper[2573]: > Sep 10 00:57:12.186728 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:12.186462 2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Sep 10 00:57:12.186728 ip-10-0-131-63 kubenswrapper[2573]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-wrnhn_kuadrant-system_9fa62217-fc2f-44e9-9800-49c71570a386_0(8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-wrnhn to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0" Netns:"/var/run/netns/39618be9-c519-41a9-9edf-9459af9f1fef" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-wrnhn;K8S_POD_INFRA_CONTAINER_ID=8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0;K8S_POD_UID=9fa62217-fc2f-44e9-9800-49c71570a386" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn/9fa62217-fc2f-44e9-9800-49c71570a386:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn 8b5fa9a92a7a83e8066b17ec6e9e74443c66310af0f759a8b759e59639a501d0 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:15 [10.134.0.21/23] Sep 10 00:57:12.186728 ip-10-0-131-63 kubenswrapper[2573]: ' Sep 10 00:57:12.186728 ip-10-0-131-63 kubenswrapper[2573]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Sep 10 00:57:12.186728 ip-10-0-131-63 kubenswrapper[2573]: > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:12.193292 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.193269 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:57:12.195698 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:12.195671 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-4s6s2\" is forbidden: User \"system:node:ip-10-0-131-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-63.ec2.internal' and this object" podUID="46768564-573e-49a8-98c5-61aadf936304" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:57:12.276922 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.276887 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x49h4\" (UniqueName: \"kubernetes.io/projected/46768564-573e-49a8-98c5-61aadf936304-kube-api-access-x49h4\") pod \"46768564-573e-49a8-98c5-61aadf936304\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " Sep 10 00:57:12.277148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.276985 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46768564-573e-49a8-98c5-61aadf936304-extensions-socket-volume\") pod \"46768564-573e-49a8-98c5-61aadf936304\" (UID: \"46768564-573e-49a8-98c5-61aadf936304\") " Sep 10 00:57:12.277148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.277069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zg52s\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.277148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.277118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-n47zs\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.277148 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.277145 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7st8\" (UniqueName: \"kubernetes.io/projected/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-kube-api-access-c7st8\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-n47zs\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.277369 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.277285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-kube-api-access-5lmqc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zg52s\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.277568 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.277537 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-n47zs\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.277568 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.277554 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46768564-573e-49a8-98c5-61aadf936304-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46768564-573e-49a8-98c5-61aadf936304" (UID: "46768564-573e-49a8-98c5-61aadf936304"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:57:12.277704 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.277543 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zg52s\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.279285 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.279265 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46768564-573e-49a8-98c5-61aadf936304-kube-api-access-x49h4" (OuterVolumeSpecName: "kube-api-access-x49h4") pod "46768564-573e-49a8-98c5-61aadf936304" (UID: "46768564-573e-49a8-98c5-61aadf936304"). InnerVolumeSpecName "kube-api-access-x49h4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:57:12.286313 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.286290 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7st8\" (UniqueName: \"kubernetes.io/projected/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-kube-api-access-c7st8\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-n47zs\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.286394 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.286347 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-kube-api-access-5lmqc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zg52s\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.331779 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.331747 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:12.362107 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.362067 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.378588 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.378556 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46768564-573e-49a8-98c5-61aadf936304-extensions-socket-volume\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:12.378740 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.378592 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x49h4\" (UniqueName: \"kubernetes.io/projected/46768564-573e-49a8-98c5-61aadf936304-kube-api-access-x49h4\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:12.606288 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.606261 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s"] Sep 10 00:57:12.609098 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:57:12.609066 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39de8b4_5a54_4f53_90b4_cd4cd93cc669.slice/crio-b12675a26dae89c6bd7a5991efa6cbac92178d84cebe33005ff7284f2cf126c6 WatchSource:0}: Error finding container b12675a26dae89c6bd7a5991efa6cbac92178d84cebe33005ff7284f2cf126c6: Status 404 returned error can't find the container with id b12675a26dae89c6bd7a5991efa6cbac92178d84cebe33005ff7284f2cf126c6 Sep 10 00:57:12.647144 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.647110 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs"] Sep 10 00:57:12.652034 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:57:12.652007 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0a5f24_4e7b_4b89_b416_8a4cbf5f2202.slice/crio-16e639d44ce744c2762d928eafe3e44a753c0638e125d99b7936fc3ca7f2fd27 WatchSource:0}: Error finding container 16e639d44ce744c2762d928eafe3e44a753c0638e125d99b7936fc3ca7f2fd27: Status 404 returned error can't find the container with id 16e639d44ce744c2762d928eafe3e44a753c0638e125d99b7936fc3ca7f2fd27 Sep 10 00:57:12.869638 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.869554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" event={"ID":"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202","Type":"ContainerStarted","Data":"04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b"} Sep 10 00:57:12.869638 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.869607 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" event={"ID":"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202","Type":"ContainerStarted","Data":"16e639d44ce744c2762d928eafe3e44a753c0638e125d99b7936fc3ca7f2fd27"} Sep 10 00:57:12.869875 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.869652 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:12.871251 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.871227 2573 generic.go:356] "Generic (PLEG): container finished" podID="46768564-573e-49a8-98c5-61aadf936304" containerID="f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42" exitCode=0 Sep 10 00:57:12.871381 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.871269 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4s6s2" Sep 10 00:57:12.871381 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.871315 2573 scope.go:117] "RemoveContainer" containerID="f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42" Sep 10 00:57:12.873259 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.873243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:12.873360 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.873288 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" event={"ID":"c39de8b4-5a54-4f53-90b4-cd4cd93cc669","Type":"ContainerStarted","Data":"36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8"} Sep 10 00:57:12.873360 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.873349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" event={"ID":"c39de8b4-5a54-4f53-90b4-cd4cd93cc669","Type":"ContainerStarted","Data":"b12675a26dae89c6bd7a5991efa6cbac92178d84cebe33005ff7284f2cf126c6"} Sep 10 00:57:12.881687 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.881668 2573 scope.go:117] "RemoveContainer" containerID="f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42" Sep 10 00:57:12.881762 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.881690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:12.881962 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:12.881946 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42\": container with ID starting with f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42 not found: ID does not exist" containerID="f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42" Sep 10 00:57:12.882011 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.881971 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42"} err="failed to get container status \"f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42\": rpc error: code = NotFound desc = could not find container \"f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42\": container with ID starting with f6f98df19783ae8e4d68564a48a952f9a11045a1feb729f39913be05317c5b42 not found: ID does not exist" Sep 10 00:57:12.893083 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.893025 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" podStartSLOduration=0.893011498 podStartE2EDuration="893.011498ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:12.891329438 +0000 UTC m=+413.182214627" watchObservedRunningTime="2026-09-10 00:57:12.893011498 +0000 UTC m=+413.183896687" Sep 10 00:57:12.893743 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:12.893721 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" is forbidden: User \"system:node:ip-10-0-131-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-63.ec2.internal' and this object" podUID="9fa62217-fc2f-44e9-9800-49c71570a386" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:12.914721 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.914662 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" podStartSLOduration=1.914641607 podStartE2EDuration="1.914641607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:12.914209993 +0000 UTC m=+413.205095204" watchObservedRunningTime="2026-09-10 00:57:12.914641607 +0000 UTC m=+413.205526814" Sep 10 00:57:12.985673 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.985636 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hctxv\" (UniqueName: \"kubernetes.io/projected/9fa62217-fc2f-44e9-9800-49c71570a386-kube-api-access-hctxv\") pod \"9fa62217-fc2f-44e9-9800-49c71570a386\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " Sep 10 00:57:12.985840 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.985709 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa62217-fc2f-44e9-9800-49c71570a386-extensions-socket-volume\") pod \"9fa62217-fc2f-44e9-9800-49c71570a386\" (UID: \"9fa62217-fc2f-44e9-9800-49c71570a386\") " Sep 10 00:57:12.986034 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.986008 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa62217-fc2f-44e9-9800-49c71570a386-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9fa62217-fc2f-44e9-9800-49c71570a386" (UID: "9fa62217-fc2f-44e9-9800-49c71570a386"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:57:12.987828 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:12.987807 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa62217-fc2f-44e9-9800-49c71570a386-kube-api-access-hctxv" (OuterVolumeSpecName: "kube-api-access-hctxv") pod "9fa62217-fc2f-44e9-9800-49c71570a386" (UID: "9fa62217-fc2f-44e9-9800-49c71570a386"). InnerVolumeSpecName "kube-api-access-hctxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:57:13.086951 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:13.086912 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hctxv\" (UniqueName: \"kubernetes.io/projected/9fa62217-fc2f-44e9-9800-49c71570a386-kube-api-access-hctxv\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:13.086951 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:13.086946 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa62217-fc2f-44e9-9800-49c71570a386-extensions-socket-volume\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:13.879259 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:13.879229 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:13.879668 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:13.879499 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:13.881849 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:13.881824 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" is forbidden: User \"system:node:ip-10-0-131-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-63.ec2.internal' and this object" podUID="9fa62217-fc2f-44e9-9800-49c71570a386" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:13.887328 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:13.887301 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-wrnhn\" is forbidden: User \"system:node:ip-10-0-131-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-63.ec2.internal' and this object" podUID="9fa62217-fc2f-44e9-9800-49c71570a386" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-wrnhn" Sep 10 00:57:14.214267 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:14.214191 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46768564-573e-49a8-98c5-61aadf936304" path="/var/lib/kubelet/pods/46768564-573e-49a8-98c5-61aadf936304/volumes" Sep 10 00:57:14.214556 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:14.214543 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa62217-fc2f-44e9-9800-49c71570a386" path="/var/lib/kubelet/pods/9fa62217-fc2f-44e9-9800-49c71570a386/volumes" Sep 10 00:57:16.105837 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:16.105799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:16.206694 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:16.206657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:16.946961 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:16.946925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:17.060671 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:17.060628 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:19.103799 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:19.103767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:19.208885 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:19.208842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:23.881146 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:23.881116 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:23.931229 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:23.931202 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s"] Sep 10 00:57:23.931436 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:23.931412 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" podUID="c39de8b4-5a54-4f53-90b4-cd4cd93cc669" containerName="manager" containerID="cri-o://36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8" gracePeriod=10 Sep 10 00:57:23.933169 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:23.933142 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:24.170645 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.170621 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:24.178580 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.178559 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-kube-api-access-5lmqc\") pod \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " Sep 10 00:57:24.178693 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.178587 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-extensions-socket-volume\") pod \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\" (UID: \"c39de8b4-5a54-4f53-90b4-cd4cd93cc669\") " Sep 10 00:57:24.178973 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.178952 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c39de8b4-5a54-4f53-90b4-cd4cd93cc669" (UID: "c39de8b4-5a54-4f53-90b4-cd4cd93cc669"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:57:24.180490 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.180468 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-kube-api-access-5lmqc" (OuterVolumeSpecName: "kube-api-access-5lmqc") pod "c39de8b4-5a54-4f53-90b4-cd4cd93cc669" (UID: "c39de8b4-5a54-4f53-90b4-cd4cd93cc669"). InnerVolumeSpecName "kube-api-access-5lmqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:57:24.240102 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.240074 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j"] Sep 10 00:57:24.240361 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.240342 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c39de8b4-5a54-4f53-90b4-cd4cd93cc669" containerName="manager" Sep 10 00:57:24.240361 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.240357 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c39de8b4-5a54-4f53-90b4-cd4cd93cc669" containerName="manager" Sep 10 00:57:24.240443 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.240416 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c39de8b4-5a54-4f53-90b4-cd4cd93cc669" containerName="manager" Sep 10 00:57:24.243073 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.243043 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.268135 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.268108 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j"] Sep 10 00:57:24.279299 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.279275 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8615660-35d6-4dca-a35f-e64204d0abe9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qpp4j\" (UID: \"b8615660-35d6-4dca-a35f-e64204d0abe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.279396 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.279313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frwkb\" (UniqueName: \"kubernetes.io/projected/b8615660-35d6-4dca-a35f-e64204d0abe9-kube-api-access-frwkb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qpp4j\" (UID: \"b8615660-35d6-4dca-a35f-e64204d0abe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.279446 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.279427 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-kube-api-access-5lmqc\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:24.279485 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.279452 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c39de8b4-5a54-4f53-90b4-cd4cd93cc669-extensions-socket-volume\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:24.353451 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.353423 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:24.380570 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.380544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8615660-35d6-4dca-a35f-e64204d0abe9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qpp4j\" (UID: \"b8615660-35d6-4dca-a35f-e64204d0abe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.380649 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.380580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frwkb\" (UniqueName: \"kubernetes.io/projected/b8615660-35d6-4dca-a35f-e64204d0abe9-kube-api-access-frwkb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qpp4j\" (UID: \"b8615660-35d6-4dca-a35f-e64204d0abe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.380881 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.380865 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8615660-35d6-4dca-a35f-e64204d0abe9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qpp4j\" (UID: \"b8615660-35d6-4dca-a35f-e64204d0abe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.394310 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.394285 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frwkb\" (UniqueName: \"kubernetes.io/projected/b8615660-35d6-4dca-a35f-e64204d0abe9-kube-api-access-frwkb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qpp4j\" (UID: \"b8615660-35d6-4dca-a35f-e64204d0abe9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.456495 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.456432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:24.552910 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.552880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.729581 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.729500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:24.824558 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.824437 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j"] Sep 10 00:57:24.826829 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:57:24.826804 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8615660_35d6_4dca_a35f_e64204d0abe9.slice/crio-6ca706213d2e708aa7806789f134193f121b8e13bc627d27f9919fca68d9d896 WatchSource:0}: Error finding container 6ca706213d2e708aa7806789f134193f121b8e13bc627d27f9919fca68d9d896: Status 404 returned error can't find the container with id 6ca706213d2e708aa7806789f134193f121b8e13bc627d27f9919fca68d9d896 Sep 10 00:57:24.827747 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.827724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:24.917925 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.917903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:24.925752 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.925731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" event={"ID":"b8615660-35d6-4dca-a35f-e64204d0abe9","Type":"ContainerStarted","Data":"a0a3dfaedd7578268c45e7a4b3d77e3283a6750e4128477c60b47454dbb1a71f"} Sep 10 00:57:24.925856 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.925784 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" event={"ID":"b8615660-35d6-4dca-a35f-e64204d0abe9","Type":"ContainerStarted","Data":"6ca706213d2e708aa7806789f134193f121b8e13bc627d27f9919fca68d9d896"} Sep 10 00:57:24.925856 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.925814 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:24.927086 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.927061 2573 generic.go:356] "Generic (PLEG): container finished" podID="c39de8b4-5a54-4f53-90b4-cd4cd93cc669" containerID="36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8" exitCode=0 Sep 10 00:57:24.927162 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.927092 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" Sep 10 00:57:24.927162 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.927106 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" event={"ID":"c39de8b4-5a54-4f53-90b4-cd4cd93cc669","Type":"ContainerDied","Data":"36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8"} Sep 10 00:57:24.927162 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.927137 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s" event={"ID":"c39de8b4-5a54-4f53-90b4-cd4cd93cc669","Type":"ContainerDied","Data":"b12675a26dae89c6bd7a5991efa6cbac92178d84cebe33005ff7284f2cf126c6"} Sep 10 00:57:24.927333 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.927164 2573 scope.go:117] "RemoveContainer" containerID="36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8" Sep 10 00:57:24.934517 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.934416 2573 scope.go:117] "RemoveContainer" containerID="36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8" Sep 10 00:57:24.934711 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:24.934694 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8\": container with ID starting with 36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8 not found: ID does not exist" containerID="36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8" Sep 10 00:57:24.934763 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.934721 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8"} err="failed to get container status \"36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8\": rpc error: code = NotFound desc = could not find container \"36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8\": container with ID starting with 36a5ad43b317b25552f9aac762303af3a341d36fc8bf32fd9ee4ec17fe0ac1a8 not found: ID does not exist" Sep 10 00:57:24.946611 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.946571 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" podStartSLOduration=0.946559576 podStartE2EDuration="946.559576ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:24.945254504 +0000 UTC m=+425.236139693" watchObservedRunningTime="2026-09-10 00:57:24.946559576 +0000 UTC m=+425.237444763" Sep 10 00:57:24.963674 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.963655 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s"] Sep 10 00:57:24.969531 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:24.969513 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zg52s"] Sep 10 00:57:25.022460 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:25.022406 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:26.213971 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:26.213936 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c39de8b4-5a54-4f53-90b4-cd4cd93cc669" path="/var/lib/kubelet/pods/c39de8b4-5a54-4f53-90b4-cd4cd93cc669/volumes" Sep 10 00:57:31.355757 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:31.355727 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:31.453461 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:31.453434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:35.935131 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:35.935099 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qpp4j" Sep 10 00:57:35.985605 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:35.985575 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs"] Sep 10 00:57:35.985795 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:35.985770 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" podUID="ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" containerName="manager" containerID="cri-o://04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b" gracePeriod=10 Sep 10 00:57:36.229761 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.229737 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:36.263021 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.262991 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7st8\" (UniqueName: \"kubernetes.io/projected/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-kube-api-access-c7st8\") pod \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " Sep 10 00:57:36.263188 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.263035 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-extensions-socket-volume\") pod \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\" (UID: \"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202\") " Sep 10 00:57:36.263502 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.263473 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" (UID: "ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:57:36.265058 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.265018 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-kube-api-access-c7st8" (OuterVolumeSpecName: "kube-api-access-c7st8") pod "ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" (UID: "ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202"). InnerVolumeSpecName "kube-api-access-c7st8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:57:36.363602 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.363574 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7st8\" (UniqueName: \"kubernetes.io/projected/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-kube-api-access-c7st8\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:36.363602 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.363597 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202-extensions-socket-volume\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:57:36.982449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.982409 2573 generic.go:356] "Generic (PLEG): container finished" podID="ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" containerID="04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b" exitCode=0 Sep 10 00:57:36.982873 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.982473 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" Sep 10 00:57:36.982873 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.982494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" event={"ID":"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202","Type":"ContainerDied","Data":"04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b"} Sep 10 00:57:36.982873 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.982570 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs" event={"ID":"ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202","Type":"ContainerDied","Data":"16e639d44ce744c2762d928eafe3e44a753c0638e125d99b7936fc3ca7f2fd27"} Sep 10 00:57:36.982873 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.982593 2573 scope.go:117] "RemoveContainer" containerID="04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b" Sep 10 00:57:36.991322 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.991175 2573 scope.go:117] "RemoveContainer" containerID="04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b" Sep 10 00:57:36.991463 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:57:36.991442 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b\": container with ID starting with 04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b not found: ID does not exist" containerID="04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b" Sep 10 00:57:36.991520 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:36.991473 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b"} err="failed to get container status \"04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b\": rpc error: code = NotFound desc = could not find container \"04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b\": container with ID starting with 04b47e348f9c971a57bc1194b25b2c09d9bc0527474bc1109610cdeb7255296b not found: ID does not exist" Sep 10 00:57:37.004497 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:37.004477 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs"] Sep 10 00:57:37.007835 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:37.007816 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-n47zs"] Sep 10 00:57:37.911122 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:37.911083 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:38.011469 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:38.011440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:38.215078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:38.214990 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" path="/var/lib/kubelet/pods/ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202/volumes" Sep 10 00:57:40.289882 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.289483 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q"] Sep 10 00:57:40.289882 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.289880 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" containerName="manager" Sep 10 00:57:40.290424 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.289896 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" containerName="manager" Sep 10 00:57:40.290424 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.289961 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea0a5f24-4e7b-4b89-b416-8a4cbf5f2202" containerName="manager" Sep 10 00:57:40.292930 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.292905 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.295604 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.295581 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zg9kk\"" Sep 10 00:57:40.305125 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.305103 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q"] Sep 10 00:57:40.318953 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.318928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:40.389852 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.389822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-data\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390035 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.389861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390035 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.389890 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-token\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390035 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.389934 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksnvb\" (UniqueName: \"kubernetes.io/projected/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-kube-api-access-ksnvb\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390218 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.390038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390218 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.390149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-workload-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390218 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.390174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390354 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.390222 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-workload-certs\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.390354 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.390283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-credential-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491210 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491173 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksnvb\" (UniqueName: \"kubernetes.io/projected/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-kube-api-access-ksnvb\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491210 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491210 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-workload-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491253 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-workload-certs\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-credential-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-data\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-token\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491804 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491635 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-workload-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491804 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491657 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-workload-certs\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491804 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491731 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-credential-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.491958 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.491910 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-data\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.492258 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.492243 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.493736 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.493716 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.494027 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.494005 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.499045 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.499021 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-istio-token\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.499213 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.499192 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksnvb\" (UniqueName: \"kubernetes.io/projected/ec5b6592-1e49-430f-913f-d4ba2c3d0ca8-kube-api-access-ksnvb\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-xqd8q\" (UID: \"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.605474 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.605446 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:40.651379 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.651342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:40.881265 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.881079 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q"] Sep 10 00:57:40.884091 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:57:40.884060 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5b6592_1e49_430f_913f_d4ba2c3d0ca8.slice/crio-81e0d2fcb10663a90f912b8617a8f7c9ad927ff95b86705315ed7922600a56e3 WatchSource:0}: Error finding container 81e0d2fcb10663a90f912b8617a8f7c9ad927ff95b86705315ed7922600a56e3: Status 404 returned error can't find the container with id 81e0d2fcb10663a90f912b8617a8f7c9ad927ff95b86705315ed7922600a56e3 Sep 10 00:57:40.886095 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.886061 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:57:40.886184 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.886126 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:57:40.886184 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.886154 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:57:40.905401 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:40.905375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:41.003433 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:41.003397 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" event={"ID":"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8","Type":"ContainerStarted","Data":"c3ec10a5e2dbb5305d97ea06a1e2ac69e97ba719278befe84145e0f45cdbb1da"} Sep 10 00:57:41.003594 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:41.003501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" event={"ID":"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8","Type":"ContainerStarted","Data":"81e0d2fcb10663a90f912b8617a8f7c9ad927ff95b86705315ed7922600a56e3"} Sep 10 00:57:41.033599 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:41.033565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:41.042081 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:41.042021 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" podStartSLOduration=1.042005153 podStartE2EDuration="1.042005153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:41.039553773 +0000 UTC m=+441.330438962" watchObservedRunningTime="2026-09-10 00:57:41.042005153 +0000 UTC m=+441.332890340" Sep 10 00:57:41.606594 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:41.606562 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:41.611291 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:41.611266 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:42.007531 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:42.007448 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:42.008352 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:42.008335 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:57:47.737272 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:47.737234 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:47.840078 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:47.840018 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:53.285521 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.285485 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-sfrx9"] Sep 10 00:57:53.287713 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.287690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.290231 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.290208 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 00:57:53.290356 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.290272 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mw498\"" Sep 10 00:57:53.296573 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.296550 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-sfrx9"] Sep 10 00:57:53.298504 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.298486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:53.386283 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.386249 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-sfrx9"] Sep 10 00:57:53.392026 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.391998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-config-file\") pod \"limitador-limitador-8588749977-sfrx9\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.392166 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.392104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxjgj\" (UniqueName: \"kubernetes.io/projected/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-kube-api-access-gxjgj\") pod \"limitador-limitador-8588749977-sfrx9\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.442883 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.442856 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:53.492884 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.492855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjgj\" (UniqueName: \"kubernetes.io/projected/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-kube-api-access-gxjgj\") pod \"limitador-limitador-8588749977-sfrx9\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.493044 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.492908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-config-file\") pod \"limitador-limitador-8588749977-sfrx9\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.493542 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.493523 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-config-file\") pod \"limitador-limitador-8588749977-sfrx9\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.502242 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.502218 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxjgj\" (UniqueName: \"kubernetes.io/projected/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-kube-api-access-gxjgj\") pod \"limitador-limitador-8588749977-sfrx9\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.543634 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.543563 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:53.598253 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.598228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:53.864799 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:53.864774 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-sfrx9"] Sep 10 00:57:53.867590 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:57:53.867561 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efed6bb_5bf1_4545_ab7c_1a46239c9d82.slice/crio-46a32c0781f655c8506a5648004ddf716bad3cd33503c8b3bc04222b8e4030c9 WatchSource:0}: Error finding container 46a32c0781f655c8506a5648004ddf716bad3cd33503c8b3bc04222b8e4030c9: Status 404 returned error can't find the container with id 46a32c0781f655c8506a5648004ddf716bad3cd33503c8b3bc04222b8e4030c9 Sep 10 00:57:54.065554 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:54.065516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" event={"ID":"6efed6bb-5bf1-4545-ab7c-1a46239c9d82","Type":"ContainerStarted","Data":"46a32c0781f655c8506a5648004ddf716bad3cd33503c8b3bc04222b8e4030c9"} Sep 10 00:57:54.098834 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:54.098799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:54.193452 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:54.193353 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:57:56.075280 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:56.075246 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" event={"ID":"6efed6bb-5bf1-4545-ab7c-1a46239c9d82","Type":"ContainerStarted","Data":"9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837"} Sep 10 00:57:56.075669 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:56.075383 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:57:56.093394 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:57:56.093324 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" podStartSLOduration=1.817085397 podStartE2EDuration="3.093308708s" totalImagesPullingTime="1.276223311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:56.093006281 +0000 UTC m=+456.383891469" watchObservedRunningTime="2026-09-10 00:57:56.093308708 +0000 UTC m=+456.384193896" Sep 10 00:58:07.081022 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:07.080987 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:58:07.999427 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:07.999393 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-sfrx9"] Sep 10 00:58:07.999637 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:07.999590 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" podUID="6efed6bb-5bf1-4545-ab7c-1a46239c9d82" containerName="limitador" containerID="cri-o://9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837" gracePeriod=30 Sep 10 00:58:08.531600 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:08.531577 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:58:08.621436 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:08.621406 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-config-file\") pod \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " Sep 10 00:58:08.621596 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:08.621458 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxjgj\" (UniqueName: \"kubernetes.io/projected/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-kube-api-access-gxjgj\") pod \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\" (UID: \"6efed6bb-5bf1-4545-ab7c-1a46239c9d82\") " Sep 10 00:58:08.621727 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:08.621706 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-config-file" (OuterVolumeSpecName: "config-file") pod "6efed6bb-5bf1-4545-ab7c-1a46239c9d82" (UID: "6efed6bb-5bf1-4545-ab7c-1a46239c9d82"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:58:08.623397 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:08.623368 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-kube-api-access-gxjgj" (OuterVolumeSpecName: "kube-api-access-gxjgj") pod "6efed6bb-5bf1-4545-ab7c-1a46239c9d82" (UID: "6efed6bb-5bf1-4545-ab7c-1a46239c9d82"). InnerVolumeSpecName "kube-api-access-gxjgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:58:08.722207 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:08.722178 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxjgj\" (UniqueName: \"kubernetes.io/projected/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-kube-api-access-gxjgj\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:58:08.722207 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:08.722203 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6efed6bb-5bf1-4545-ab7c-1a46239c9d82-config-file\") on node \"ip-10-0-131-63.ec2.internal\" DevicePath \"\"" Sep 10 00:58:09.130740 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.130705 2573 generic.go:356] "Generic (PLEG): container finished" podID="6efed6bb-5bf1-4545-ab7c-1a46239c9d82" containerID="9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837" exitCode=0 Sep 10 00:58:09.130901 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.130751 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" Sep 10 00:58:09.130901 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.130788 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" event={"ID":"6efed6bb-5bf1-4545-ab7c-1a46239c9d82","Type":"ContainerDied","Data":"9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837"} Sep 10 00:58:09.130901 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.130847 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-sfrx9" event={"ID":"6efed6bb-5bf1-4545-ab7c-1a46239c9d82","Type":"ContainerDied","Data":"46a32c0781f655c8506a5648004ddf716bad3cd33503c8b3bc04222b8e4030c9"} Sep 10 00:58:09.130901 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.130869 2573 scope.go:117] "RemoveContainer" containerID="9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837" Sep 10 00:58:09.138895 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.138880 2573 scope.go:117] "RemoveContainer" containerID="9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837" Sep 10 00:58:09.139186 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:58:09.139160 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837\": container with ID starting with 9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837 not found: ID does not exist" containerID="9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837" Sep 10 00:58:09.139294 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.139194 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837"} err="failed to get container status \"9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837\": rpc error: code = NotFound desc = could not find container \"9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837\": container with ID starting with 9976a8707191b1f15debf37995745f07fb7e09353466d714a3e297c551561837 not found: ID does not exist" Sep 10 00:58:09.150946 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.150923 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-sfrx9"] Sep 10 00:58:09.154764 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:09.154745 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-sfrx9"] Sep 10 00:58:10.220969 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:10.220927 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6efed6bb-5bf1-4545-ab7c-1a46239c9d82" path="/var/lib/kubelet/pods/6efed6bb-5bf1-4545-ab7c-1a46239c9d82/volumes" Sep 10 00:58:13.511420 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.511380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:13.611166 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.611137 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:13.950765 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.950734 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vctrj"] Sep 10 00:58:13.951064 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.951037 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efed6bb-5bf1-4545-ab7c-1a46239c9d82" containerName="limitador" Sep 10 00:58:13.951121 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.951068 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efed6bb-5bf1-4545-ab7c-1a46239c9d82" containerName="limitador" Sep 10 00:58:13.951157 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.951122 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6efed6bb-5bf1-4545-ab7c-1a46239c9d82" containerName="limitador" Sep 10 00:58:13.953214 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.953194 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:13.955878 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.955850 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 00:58:13.956001 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.955886 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-8vcsb\"" Sep 10 00:58:13.956001 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.955862 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 00:58:13.957043 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.957030 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 00:58:13.961995 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.961971 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vctrj"] Sep 10 00:58:13.978432 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:13.978394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:14.065856 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.065823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x65sv\" (UniqueName: \"kubernetes.io/projected/713ddcff-489a-4a09-93b4-3a6c03706f77-kube-api-access-x65sv\") pod \"postgres-69fb4594cf-vctrj\" (UID: \"713ddcff-489a-4a09-93b4-3a6c03706f77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:14.066017 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.065927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/713ddcff-489a-4a09-93b4-3a6c03706f77-data\") pod \"postgres-69fb4594cf-vctrj\" (UID: \"713ddcff-489a-4a09-93b4-3a6c03706f77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:14.166364 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.166331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/713ddcff-489a-4a09-93b4-3a6c03706f77-data\") pod \"postgres-69fb4594cf-vctrj\" (UID: \"713ddcff-489a-4a09-93b4-3a6c03706f77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:14.166590 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.166384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x65sv\" (UniqueName: \"kubernetes.io/projected/713ddcff-489a-4a09-93b4-3a6c03706f77-kube-api-access-x65sv\") pod \"postgres-69fb4594cf-vctrj\" (UID: \"713ddcff-489a-4a09-93b4-3a6c03706f77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:14.166746 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.166726 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/713ddcff-489a-4a09-93b4-3a6c03706f77-data\") pod \"postgres-69fb4594cf-vctrj\" (UID: \"713ddcff-489a-4a09-93b4-3a6c03706f77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:14.176535 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.176502 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x65sv\" (UniqueName: \"kubernetes.io/projected/713ddcff-489a-4a09-93b4-3a6c03706f77-kube-api-access-x65sv\") pod \"postgres-69fb4594cf-vctrj\" (UID: \"713ddcff-489a-4a09-93b4-3a6c03706f77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:14.264920 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.264842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:14.532431 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:14.532408 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vctrj"] Sep 10 00:58:14.535001 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:58:14.534975 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713ddcff_489a_4a09_93b4_3a6c03706f77.slice/crio-21d983467626878d868cb6e2f8a6501eb1a9ecd007201d59857bead470e5e6cf WatchSource:0}: Error finding container 21d983467626878d868cb6e2f8a6501eb1a9ecd007201d59857bead470e5e6cf: Status 404 returned error can't find the container with id 21d983467626878d868cb6e2f8a6501eb1a9ecd007201d59857bead470e5e6cf Sep 10 00:58:15.160449 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:15.160415 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" event={"ID":"713ddcff-489a-4a09-93b4-3a6c03706f77","Type":"ContainerStarted","Data":"21d983467626878d868cb6e2f8a6501eb1a9ecd007201d59857bead470e5e6cf"} Sep 10 00:58:20.192694 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:20.192662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" event={"ID":"713ddcff-489a-4a09-93b4-3a6c03706f77","Type":"ContainerStarted","Data":"b30a4e305210a12747f25ebc3bf28e0b628c07311b8a1ca7cdd190c431fef10d"} Sep 10 00:58:20.193088 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:20.192753 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:20.211659 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:20.211601 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" podStartSLOduration=2.409022025 podStartE2EDuration="7.211582908s" totalImagesPullingTime="4.802560883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:58:20.210351332 +0000 UTC m=+480.501236519" watchObservedRunningTime="2026-09-10 00:58:20.211582908 +0000 UTC m=+480.502468096" Sep 10 00:58:26.225456 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:26.225429 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vctrj" Sep 10 00:58:26.547004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:26.546901 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:26.923665 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:26.923619 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:33.919887 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:33.919856 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:33.992233 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:33.992195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:34.049734 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:34.049707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:34.137011 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:34.136976 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:34.436410 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:34.436381 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:37.610491 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:37.610457 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:37.675158 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:37.675125 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:47.911509 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:47.911473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:58:48.012659 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:58:48.012628 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:09.192315 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:09.192257 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:09.290616 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:09.290579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:10.539009 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:10.538975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:10.639929 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:10.639897 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:10.797502 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:10.797414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:11.032793 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.032750 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:11.132908 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.132875 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97"] Sep 10 00:59:11.135187 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.135172 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.138467 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.138442 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 00:59:11.138595 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.138473 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xkrnh\"" Sep 10 00:59:11.146866 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.146844 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97"] Sep 10 00:59:11.214916 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.214879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22z9t\" (UniqueName: \"kubernetes.io/projected/a5a09bf4-5c8c-4030-9500-84d8b80d69e3-kube-api-access-22z9t\") pod \"payload-pre-processing-59fbc47bf8-2sl97\" (UID: \"a5a09bf4-5c8c-4030-9500-84d8b80d69e3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.215103 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.214929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5a09bf4-5c8c-4030-9500-84d8b80d69e3-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2sl97\" (UID: \"a5a09bf4-5c8c-4030-9500-84d8b80d69e3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.287950 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.287918 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:11.315312 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.315290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5a09bf4-5c8c-4030-9500-84d8b80d69e3-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2sl97\" (UID: \"a5a09bf4-5c8c-4030-9500-84d8b80d69e3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.315526 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.315489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22z9t\" (UniqueName: \"kubernetes.io/projected/a5a09bf4-5c8c-4030-9500-84d8b80d69e3-kube-api-access-22z9t\") pod \"payload-pre-processing-59fbc47bf8-2sl97\" (UID: \"a5a09bf4-5c8c-4030-9500-84d8b80d69e3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.316007 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.315987 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5a09bf4-5c8c-4030-9500-84d8b80d69e3-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2sl97\" (UID: \"a5a09bf4-5c8c-4030-9500-84d8b80d69e3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.324262 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.324241 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22z9t\" (UniqueName: \"kubernetes.io/projected/a5a09bf4-5c8c-4030-9500-84d8b80d69e3-kube-api-access-22z9t\") pod \"payload-pre-processing-59fbc47bf8-2sl97\" (UID: \"a5a09bf4-5c8c-4030-9500-84d8b80d69e3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.388042 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.387962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:11.446665 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.446637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:11.713352 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:11.713328 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97"] Sep 10 00:59:11.715763 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:59:11.715730 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a09bf4_5c8c_4030_9500_84d8b80d69e3.slice/crio-40d8ff739e3b1d409fda222878bd1ad8df271b732b413e4eefa1850be72d5c70 WatchSource:0}: Error finding container 40d8ff739e3b1d409fda222878bd1ad8df271b732b413e4eefa1850be72d5c70: Status 404 returned error can't find the container with id 40d8ff739e3b1d409fda222878bd1ad8df271b732b413e4eefa1850be72d5c70 Sep 10 00:59:12.404083 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:12.403987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" event={"ID":"a5a09bf4-5c8c-4030-9500-84d8b80d69e3","Type":"ContainerStarted","Data":"40d8ff739e3b1d409fda222878bd1ad8df271b732b413e4eefa1850be72d5c70"} Sep 10 00:59:14.414335 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:14.414303 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" event={"ID":"a5a09bf4-5c8c-4030-9500-84d8b80d69e3","Type":"ContainerStarted","Data":"e5ed08d4481f79a0aaae3b3ac004545b3b8b7a57475c05ccd60f8d20e93911ec"} Sep 10 00:59:14.414757 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:14.414413 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:14.432138 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:14.432088 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" podStartSLOduration=1.440745625 podStartE2EDuration="3.432068079s" totalImagesPullingTime="1.991322454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:59:14.429815801 +0000 UTC m=+534.720700988" watchObservedRunningTime="2026-09-10 00:59:14.432068079 +0000 UTC m=+534.722953259" Sep 10 00:59:21.446064 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.446017 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec5b6592-1e49-430f-913f-d4ba2c3d0ca8" containerID="c3ec10a5e2dbb5305d97ea06a1e2ac69e97ba719278befe84145e0f45cdbb1da" exitCode=0 Sep 10 00:59:21.446441 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.446076 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" event={"ID":"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8","Type":"ContainerDied","Data":"c3ec10a5e2dbb5305d97ea06a1e2ac69e97ba719278befe84145e0f45cdbb1da"} Sep 10 00:59:21.446441 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.446387 2573 scope.go:117] "RemoveContainer" containerID="c3ec10a5e2dbb5305d97ea06a1e2ac69e97ba719278befe84145e0f45cdbb1da" Sep 10 00:59:21.447305 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.447277 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:59:21.447408 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.447354 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:59:21.447408 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.447399 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 00:59:21.743303 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.743227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:21.842236 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:21.842169 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:22.455339 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:22.455301 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" event={"ID":"ec5b6592-1e49-430f-913f-d4ba2c3d0ca8","Type":"ContainerStarted","Data":"170d120a17b26bd32232d6a5407aedbe1ceaca5c974bd224836d1d552c8280d2"} Sep 10 00:59:22.606675 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:22.606645 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:59:22.607732 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:22.607698 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 10 00:59:22.607877 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:22.607764 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" podUID="ec5b6592-1e49-430f-913f-d4ba2c3d0ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 10 00:59:23.606895 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:23.606857 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 10 00:59:23.607383 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:23.606919 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" podUID="ec5b6592-1e49-430f-913f-d4ba2c3d0ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 10 00:59:24.606129 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:24.606090 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 10 00:59:24.606305 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:24.606151 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" podUID="ec5b6592-1e49-430f-913f-d4ba2c3d0ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 10 00:59:25.421060 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:25.421015 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2sl97" Sep 10 00:59:25.606042 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:25.606009 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 10 00:59:25.606217 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:25.606083 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" podUID="ec5b6592-1e49-430f-913f-d4ba2c3d0ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 10 00:59:26.606868 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:26.606825 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 10 00:59:26.607349 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:26.606897 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" podUID="ec5b6592-1e49-430f-913f-d4ba2c3d0ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 10 00:59:27.008339 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:27.008253 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:59:27.610443 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:27.610416 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:59:27.611461 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:27.611442 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-xqd8q" Sep 10 00:59:30.202150 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.202116 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8"] Sep 10 00:59:30.205376 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.205359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.209347 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.209322 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sbt7f\"" Sep 10 00:59:30.209661 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.209326 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 00:59:30.209661 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.209418 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 00:59:30.209661 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.209456 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 00:59:30.216580 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.216555 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8"] Sep 10 00:59:30.231818 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.231796 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:30.300221 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.300187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.300404 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.300387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.300476 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.300463 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.300531 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.300515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.300587 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.300546 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.300648 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.300589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr7mz\" (UniqueName: \"kubernetes.io/projected/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-kube-api-access-rr7mz\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.401908 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.401874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.401908 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.401906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.402171 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.401936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr7mz\" (UniqueName: \"kubernetes.io/projected/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-kube-api-access-rr7mz\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.402171 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.401976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.402171 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.401994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.402171 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.402033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.402372 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.402349 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.402442 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.402421 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.402501 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.402484 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.404232 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.404200 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.404561 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.404542 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.410358 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.410312 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr7mz\" (UniqueName: \"kubernetes.io/projected/1248514a-4eaf-4f7e-a8ec-4a0017ae273d-kube-api-access-rr7mz\") pod \"e2e-distinct-2-simulated-kserve-859856b874-ptzl8\" (UID: \"1248514a-4eaf-4f7e-a8ec-4a0017ae273d\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.517806 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.517728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:30.786855 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:30.786830 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8"] Sep 10 00:59:30.789346 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:59:30.789319 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1248514a_4eaf_4f7e_a8ec_4a0017ae273d.slice/crio-95a1e8fda126607e1fe15ceebeaecf9e0cf024ff1de76815406d3cf8739bb5ef WatchSource:0}: Error finding container 95a1e8fda126607e1fe15ceebeaecf9e0cf024ff1de76815406d3cf8739bb5ef: Status 404 returned error can't find the container with id 95a1e8fda126607e1fe15ceebeaecf9e0cf024ff1de76815406d3cf8739bb5ef Sep 10 00:59:31.495864 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:31.495824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" event={"ID":"1248514a-4eaf-4f7e-a8ec-4a0017ae273d","Type":"ContainerStarted","Data":"95a1e8fda126607e1fe15ceebeaecf9e0cf024ff1de76815406d3cf8739bb5ef"} Sep 10 00:59:32.506772 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:32.506735 2573 generic.go:356] "Generic (PLEG): container finished" podID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" containerID="359e4275dab66ffe0c07988ab95cdaac0db0c5bf85571ba437699d498ef797fd" exitCode=0 Sep 10 00:59:32.506772 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:32.506770 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" event={"ID":"1248514a-4eaf-4f7e-a8ec-4a0017ae273d","Type":"ContainerDied","Data":"359e4275dab66ffe0c07988ab95cdaac0db0c5bf85571ba437699d498ef797fd"} Sep 10 00:59:32.507242 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:32.507044 2573 scope.go:117] "RemoveContainer" containerID="359e4275dab66ffe0c07988ab95cdaac0db0c5bf85571ba437699d498ef797fd" Sep 10 00:59:33.513253 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:33.513219 2573 generic.go:356] "Generic (PLEG): container finished" podID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" containerID="d066c0849be024033ceb2814632a6e126c48d3c6fb3184ddea49716bfbd6f36d" exitCode=0 Sep 10 00:59:33.513641 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:33.513273 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" event={"ID":"1248514a-4eaf-4f7e-a8ec-4a0017ae273d","Type":"ContainerDied","Data":"d066c0849be024033ceb2814632a6e126c48d3c6fb3184ddea49716bfbd6f36d"} Sep 10 00:59:33.513641 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:33.513324 2573 scope.go:117] "RemoveContainer" containerID="359e4275dab66ffe0c07988ab95cdaac0db0c5bf85571ba437699d498ef797fd" Sep 10 00:59:33.513641 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:33.513544 2573 scope.go:117] "RemoveContainer" containerID="d066c0849be024033ceb2814632a6e126c48d3c6fb3184ddea49716bfbd6f36d" Sep 10 00:59:33.513791 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:33.513772 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 00:59:34.519373 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:34.519343 2573 scope.go:117] "RemoveContainer" containerID="d066c0849be024033ceb2814632a6e126c48d3c6fb3184ddea49716bfbd6f36d" Sep 10 00:59:34.519841 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:34.519545 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 00:59:37.690849 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.690817 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz"] Sep 10 00:59:37.693631 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.693609 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.696175 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.696156 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 00:59:37.704014 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.703994 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz"] Sep 10 00:59:37.722889 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.722869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:37.761177 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.761156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmtl\" (UniqueName: \"kubernetes.io/projected/ba335441-3f6c-4804-9d19-7c783edc8f27-kube-api-access-nrmtl\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.761316 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.761198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.761316 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.761220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.761316 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.761250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.761447 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.761321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.761447 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.761349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba335441-3f6c-4804-9d19-7c783edc8f27-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862160 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmtl\" (UniqueName: \"kubernetes.io/projected/ba335441-3f6c-4804-9d19-7c783edc8f27-kube-api-access-nrmtl\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862410 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862551 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862551 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862551 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862496 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862551 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba335441-3f6c-4804-9d19-7c783edc8f27-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862888 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862856 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862888 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862870 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.862986 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.862909 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.865408 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.865385 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba335441-3f6c-4804-9d19-7c783edc8f27-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.865641 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.865615 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba335441-3f6c-4804-9d19-7c783edc8f27-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:37.870292 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:37.870267 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmtl\" (UniqueName: \"kubernetes.io/projected/ba335441-3f6c-4804-9d19-7c783edc8f27-kube-api-access-nrmtl\") pod \"e2e-distinct-simulated-kserve-6685d86975-hrnmz\" (UID: \"ba335441-3f6c-4804-9d19-7c783edc8f27\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:38.003938 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:38.003843 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:38.271521 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:38.271492 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz"] Sep 10 00:59:38.274106 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:59:38.274080 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba335441_3f6c_4804_9d19_7c783edc8f27.slice/crio-69f44eb3d173178530878be77d1ae326f6703ef1686223b471f57b07915b32a4 WatchSource:0}: Error finding container 69f44eb3d173178530878be77d1ae326f6703ef1686223b471f57b07915b32a4: Status 404 returned error can't find the container with id 69f44eb3d173178530878be77d1ae326f6703ef1686223b471f57b07915b32a4 Sep 10 00:59:38.538836 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:38.538792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerStarted","Data":"d2848a4346e2f4802933daa45cba0bf8d635db3277c4b2394e999549b4182784"} Sep 10 00:59:38.539004 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:38.538859 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerStarted","Data":"69f44eb3d173178530878be77d1ae326f6703ef1686223b471f57b07915b32a4"} Sep 10 00:59:38.583280 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:38.583220 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podStartSLOduration=1.373386334 podStartE2EDuration="1.583196387s" totalImagesPullingTime="209.810053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:59:38.582619654 +0000 UTC m=+558.873504842" watchObservedRunningTime="2026-09-10 00:59:38.583196387 +0000 UTC m=+558.874081576" Sep 10 00:59:39.544891 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:39.544855 2573 generic.go:356] "Generic (PLEG): container finished" podID="ba335441-3f6c-4804-9d19-7c783edc8f27" containerID="d2848a4346e2f4802933daa45cba0bf8d635db3277c4b2394e999549b4182784" exitCode=0 Sep 10 00:59:39.545399 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:39.544918 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerDied","Data":"d2848a4346e2f4802933daa45cba0bf8d635db3277c4b2394e999549b4182784"} Sep 10 00:59:39.545399 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:39.545256 2573 scope.go:117] "RemoveContainer" containerID="d2848a4346e2f4802933daa45cba0bf8d635db3277c4b2394e999549b4182784" Sep 10 00:59:40.517876 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.517830 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:40.518168 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.517906 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:40.518168 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.517923 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:40.518168 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.517937 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 00:59:40.518348 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.518332 2573 scope.go:117] "RemoveContainer" containerID="d066c0849be024033ceb2814632a6e126c48d3c6fb3184ddea49716bfbd6f36d" Sep 10 00:59:40.518569 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:40.518539 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 00:59:40.551433 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.551400 2573 generic.go:356] "Generic (PLEG): container finished" podID="ba335441-3f6c-4804-9d19-7c783edc8f27" containerID="8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e" exitCode=0 Sep 10 00:59:40.551900 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.551490 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerDied","Data":"8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e"} Sep 10 00:59:40.551900 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.551553 2573 scope.go:117] "RemoveContainer" containerID="d2848a4346e2f4802933daa45cba0bf8d635db3277c4b2394e999549b4182784" Sep 10 00:59:40.551900 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.551829 2573 scope.go:117] "RemoveContainer" containerID="8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e" Sep 10 00:59:40.552037 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:40.552018 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 00:59:40.956893 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:40.956860 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:41.557753 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:41.557722 2573 scope.go:117] "RemoveContainer" containerID="8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e" Sep 10 00:59:41.558170 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:41.557884 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 00:59:43.519129 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:43.519097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:43.573058 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:43.573029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:46.511819 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:46.511781 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:46.567328 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:46.567293 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:48.004586 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:48.004547 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:48.004986 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:48.004626 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:48.004986 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:48.004650 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:48.004986 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:48.004667 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 00:59:48.004986 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:48.004982 2573 scope.go:117] "RemoveContainer" containerID="8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e" Sep 10 00:59:48.005239 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:48.005191 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 00:59:48.587248 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:48.587221 2573 scope.go:117] "RemoveContainer" containerID="8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e" Sep 10 00:59:48.587428 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:48.587400 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 00:59:49.586325 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.586291 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h"] Sep 10 00:59:49.589111 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.589087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.591804 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.591781 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 00:59:49.600801 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.600766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h"] Sep 10 00:59:49.625316 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.625280 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:49.664434 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.664392 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.664434 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.664438 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwgg5\" (UniqueName: \"kubernetes.io/projected/7a382862-0f92-4a60-a2d9-c4740f2dd814-kube-api-access-vwgg5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.664642 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.664470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.664642 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.664552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.664642 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.664581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.664642 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.664609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a382862-0f92-4a60-a2d9-c4740f2dd814-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765495 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765453 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765495 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwgg5\" (UniqueName: \"kubernetes.io/projected/7a382862-0f92-4a60-a2d9-c4740f2dd814-kube-api-access-vwgg5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765707 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a382862-0f92-4a60-a2d9-c4740f2dd814-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765932 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765907 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.765993 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.765942 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.766079 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.766029 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.767951 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.767923 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a382862-0f92-4a60-a2d9-c4740f2dd814-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.768113 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.768097 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a382862-0f92-4a60-a2d9-c4740f2dd814-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.773299 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.773275 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwgg5\" (UniqueName: \"kubernetes.io/projected/7a382862-0f92-4a60-a2d9-c4740f2dd814-kube-api-access-vwgg5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8n6h\" (UID: \"7a382862-0f92-4a60-a2d9-c4740f2dd814\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:49.900549 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:49.900441 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:50.169355 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:50.169260 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h"] Sep 10 00:59:50.172030 ip-10-0-131-63 kubenswrapper[2573]: W0910 00:59:50.171997 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a382862_0f92_4a60_a2d9_c4740f2dd814.slice/crio-abe62b802769421e2490fa6d7aa394f6a2c87037e09e0d5df026d4a68be2a3d2 WatchSource:0}: Error finding container abe62b802769421e2490fa6d7aa394f6a2c87037e09e0d5df026d4a68be2a3d2: Status 404 returned error can't find the container with id abe62b802769421e2490fa6d7aa394f6a2c87037e09e0d5df026d4a68be2a3d2 Sep 10 00:59:50.597799 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:50.597760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" event={"ID":"7a382862-0f92-4a60-a2d9-c4740f2dd814","Type":"ContainerStarted","Data":"69de47f86cbc911ccf6e68f955f752d70fc6b407899bc52b7b4bbd9d785f00de"} Sep 10 00:59:50.598218 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:50.597815 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" event={"ID":"7a382862-0f92-4a60-a2d9-c4740f2dd814","Type":"ContainerStarted","Data":"abe62b802769421e2490fa6d7aa394f6a2c87037e09e0d5df026d4a68be2a3d2"} Sep 10 00:59:50.614504 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:50.614444 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" podStartSLOduration=1.413811927 podStartE2EDuration="1.614426431s" totalImagesPullingTime="200.614504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:59:50.613215544 +0000 UTC m=+570.904100733" watchObservedRunningTime="2026-09-10 00:59:50.614426431 +0000 UTC m=+570.905311619" Sep 10 00:59:55.209130 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:55.209088 2573 scope.go:117] "RemoveContainer" containerID="d066c0849be024033ceb2814632a6e126c48d3c6fb3184ddea49716bfbd6f36d" Sep 10 00:59:55.621116 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:55.621076 2573 generic.go:356] "Generic (PLEG): container finished" podID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" containerID="69df5994979232d52a088ce8c5979fe9548a5492a01c7feef201940640acdc2e" exitCode=0 Sep 10 00:59:55.621319 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:55.621085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" event={"ID":"1248514a-4eaf-4f7e-a8ec-4a0017ae273d","Type":"ContainerDied","Data":"69df5994979232d52a088ce8c5979fe9548a5492a01c7feef201940640acdc2e"} Sep 10 00:59:55.621319 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:55.621214 2573 scope.go:117] "RemoveContainer" containerID="d066c0849be024033ceb2814632a6e126c48d3c6fb3184ddea49716bfbd6f36d" Sep 10 00:59:55.621554 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:55.621537 2573 scope.go:117] "RemoveContainer" containerID="69df5994979232d52a088ce8c5979fe9548a5492a01c7feef201940640acdc2e" Sep 10 00:59:55.621752 ip-10-0-131-63 kubenswrapper[2573]: E0910 00:59:55.621733 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 00:59:57.723367 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:57.723334 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 00:59:59.900789 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:59.900755 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:59.902118 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:59.902096 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 00:59:59.918640 ip-10-0-131-63 kubenswrapper[2573]: I0910 00:59:59.918610 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 01:00:00.518400 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:00.518355 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:00.518606 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:00.518439 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:00.518606 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:00.518456 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:00.518606 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:00.518470 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:00.518865 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:00.518851 2573 scope.go:117] "RemoveContainer" containerID="69df5994979232d52a088ce8c5979fe9548a5492a01c7feef201940640acdc2e" Sep 10 01:00:00.519103 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:00.519045 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:00:00.657299 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:00.657262 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8n6h" Sep 10 01:00:03.209849 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:03.209811 2573 scope.go:117] "RemoveContainer" containerID="8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e" Sep 10 01:00:05.671144 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:05.671113 2573 generic.go:356] "Generic (PLEG): container finished" podID="ba335441-3f6c-4804-9d19-7c783edc8f27" containerID="f771b8d53153f9b7ff6a8ed259e966fdc243ad13bb0bf90579c65c76db8359a7" exitCode=0 Sep 10 01:00:05.671535 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:05.671163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerDied","Data":"f771b8d53153f9b7ff6a8ed259e966fdc243ad13bb0bf90579c65c76db8359a7"} Sep 10 01:00:05.671535 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:05.671239 2573 scope.go:117] "RemoveContainer" containerID="8b940094ab811288e3beabd15ab4c6f61f4acda51c09daf781bb651e47ec014e" Sep 10 01:00:05.671643 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:05.671623 2573 scope.go:117] "RemoveContainer" containerID="f771b8d53153f9b7ff6a8ed259e966fdc243ad13bb0bf90579c65c76db8359a7" Sep 10 01:00:05.671869 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:05.671852 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:00:08.004130 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:08.004086 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:08.004496 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:08.004155 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:08.004496 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:08.004174 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:08.004496 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:08.004189 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:08.004617 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:08.004574 2573 scope.go:117] "RemoveContainer" containerID="f771b8d53153f9b7ff6a8ed259e966fdc243ad13bb0bf90579c65c76db8359a7" Sep 10 01:00:08.004787 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:08.004767 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:00:11.517889 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:11.517856 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:00:14.209088 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:14.209039 2573 scope.go:117] "RemoveContainer" containerID="69df5994979232d52a088ce8c5979fe9548a5492a01c7feef201940640acdc2e" Sep 10 01:00:14.209559 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:14.209246 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:00:18.015484 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:18.015453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:00:19.865432 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:19.865394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:00:20.141746 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:20.141654 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 01:00:20.142463 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:20.142434 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 01:00:23.209554 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:23.209523 2573 scope.go:117] "RemoveContainer" containerID="f771b8d53153f9b7ff6a8ed259e966fdc243ad13bb0bf90579c65c76db8359a7" Sep 10 01:00:23.209952 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:23.209694 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:00:29.209868 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:29.209831 2573 scope.go:117] "RemoveContainer" containerID="69df5994979232d52a088ce8c5979fe9548a5492a01c7feef201940640acdc2e" Sep 10 01:00:29.210282 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:29.210134 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 01:00:29.780782 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:29.780696 2573 generic.go:356] "Generic (PLEG): container finished" podID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" containerID="a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46" exitCode=0 Sep 10 01:00:29.780782 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:29.780772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" event={"ID":"1248514a-4eaf-4f7e-a8ec-4a0017ae273d","Type":"ContainerDied","Data":"a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46"} Sep 10 01:00:29.780959 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:29.780832 2573 scope.go:117] "RemoveContainer" containerID="69df5994979232d52a088ce8c5979fe9548a5492a01c7feef201940640acdc2e" Sep 10 01:00:29.781217 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:29.781195 2573 scope.go:117] "RemoveContainer" containerID="a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46" Sep 10 01:00:29.781390 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:29.781371 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:00:30.518897 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:30.518852 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:30.519316 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:30.518948 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:30.519316 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:30.518967 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:30.519316 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:30.518981 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:00:30.786746 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:30.786672 2573 scope.go:117] "RemoveContainer" containerID="a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46" Sep 10 01:00:30.786880 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:30.786846 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:00:38.209283 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:38.209251 2573 scope.go:117] "RemoveContainer" containerID="f771b8d53153f9b7ff6a8ed259e966fdc243ad13bb0bf90579c65c76db8359a7" Sep 10 01:00:38.826108 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:38.826076 2573 generic.go:356] "Generic (PLEG): container finished" podID="ba335441-3f6c-4804-9d19-7c783edc8f27" containerID="abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481" exitCode=0 Sep 10 01:00:38.826284 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:38.826145 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerDied","Data":"abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481"} Sep 10 01:00:38.826284 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:38.826204 2573 scope.go:117] "RemoveContainer" containerID="f771b8d53153f9b7ff6a8ed259e966fdc243ad13bb0bf90579c65c76db8359a7" Sep 10 01:00:38.826526 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:38.826508 2573 scope.go:117] "RemoveContainer" containerID="abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481" Sep 10 01:00:38.826726 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:38.826703 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:00:46.209993 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:46.209922 2573 scope.go:117] "RemoveContainer" containerID="a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46" Sep 10 01:00:46.210440 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:46.210120 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:00:48.004829 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:48.004795 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:48.005303 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:48.004859 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:48.005303 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:48.004890 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:48.005303 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:48.004910 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:00:48.005464 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:48.005336 2573 scope.go:117] "RemoveContainer" containerID="abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481" Sep 10 01:00:48.005564 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:48.005542 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:00:57.209467 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:00:57.209438 2573 scope.go:117] "RemoveContainer" containerID="a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46" Sep 10 01:00:57.209824 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:00:57.209602 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:01:02.208848 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:02.208820 2573 scope.go:117] "RemoveContainer" containerID="abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481" Sep 10 01:01:02.209229 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:02.208981 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:01:11.209482 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:11.209456 2573 scope.go:117] "RemoveContainer" containerID="a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46" Sep 10 01:01:11.970385 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:11.970353 2573 generic.go:356] "Generic (PLEG): container finished" podID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" exitCode=0 Sep 10 01:01:11.970550 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:11.970422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" event={"ID":"1248514a-4eaf-4f7e-a8ec-4a0017ae273d","Type":"ContainerDied","Data":"ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39"} Sep 10 01:01:11.970550 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:11.970478 2573 scope.go:117] "RemoveContainer" containerID="a9b5cd9761671c750f1de27f764723808fa73187b12a8535632588e2196c0a46" Sep 10 01:01:11.970787 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:11.970773 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:01:11.970961 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:11.970941 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:01:13.209711 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:13.209680 2573 scope.go:117] "RemoveContainer" containerID="abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481" Sep 10 01:01:13.210108 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:13.209847 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:01:20.517910 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:20.517871 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:01:20.518435 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:20.518246 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:01:20.518435 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:20.518278 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:01:20.518435 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:20.518424 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:01:20.518727 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:20.518712 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:01:20.518897 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:20.518874 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:01:21.010234 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:21.010200 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:01:21.010441 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:21.010416 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:01:28.209729 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:28.209695 2573 scope.go:117] "RemoveContainer" containerID="abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481" Sep 10 01:01:29.047025 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:29.046995 2573 generic.go:356] "Generic (PLEG): container finished" podID="ba335441-3f6c-4804-9d19-7c783edc8f27" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" exitCode=0 Sep 10 01:01:29.047210 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:29.047071 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerDied","Data":"44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72"} Sep 10 01:01:29.047210 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:29.047121 2573 scope.go:117] "RemoveContainer" containerID="abd3b6d2edc347680ef99966f7f88058c83c4327966e1c7c781a8fa5752e3481" Sep 10 01:01:29.047528 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:29.047505 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:01:29.047758 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:29.047732 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:01:32.209685 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:32.209653 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:01:32.210117 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:32.209825 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:01:38.003987 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:38.003950 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:01:38.004403 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:38.004017 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:01:38.004403 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:38.004036 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:01:38.004403 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:38.004072 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:01:38.004506 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:38.004413 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:01:38.004665 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:38.004639 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:01:38.087368 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:38.087341 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:01:38.087530 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:38.087499 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:01:44.712795 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:44.712754 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:01:46.209072 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:46.209030 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:01:46.209531 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:46.209298 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:01:52.209305 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:52.209269 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:01:52.209859 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:01:52.209499 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:01:55.565391 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:01:55.565357 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:02:00.210792 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:00.210757 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:02:00.211219 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:00.210939 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:02:04.214306 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:04.214278 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:02:04.214682 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:04.214443 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:02:12.209335 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:12.209305 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:02:12.209699 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:12.209470 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:02:17.209352 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:17.209318 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:02:17.209711 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:17.209507 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:02:27.209274 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:27.209244 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:02:27.209705 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:27.209434 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:02:29.209090 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:29.209037 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:02:29.209481 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:29.209230 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:02:41.209233 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:41.209203 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:02:42.359686 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:42.359650 2573 generic.go:356] "Generic (PLEG): container finished" podID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" exitCode=0 Sep 10 01:02:42.360105 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:42.359720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" event={"ID":"1248514a-4eaf-4f7e-a8ec-4a0017ae273d","Type":"ContainerDied","Data":"0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c"} Sep 10 01:02:42.360105 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:42.359781 2573 scope.go:117] "RemoveContainer" containerID="ce09a26d43c46dee8eccea895acc7023aa8c65ccbf7c4f1f13a19be436700f39" Sep 10 01:02:42.360195 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:42.360124 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:02:42.360323 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:42.360301 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:02:43.209184 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:43.209157 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:02:43.209347 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:43.209308 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:02:50.518395 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:50.518363 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:02:50.518766 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:50.518424 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:02:50.518766 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:50.518443 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:02:50.518766 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:50.518456 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" Sep 10 01:02:50.518874 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:50.518793 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:02:50.518999 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:50.518980 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:02:54.209091 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:54.209013 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:02:55.414967 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:55.414935 2573 generic.go:356] "Generic (PLEG): container finished" podID="ba335441-3f6c-4804-9d19-7c783edc8f27" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" exitCode=0 Sep 10 01:02:55.415439 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:55.414977 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" event={"ID":"ba335441-3f6c-4804-9d19-7c783edc8f27","Type":"ContainerDied","Data":"be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391"} Sep 10 01:02:55.415439 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:55.415024 2573 scope.go:117] "RemoveContainer" containerID="44a243cbeb04875caa45b7fabb07e3c749993b33e9b911d5433081e941cfdf72" Sep 10 01:02:55.415439 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:55.415424 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:02:55.415670 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:55.415649 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:02:58.004518 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:58.004482 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:02:58.004958 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:58.004547 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:02:58.004958 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:58.004566 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:02:58.004958 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:58.004578 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" Sep 10 01:02:58.004958 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:02:58.004905 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:02:58.005127 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:02:58.005107 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:03:04.209428 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:04.209397 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:03:04.209920 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:04.209556 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:03:09.208941 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:09.208910 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:03:09.209335 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:09.209098 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:03:15.209618 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:15.209581 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:03:15.210121 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:15.209805 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:03:22.209395 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:22.209362 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:03:22.209852 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:22.209530 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:03:29.209575 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:29.209544 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:03:29.210030 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:29.209726 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:03:35.209484 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:35.209450 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:03:35.209880 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:35.209621 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:03:36.379469 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:36.379438 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:03:41.209123 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:41.209092 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:03:41.209480 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:41.209264 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:03:46.209405 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:46.209327 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:03:46.209767 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:46.209553 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:03:53.209485 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:53.209453 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:03:53.209873 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:53.209635 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:03:58.209497 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:03:58.209460 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:03:58.209888 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:03:58.209631 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:04:04.210167 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:04.210125 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:04:04.210731 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:04.210619 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:04:13.209771 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:13.209739 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:04:13.210188 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:13.209930 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:04:16.209255 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:16.209227 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:04:16.209615 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:16.209404 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:04:24.208898 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:24.208865 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:04:24.210493 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:24.209140 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:04:28.209489 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:28.209456 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:04:28.209870 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:28.209605 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:04:32.293742 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:32.293713 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-8kqzv_fe06bd9c-7090-4c93-85f4-0af63e5e0122/copy-manifests/0.log" Sep 10 01:04:32.305819 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:32.305782 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-8kqzv_fe06bd9c-7090-4c93-85f4-0af63e5e0122/manager/0.log" Sep 10 01:04:33.127668 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:33.127639 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vctrj_713ddcff-489a-4a09-93b4-3a6c03706f77/postgres/0.log" Sep 10 01:04:34.372007 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:34.371971 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qpp4j_b8615660-35d6-4dca-a35f-e64204d0abe9/manager/0.log" Sep 10 01:04:34.951535 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:34.951504 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777w9rhz_4aac8806-bc43-4bb0-b18f-8f2b9f80a926/istio-proxy/0.log" Sep 10 01:04:35.071261 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:35.071222 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t92vm_5a1c0a70-76fb-4d44-9ef2-d3ac222cf391/discovery/0.log" Sep 10 01:04:35.187358 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:35.187329 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-nr99r_2486d521-7105-45c6-a871-0a9b0546eac5/kube-auth-proxy/0.log" Sep 10 01:04:35.411921 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:35.411892 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-xqd8q_ec5b6592-1e49-430f-913f-d4ba2c3d0ca8/istio-proxy/1.log" Sep 10 01:04:35.520293 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:35.520259 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2sl97_a5a09bf4-5c8c-4030-9500-84d8b80d69e3/payload-pre-processing/0.log" Sep 10 01:04:36.072130 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:36.072104 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-ptzl8_1248514a-4eaf-4f7e-a8ec-4a0017ae273d/main/5.log" Sep 10 01:04:36.189403 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:36.189376 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-hrnmz_ba335441-3f6c-4804-9d19-7c783edc8f27/main/5.log" Sep 10 01:04:36.416812 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:36.416738 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-m8n6h_7a382862-0f92-4a60-a2d9-c4740f2dd814/main/0.log" Sep 10 01:04:39.209804 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:39.209771 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:04:39.210218 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:39.209941 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:04:41.208808 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:41.208782 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:04:41.209159 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:41.208969 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:04:41.881508 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:41.881474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:04:41.950848 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:41.950816 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" limit=1024 Sep 10 01:04:45.564857 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:45.564825 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q5bvn_2552efdc-0ea2-41f8-9750-6b41238557d4/global-pull-secret-syncer/0.log" Sep 10 01:04:45.610194 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:45.610167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kfsrs_b0461365-5833-4fa2-9f41-61e18362440e/konnectivity-agent/0.log" Sep 10 01:04:45.708475 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:45.708449 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-63.ec2.internal_afb1c523a0c5b188374be40b94f8933b/haproxy/0.log" Sep 10 01:04:50.739362 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:50.739329 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qpp4j_b8615660-35d6-4dca-a35f-e64204d0abe9/manager/0.log" Sep 10 01:04:51.209077 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:51.209035 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:04:51.209251 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:51.209232 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:04:52.622398 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:52.622367 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-8qjbr_7b6c3b73-0062-4352-8f1e-f460603f639c/monitoring-plugin/0.log" Sep 10 01:04:52.840029 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:52.840000 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mdfdv_429a2d43-ce4c-420a-a7ae-214b5b90c64b/node-exporter/0.log" Sep 10 01:04:52.868356 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:52.868327 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mdfdv_429a2d43-ce4c-420a-a7ae-214b5b90c64b/kube-rbac-proxy/0.log" Sep 10 01:04:52.892861 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:52.892804 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mdfdv_429a2d43-ce4c-420a-a7ae-214b5b90c64b/init-textfile/0.log" Sep 10 01:04:55.989788 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:55.989759 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48"] Sep 10 01:04:55.992162 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:55.992139 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:55.994701 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:55.994667 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sb69v\"/\"openshift-service-ca.crt\"" Sep 10 01:04:55.995821 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:55.995802 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sb69v\"/\"default-dockercfg-9hx98\"" Sep 10 01:04:55.995901 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:55.995845 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sb69v\"/\"kube-root-ca.crt\"" Sep 10 01:04:56.002981 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.002959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48"] Sep 10 01:04:56.103287 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.103255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-sys\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.103287 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.103287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszcd\" (UniqueName: \"kubernetes.io/projected/c5446ebd-9546-4f70-a820-c2656c2f5bce-kube-api-access-pszcd\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.103531 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.103373 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-podres\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.103531 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.103461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-proc\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.103531 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.103483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-lib-modules\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204119 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-proc\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204119 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-lib-modules\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204342 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-sys\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204342 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszcd\" (UniqueName: \"kubernetes.io/projected/c5446ebd-9546-4f70-a820-c2656c2f5bce-kube-api-access-pszcd\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204342 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-podres\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204342 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204221 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-sys\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204342 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204221 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-proc\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204342 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204269 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-lib-modules\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.204342 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.204323 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5446ebd-9546-4f70-a820-c2656c2f5bce-podres\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.209408 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.209390 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:04:56.209569 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:04:56.209551 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:04:56.212040 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.212018 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszcd\" (UniqueName: \"kubernetes.io/projected/c5446ebd-9546-4f70-a820-c2656c2f5bce-kube-api-access-pszcd\") pod \"perf-node-gather-daemonset-x6b48\" (UID: \"c5446ebd-9546-4f70-a820-c2656c2f5bce\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.302329 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.302258 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.570951 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.570927 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48"] Sep 10 01:04:56.573166 ip-10-0-131-63 kubenswrapper[2573]: W0910 01:04:56.573137 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5446ebd_9546_4f70_a820_c2656c2f5bce.slice/crio-6f642961291deee1161125832b66391ef4df254917a8e749c8e61915a38fe360 WatchSource:0}: Error finding container 6f642961291deee1161125832b66391ef4df254917a8e749c8e61915a38fe360: Status 404 returned error can't find the container with id 6f642961291deee1161125832b66391ef4df254917a8e749c8e61915a38fe360 Sep 10 01:04:56.937409 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.937317 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" event={"ID":"c5446ebd-9546-4f70-a820-c2656c2f5bce","Type":"ContainerStarted","Data":"97a0d1b7da465882eb6ec66a9b8ba0c3485ffa71f3813d098a636c2216954875"} Sep 10 01:04:56.937409 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.937382 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:04:56.937409 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.937404 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" event={"ID":"c5446ebd-9546-4f70-a820-c2656c2f5bce","Type":"ContainerStarted","Data":"6f642961291deee1161125832b66391ef4df254917a8e749c8e61915a38fe360"} Sep 10 01:04:56.953780 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:56.953731 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" podStartSLOduration=1.953717186 podStartE2EDuration="1.953717186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 01:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 01:04:56.951502486 +0000 UTC m=+877.242387676" watchObservedRunningTime="2026-09-10 01:04:56.953717186 +0000 UTC m=+877.244602373" Sep 10 01:04:57.780573 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:57.780545 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5hsw_82991ee5-f130-4fab-8fd0-d6b59755e2f2/dns/0.log" Sep 10 01:04:57.805229 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:57.805203 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5hsw_82991ee5-f130-4fab-8fd0-d6b59755e2f2/kube-rbac-proxy/0.log" Sep 10 01:04:57.896218 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:57.896195 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6l5k_6d8f6ba2-5c51-4da2-bdc5-99b3bd806d4d/dns-node-resolver/0.log" Sep 10 01:04:58.507492 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:58.507466 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z6256_a2937f26-1d68-47c9-92d4-979f1ed3a5be/node-ca/0.log" Sep 10 01:04:59.378892 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:59.378860 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777w9rhz_4aac8806-bc43-4bb0-b18f-8f2b9f80a926/istio-proxy/0.log" Sep 10 01:04:59.425270 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:59.425244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t92vm_5a1c0a70-76fb-4d44-9ef2-d3ac222cf391/discovery/0.log" Sep 10 01:04:59.443800 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:59.443777 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-nr99r_2486d521-7105-45c6-a871-0a9b0546eac5/kube-auth-proxy/0.log" Sep 10 01:04:59.496141 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:59.496113 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-xqd8q_ec5b6592-1e49-430f-913f-d4ba2c3d0ca8/istio-proxy/1.log" Sep 10 01:04:59.496542 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:59.496525 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-xqd8q_ec5b6592-1e49-430f-913f-d4ba2c3d0ca8/istio-proxy/0.log" Sep 10 01:04:59.516005 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:04:59.515984 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2sl97_a5a09bf4-5c8c-4030-9500-84d8b80d69e3/payload-pre-processing/0.log" Sep 10 01:05:00.200099 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:00.200067 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gchmg_19aa8118-a6a3-49e8-b252-d02cbea109dd/serve-healthcheck-canary/0.log" Sep 10 01:05:00.783098 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:00.783068 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcxbl_6576704f-06e3-4b94-8081-9c09fe114efb/kube-rbac-proxy/0.log" Sep 10 01:05:00.804232 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:00.804206 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcxbl_6576704f-06e3-4b94-8081-9c09fe114efb/exporter/0.log" Sep 10 01:05:00.825782 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:00.825758 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcxbl_6576704f-06e3-4b94-8081-9c09fe114efb/extractor/0.log" Sep 10 01:05:02.951117 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:02.951085 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-x6b48" Sep 10 01:05:03.142919 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:03.142891 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-8kqzv_fe06bd9c-7090-4c93-85f4-0af63e5e0122/manager/0.log" Sep 10 01:05:03.159621 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:03.159599 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-8kqzv_fe06bd9c-7090-4c93-85f4-0af63e5e0122/copy-manifests/0.log" Sep 10 01:05:03.209558 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:03.209498 2573 scope.go:117] "RemoveContainer" containerID="be0340569369ca36a5bbef971d4463527e6eaf9bdd05143deadf3bfc70fdc391" Sep 10 01:05:03.209681 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:05:03.209663 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hrnmz_llm(ba335441-3f6c-4804-9d19-7c783edc8f27)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hrnmz" podUID="ba335441-3f6c-4804-9d19-7c783edc8f27" Sep 10 01:05:04.393329 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:04.393301 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vzmd6_70db01a3-a3ca-433d-b708-9656b9f73039/openshift-lws-operator/0.log" Sep 10 01:05:06.059192 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:06.059157 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777w9rhz_4aac8806-bc43-4bb0-b18f-8f2b9f80a926/istio-proxy/0.log" Sep 10 01:05:06.093795 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:06.093771 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t92vm_5a1c0a70-76fb-4d44-9ef2-d3ac222cf391/discovery/0.log" Sep 10 01:05:06.120600 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:06.120577 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-nr99r_2486d521-7105-45c6-a871-0a9b0546eac5/kube-auth-proxy/0.log" Sep 10 01:05:06.160794 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:06.160768 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-xqd8q_ec5b6592-1e49-430f-913f-d4ba2c3d0ca8/istio-proxy/1.log" Sep 10 01:05:06.161091 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:06.161076 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-xqd8q_ec5b6592-1e49-430f-913f-d4ba2c3d0ca8/istio-proxy/0.log" Sep 10 01:05:06.172381 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:06.172359 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2sl97_a5a09bf4-5c8c-4030-9500-84d8b80d69e3/payload-pre-processing/0.log" Sep 10 01:05:07.467524 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:07.467499 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777w9rhz_4aac8806-bc43-4bb0-b18f-8f2b9f80a926/istio-proxy/0.log" Sep 10 01:05:07.504768 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:07.504739 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t92vm_5a1c0a70-76fb-4d44-9ef2-d3ac222cf391/discovery/0.log" Sep 10 01:05:07.516846 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:07.516820 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-nr99r_2486d521-7105-45c6-a871-0a9b0546eac5/kube-auth-proxy/0.log" Sep 10 01:05:07.557959 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:07.557893 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-xqd8q_ec5b6592-1e49-430f-913f-d4ba2c3d0ca8/istio-proxy/1.log" Sep 10 01:05:07.558184 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:07.558169 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-xqd8q_ec5b6592-1e49-430f-913f-d4ba2c3d0ca8/istio-proxy/0.log" Sep 10 01:05:07.569886 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:07.569870 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2sl97_a5a09bf4-5c8c-4030-9500-84d8b80d69e3/payload-pre-processing/0.log" Sep 10 01:05:09.622526 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:09.622487 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-kfd5p_0311f807-7e59-493f-a2fd-a84618615a20/migrator/0.log" Sep 10 01:05:09.650231 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:09.650203 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-kfd5p_0311f807-7e59-493f-a2fd-a84618615a20/graceful-termination/0.log" Sep 10 01:05:11.209385 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.209352 2573 scope.go:117] "RemoveContainer" containerID="0d1823e484c18559db78747e06a9d56b54389b79b81cfff7070829c427bc896c" Sep 10 01:05:11.209729 ip-10-0-131-63 kubenswrapper[2573]: E0910 01:05:11.209592 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-ptzl8_llm(1248514a-4eaf-4f7e-a8ec-4a0017ae273d)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-ptzl8" podUID="1248514a-4eaf-4f7e-a8ec-4a0017ae273d" Sep 10 01:05:11.307526 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.307497 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xbx6s_3620729c-b4c0-4373-8f03-952db98d5586/kube-multus-additional-cni-plugins/0.log" Sep 10 01:05:11.327647 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.327624 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xbx6s_3620729c-b4c0-4373-8f03-952db98d5586/egress-router-binary-copy/0.log" Sep 10 01:05:11.351736 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.351712 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xbx6s_3620729c-b4c0-4373-8f03-952db98d5586/cni-plugins/0.log" Sep 10 01:05:11.372768 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.372746 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xbx6s_3620729c-b4c0-4373-8f03-952db98d5586/bond-cni-plugin/0.log" Sep 10 01:05:11.394939 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.394920 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xbx6s_3620729c-b4c0-4373-8f03-952db98d5586/routeoverride-cni/0.log" Sep 10 01:05:11.417380 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.417361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xbx6s_3620729c-b4c0-4373-8f03-952db98d5586/whereabouts-cni-bincopy/0.log" Sep 10 01:05:11.439188 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.439166 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xbx6s_3620729c-b4c0-4373-8f03-952db98d5586/whereabouts-cni/0.log" Sep 10 01:05:11.512137 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.512073 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-km6nq_1bf268dd-5e37-4ba3-bc59-6c3f7d5b945c/kube-multus/0.log" Sep 10 01:05:11.622128 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.622103 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zpzbn_41146b11-bf1d-412b-85cf-83cd0b4fc7cf/network-metrics-daemon/0.log" Sep 10 01:05:11.641962 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:11.641913 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zpzbn_41146b11-bf1d-412b-85cf-83cd0b4fc7cf/kube-rbac-proxy/0.log" Sep 10 01:05:12.632482 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.632401 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-controller/0.log" Sep 10 01:05:12.651456 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.651430 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/1.log" Sep 10 01:05:12.651599 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.651489 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovn-acl-logging/0.log" Sep 10 01:05:12.669199 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.669178 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/kube-rbac-proxy-node/0.log" Sep 10 01:05:12.689931 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.689910 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 01:05:12.710332 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.710311 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/northd/0.log" Sep 10 01:05:12.730487 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.730464 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/nbdb/0.log" Sep 10 01:05:12.750583 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.750567 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/sbdb/0.log" Sep 10 01:05:12.784605 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:12.784582 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5fjt_293375e1-ca1f-4dd0-9b72-c3f53239616e/ovnkube-controller/0.log" Sep 10 01:05:14.121420 ip-10-0-131-63 kubenswrapper[2573]: I0910 01:05:14.121392 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tfbb8_0e9a721c-3e04-4772-8554-341c06b38a5d/network-check-target-container/0.log"