Jul 20 19:13:08.491810 ip-10-0-135-129 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 19:13:08.491825 ip-10-0-135-129 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 19:13:08.491834 ip-10-0-135-129 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 19:13:08.492198 ip-10-0-135-129 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 19:13:18.532518 ip-10-0-135-129 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 19:13:18.532539 ip-10-0-135-129 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 37faa58d21764a90b2e06fded3159d63 -- Jul 20 19:15:16.075724 ip-10-0-135-129 systemd[1]: Starting Kubernetes Kubelet... Jul 20 19:15:16.459824 ip-10-0-135-129 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:15:16.459824 ip-10-0-135-129 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 19:15:16.459824 ip-10-0-135-129 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:15:16.459824 ip-10-0-135-129 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 19:15:16.459824 ip-10-0-135-129 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:15:16.460706 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.459907 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468393 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468420 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468426 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468429 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468436 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468440 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468443 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468446 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468450 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468453 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468456 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468458 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468462 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:15:16.468455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468465 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468468 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468471 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468473 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468479 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468481 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468484 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468487 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468490 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468492 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468495 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468499 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468513 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468516 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468518 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468521 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468527 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468530 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468532 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468535 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:15:16.469026 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468538 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468540 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468545 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468548 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468551 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468554 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468557 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468562 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468565 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468568 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468571 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468573 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468575 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468578 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468581 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468584 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468588 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468592 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468595 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468599 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:15:16.469726 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468604 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468607 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468609 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468612 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468615 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468618 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468621 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468623 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468626 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468629 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468632 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468635 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468640 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468644 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468648 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468652 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468655 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468658 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468662 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:15:16.470468 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468668 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468671 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468674 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468676 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468679 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468684 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468687 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468690 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468692 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468695 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468698 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468701 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468704 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468706 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468709 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468712 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468715 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468720 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468723 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468725 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:15:16.471137 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468728 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468730 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468733 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468736 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468739 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468741 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.468745 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470932 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470941 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470946 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470953 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470956 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470958 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470961 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470964 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470966 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470969 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470972 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470975 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470978 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470981 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:15:16.471853 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470984 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470989 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470992 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470995 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.470998 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471001 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471004 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471006 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471009 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471012 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471016 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471020 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471023 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471029 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471032 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471035 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471037 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471040 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471043 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471046 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:15:16.472612 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471049 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471052 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471057 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471060 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471063 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471066 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471079 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471082 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471084 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471087 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471091 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471094 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471097 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471101 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471104 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471107 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471110 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471113 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471118 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:15:16.473326 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471121 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471123 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471126 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471129 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471131 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471134 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471138 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471141 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471144 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471148 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471153 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471158 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471161 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471164 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471167 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471170 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471173 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471176 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471179 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:15:16.474018 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471181 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471184 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471188 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471191 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471194 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471198 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471201 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471204 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471209 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471212 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471216 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471219 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471221 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471224 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471227 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471230 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471243 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471246 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471249 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471252 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:15:16.474690 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471255 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471258 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471260 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471266 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471269 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471271 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471274 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471969 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471975 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471978 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471981 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471986 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471993 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471996 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.471999 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472002 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472005 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472008 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472010 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:15:16.475406 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472013 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472016 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472019 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472021 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472024 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472027 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472032 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472035 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472038 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472041 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472044 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472046 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472056 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472059 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472061 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472064 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472067 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472070 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472075 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:15:16.476089 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472079 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472082 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472084 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472088 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472091 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472093 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472096 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472098 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472102 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472104 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472107 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472110 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472115 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472118 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472121 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472123 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472126 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472129 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472131 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:15:16.476780 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472134 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472137 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472139 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472142 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472144 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472147 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472152 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472155 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472157 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472160 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472163 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472165 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472168 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472170 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472173 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472176 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472181 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472184 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472190 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472193 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:15:16.477523 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472197 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472200 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472204 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472207 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472209 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472212 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472215 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472217 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472220 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472223 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472229 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472232 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472235 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472237 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472240 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472244 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472247 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472249 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472252 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472255 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:15:16.478235 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472257 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472263 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472265 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472268 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472271 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472276 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472279 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472281 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.472284 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472389 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472397 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472405 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472422 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472427 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472430 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472435 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472443 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472447 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472450 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472454 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472457 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472460 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 19:15:16.478943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472464 2575 flags.go:64] FLAG: --cgroup-root="" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472467 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472473 2575 flags.go:64] FLAG: --client-ca-file="" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472476 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472479 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472484 2575 flags.go:64] FLAG: --cluster-domain="" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472487 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472490 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472493 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472497 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472501 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472507 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472510 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472513 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472516 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472521 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472524 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472528 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472531 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472538 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472542 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472547 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472551 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472554 2575 flags.go:64] FLAG: --enable-server="true" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472557 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 19:15:16.479733 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472561 2575 flags.go:64] FLAG: --event-burst="100" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472564 2575 flags.go:64] FLAG: --event-qps="50" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472567 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472573 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472576 2575 flags.go:64] FLAG: --eviction-hard="" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472580 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472583 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472586 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472589 2575 flags.go:64] FLAG: --eviction-soft="" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472592 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472596 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472601 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472605 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472608 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472611 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472615 2575 flags.go:64] FLAG: --feature-gates="" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472619 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472623 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472626 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472632 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472635 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472639 2575 flags.go:64] FLAG: --help="false" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472642 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472646 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 19:15:16.480628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472649 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472652 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472656 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472660 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472666 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472674 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472677 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472680 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472684 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472687 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472690 2575 flags.go:64] FLAG: --kube-reserved="" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472694 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472697 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472702 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472705 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472709 2575 flags.go:64] FLAG: --lock-file="" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472712 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472715 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472719 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472725 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472728 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472733 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472736 2575 flags.go:64] FLAG: --logging-format="text" Jul 20 19:15:16.481524 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472740 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472743 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472746 2575 flags.go:64] FLAG: --manifest-url="" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472749 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472754 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472757 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472764 2575 flags.go:64] FLAG: --max-pods="110" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472767 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472771 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472774 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472778 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472781 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472784 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472789 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472799 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472803 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472806 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472810 2575 flags.go:64] FLAG: --pod-cidr="" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472813 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472819 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472823 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472826 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472832 2575 flags.go:64] FLAG: --port="10250" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472835 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 19:15:16.482380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472839 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b1bbd5ab01e5c952" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472842 2575 flags.go:64] FLAG: --qos-reserved="" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472845 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472849 2575 flags.go:64] FLAG: --register-node="true" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472852 2575 flags.go:64] FLAG: --register-with-taints="" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472855 2575 flags.go:64] FLAG: --registry-burst="10" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472861 2575 flags.go:64] FLAG: --registry-qps="5" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472864 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472867 2575 flags.go:64] FLAG: --reserved-memory="" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472871 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472874 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472877 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472880 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472883 2575 flags.go:64] FLAG: --runonce="false" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472886 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472892 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472895 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472898 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472901 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472904 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472908 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472911 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472915 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472920 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472925 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472927 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 19:15:16.483269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472931 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472934 2575 flags.go:64] FLAG: --system-cgroups="" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472937 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472943 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472948 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472952 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472956 2575 flags.go:64] FLAG: --tls-min-version="" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472959 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472962 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472965 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472968 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472972 2575 flags.go:64] FLAG: --v="2" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472976 2575 flags.go:64] FLAG: --version="false" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472983 2575 flags.go:64] FLAG: --vmodule="" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472987 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.472990 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473252 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473257 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473262 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473266 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473269 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473271 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473274 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:15:16.484188 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473277 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473281 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473287 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473289 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473292 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473296 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473299 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473302 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473305 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473308 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473311 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473313 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473316 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473320 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473323 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473328 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473332 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473334 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473337 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473340 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:15:16.485030 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473343 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473345 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473348 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473351 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473354 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473358 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473361 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473367 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473369 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473372 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473375 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473377 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473381 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473385 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473388 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473391 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473394 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473397 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473400 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:15:16.485760 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473402 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473424 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473429 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473434 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473438 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473442 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473447 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473450 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473452 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473455 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473458 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473461 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473463 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473468 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473471 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473474 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473476 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473479 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473482 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473484 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:15:16.486455 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473487 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473490 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473492 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473495 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473497 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473500 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473505 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473508 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473510 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473513 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473516 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473519 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473521 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473524 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473527 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473531 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473534 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473537 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473544 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:15:16.487189 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473546 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473549 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473552 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473555 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473557 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473560 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473562 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473565 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473568 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473570 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473573 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473575 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473580 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.473583 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:15:16.487876 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.474474 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:15:16.496898 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.496869 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 19:15:16.496898 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.496896 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.496913 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.496919 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.496986 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.496991 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.496995 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.496998 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497002 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497005 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497007 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497010 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497013 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:15:16.497011 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497016 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497019 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497023 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497025 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497028 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497030 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497033 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497036 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497038 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497041 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497044 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497046 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497049 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497052 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497054 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497057 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497060 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497063 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497066 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497068 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:15:16.497323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497071 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497073 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497076 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497078 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497081 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497083 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497085 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497088 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497090 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497093 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497096 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497098 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497101 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497103 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497107 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497110 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497113 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497115 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497118 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497121 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:15:16.497826 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497123 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497126 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497128 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497131 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497133 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497136 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497138 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497141 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497144 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497146 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497149 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497151 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497153 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497156 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497158 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497161 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497164 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497166 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497169 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:15:16.498347 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497173 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497177 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497182 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497185 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497188 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497190 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497193 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497196 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497199 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497201 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497204 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497207 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497210 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497212 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497215 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497218 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497221 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497224 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497226 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497229 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:15:16.498818 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497231 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497234 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497238 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497241 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497244 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497247 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497250 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497254 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497257 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497261 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497264 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.497270 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497387 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497393 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:15:16.499307 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497395 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497398 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497401 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497404 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497407 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497423 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497428 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497431 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497434 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497438 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497441 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497444 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497447 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497449 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497452 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497455 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497458 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497460 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497463 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497465 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:15:16.499669 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497468 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497471 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497473 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497476 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497479 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497481 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497484 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497486 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497489 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497492 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497495 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497498 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497500 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497503 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497505 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497508 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497511 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497514 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497516 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497519 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:15:16.500172 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497522 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497525 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497528 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497531 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497533 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497536 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497539 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497541 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497545 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497549 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497552 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497554 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497556 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497559 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497561 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497564 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497566 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497569 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497571 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:15:16.500689 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497574 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497576 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497579 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497581 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497584 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497586 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497589 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497591 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497593 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497596 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497599 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497602 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497605 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497607 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497610 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497613 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497616 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497618 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497621 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497624 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:15:16.501138 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497626 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497629 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497633 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497636 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497639 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497642 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497645 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497647 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497650 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497653 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497655 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497659 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497662 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497665 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497668 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497670 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497672 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:15:16.501783 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:16.497675 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:15:16.502205 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.497680 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:15:16.502205 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.497818 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 19:15:16.502205 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.499960 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 19:15:16.502205 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.501269 2575 server.go:1019] "Starting client certificate rotation" Jul 20 19:15:16.502205 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.501375 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:15:16.502205 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.501455 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:15:16.503836 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.503816 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:15:16.507337 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.507319 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:15:16.515937 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.515914 2575 log.go:25] "Validated CRI v1 runtime API" Jul 20 19:15:16.520314 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.520299 2575 log.go:25] "Validated CRI v1 image API" Jul 20 19:15:16.522563 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.522542 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 19:15:16.527920 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.527896 2575 fs.go:135] Filesystem UUIDs: map[2004fb48-1bf1-4746-baa9-d7190e30efd4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fa0ea7be-82c6-43b9-8b03-0dac8bedd154:/dev/nvme0n1p4] Jul 20 19:15:16.528001 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.527917 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 19:15:16.533577 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.533554 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:15:16.534606 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.534494 2575 manager.go:216] Machine: {Timestamp:2026-07-20 19:15:16.53259039 +0000 UTC m=+0.345458690 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3083894 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27575bd21f08e6d18b725699eafa38 SystemUUID:ec27575b-d21f-08e6-d18b-725699eafa38 BootID:37faa58d-2176-4a90-b2e0-6fded3159d63 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:2a:c4:65:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:2a:c4:65:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:e9:ba:be:a7:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 19:15:16.534606 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.534606 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 19:15:16.534723 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.534704 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 19:15:16.537372 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.537344 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 19:15:16.537565 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.537374 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 19:15:16.538556 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.538545 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 19:15:16.538588 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.538558 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 19:15:16.538588 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.538566 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:15:16.539087 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.539076 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:15:16.540074 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.540064 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 19:15:16.542751 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.542739 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:15:16.542870 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.542860 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 19:15:16.542908 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.542890 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 20 19:15:16.542908 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.542900 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 19:15:16.542990 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.542911 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 19:15:16.542990 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.542927 2575 kubelet.go:398] "Adding apiserver pod source" Jul 20 19:15:16.542990 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.542938 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 19:15:16.543373 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.543362 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:15:16.543436 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.543382 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:15:16.546802 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.546785 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 19:15:16.548717 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.548700 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 19:15:16.548810 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.548739 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 19:15:16.549721 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549708 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 19:15:16.549764 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549726 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 19:15:16.549764 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549737 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 19:15:16.549764 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549747 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 19:15:16.549764 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549758 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 19:15:16.549764 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549764 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549773 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549780 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549786 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549792 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549801 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549807 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549830 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 19:15:16.549897 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.549836 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 19:15:16.553381 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.553365 2575 server.go:1268] "Started kubelet" Jul 20 19:15:16.553463 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.553446 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 19:15:16.553516 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.553464 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 19:15:16.553516 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.553498 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 19:15:16.553616 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.553531 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 19:15:16.553707 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.553662 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 19:15:16.553828 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.553725 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 19:15:16.555218 ip-10-0-135-129 systemd[1]: Started Kubernetes Kubelet. Jul 20 19:15:16.555462 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.555450 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 19:15:16.556191 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.556179 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 20 19:15:16.558376 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.558347 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xsq9g" Jul 20 19:15:16.559374 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.558402 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-129.ec2.internal.18c4156e783bdf03 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-129.ec2.internal,UID:ip-10-0-135-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-129.ec2.internal,},FirstTimestamp:2026-07-20 19:15:16.553334531 +0000 UTC m=+0.366202828,LastTimestamp:2026-07-20 19:15:16.553334531 +0000 UTC m=+0.366202828,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-129.ec2.internal,}" Jul 20 19:15:16.560660 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.560630 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 19:15:16.561353 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.561339 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 19:15:16.561404 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.561362 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 19:15:16.561466 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.561435 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:16.561892 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.561876 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 19:15:16.561892 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.561894 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 19:15:16.562017 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.561879 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 19:15:16.562017 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562003 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 20 19:15:16.562017 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562013 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 20 19:15:16.562202 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562182 2575 factory.go:55] Registering systemd factory Jul 20 19:15:16.562202 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562204 2575 factory.go:223] Registration of the systemd container factory successfully Jul 20 19:15:16.562456 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562441 2575 factory.go:153] Registering CRI-O factory Jul 20 19:15:16.562456 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562458 2575 factory.go:223] Registration of the crio container factory successfully Jul 20 19:15:16.562575 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562504 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 19:15:16.562575 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562529 2575 factory.go:103] Registering Raw factory Jul 20 19:15:16.562575 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.562545 2575 manager.go:1196] Started watching for new ooms in manager Jul 20 19:15:16.563225 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.563203 2575 manager.go:349] Starting recovery of all containers Jul 20 19:15:16.566647 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.566617 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xsq9g" Jul 20 19:15:16.572054 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.572019 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 19:15:16.572170 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.572146 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 19:15:16.575845 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.575828 2575 manager.go:354] Recovery completed Jul 20 19:15:16.577282 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.577264 2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 20 19:15:16.580295 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.580283 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:15:16.582227 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.582214 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:15:16.582274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.582242 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:15:16.582274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.582253 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:16.582806 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.582792 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 19:15:16.582806 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.582803 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 19:15:16.582806 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.582805 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:15:16.582971 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.582819 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:15:16.583473 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.583459 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:15:16.583512 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.583483 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:15:16.583512 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.583493 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:16.583984 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.583972 2575 policy_none.go:49] "None policy: Start" Jul 20 19:15:16.584043 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.583988 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 19:15:16.584043 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.583999 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 19:15:16.584913 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.584901 2575 policy_none.go:47] "Start" Jul 20 19:15:16.621210 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.621194 2575 manager.go:337] "Starting Device Plugin manager" Jul 20 19:15:16.621288 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.621230 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 19:15:16.621288 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.621240 2575 server.go:87] "Starting device plugin registration server" Jul 20 19:15:16.621599 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.621586 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 19:15:16.621639 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.621603 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 19:15:16.621756 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.621723 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 19:15:16.621877 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.621864 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 19:15:16.621930 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.621879 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 19:15:16.622476 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.622451 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 19:15:16.622548 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.622520 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:16.722306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.722044 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:15:16.723358 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.723271 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:15:16.723358 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.723302 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:15:16.723358 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.723313 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:16.723522 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.723367 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.729827 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.729804 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.729905 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.729833 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-129.ec2.internal\": node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:16.743729 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.743679 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 19:15:16.745115 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.745097 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 19:15:16.745219 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.745143 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 19:15:16.745219 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.745172 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 19:15:16.745219 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.745215 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 19:15:16.748700 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.748673 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:16.748963 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.748948 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:16.845855 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.845796 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal"] Jul 20 19:15:16.846036 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.845903 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:15:16.847048 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.847025 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:15:16.847148 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.847065 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:15:16.847148 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.847078 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:16.848269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.848256 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:15:16.848737 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.848719 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.848802 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.848751 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:16.848802 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.848755 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:15:16.849077 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.849064 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:15:16.849143 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.849088 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:15:16.849143 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.849133 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:16.849462 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.849447 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:15:16.849533 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.849470 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:15:16.849533 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.849482 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:16.850383 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.850369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.850466 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.850395 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:15:16.851052 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.851034 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:15:16.851154 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.851065 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:15:16.851154 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.851077 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:16.863562 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.863524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c30068a5c68662c7012fb3acbabc0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal\" (UID: \"63c30068a5c68662c7012fb3acbabc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.863671 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.863579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8911901eb3c917ae3f606fdd7e95c70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-129.ec2.internal\" (UID: \"a8911901eb3c917ae3f606fdd7e95c70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.863671 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.863598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63c30068a5c68662c7012fb3acbabc0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal\" (UID: \"63c30068a5c68662c7012fb3acbabc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.869198 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.869178 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-129.ec2.internal\" not found" node="ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.873459 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.873442 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-129.ec2.internal\" not found" node="ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.949022 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:16.948989 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:16.963831 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.963804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63c30068a5c68662c7012fb3acbabc0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal\" (UID: \"63c30068a5c68662c7012fb3acbabc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.963922 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.963838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c30068a5c68662c7012fb3acbabc0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal\" (UID: \"63c30068a5c68662c7012fb3acbabc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.963922 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.963858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8911901eb3c917ae3f606fdd7e95c70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-129.ec2.internal\" (UID: \"a8911901eb3c917ae3f606fdd7e95c70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.963922 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.963897 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63c30068a5c68662c7012fb3acbabc0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal\" (UID: \"63c30068a5c68662c7012fb3acbabc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.963922 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.963911 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8911901eb3c917ae3f606fdd7e95c70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-129.ec2.internal\" (UID: \"a8911901eb3c917ae3f606fdd7e95c70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" Jul 20 19:15:16.964070 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:16.963924 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c30068a5c68662c7012fb3acbabc0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal\" (UID: \"63c30068a5c68662c7012fb3acbabc0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:17.049299 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.049210 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:17.154494 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.154443 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:17.171863 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.171831 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:17.175929 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.175654 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" Jul 20 19:15:17.255805 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.255734 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:17.362586 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.362499 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:17.463426 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.463385 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-129.ec2.internal\" not found" Jul 20 19:15:17.466140 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.466118 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:17.501798 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.501762 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 19:15:17.501990 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.501943 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:15:17.501990 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.501962 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:15:17.544168 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.544123 2575 apiserver.go:52] "Watching apiserver" Jul 20 19:15:17.561566 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.561531 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" Jul 20 19:15:17.561715 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.561536 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 19:15:17.564338 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.564312 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 19:15:17.564759 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.564737 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mqd6q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859","openshift-cluster-node-tuning-operator/tuned-4h84s","openshift-image-registry/node-ca-j55gg","openshift-multus/multus-9h7qp","openshift-multus/network-metrics-daemon-9v9lk","openshift-network-diagnostics/network-check-target-7885c","openshift-network-operator/iptables-alerter-x5dpf","kube-system/global-pull-secret-syncer-xkvvv","openshift-dns/node-resolver-s9dxv","openshift-multus/multus-additional-cni-plugins-r445h","openshift-ovn-kubernetes/ovnkube-node-x66gd"] Jul 20 19:15:17.566414 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.566396 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.568182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.568138 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.568654 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.568632 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xwzgw\"" Jul 20 19:15:17.568777 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.568700 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 19:15:17.568833 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.568790 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 19:15:17.569344 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.569325 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.570353 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.570310 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 19:15:17.570448 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.570405 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 19:15:17.570584 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.570476 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:10:17 +0000 UTC" deadline="2028-03-22 15:11:39.399724846 +0000 UTC" Jul 20 19:15:17.570584 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.570500 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14659h56m21.829227832s" Jul 20 19:15:17.570584 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.570540 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j44k9\"" Jul 20 19:15:17.570584 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.570568 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 19:15:17.570790 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.570602 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.571327 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.571310 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:17.571516 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.571501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7lgp8\"" Jul 20 19:15:17.571677 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.571569 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:17.571898 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.571882 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.572765 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.572746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 19:15:17.572852 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.572771 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 19:15:17.572852 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.572752 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b6g26\"" Jul 20 19:15:17.572852 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.572756 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 19:15:17.573204 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.573189 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:17.573300 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.573251 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:17.573863 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.573847 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 19:15:17.574086 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.574064 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 19:15:17.574197 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.574126 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 19:15:17.574197 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.574142 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-czf9f\"" Jul 20 19:15:17.574197 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.574183 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 19:15:17.574541 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.574519 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:17.574646 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.574613 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:17.575888 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.575872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.577101 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.577072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.577197 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.577130 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:17.578265 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.578247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.578580 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.578558 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:17.578717 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.578688 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:15:17.578887 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.578869 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" Jul 20 19:15:17.578971 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.578896 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 19:15:17.579282 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.579265 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:17.579442 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.579427 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpkjt\"" Jul 20 19:15:17.579710 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.579697 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.580941 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.580918 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal"] Jul 20 19:15:17.581022 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.581016 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.581372 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.581337 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 19:15:17.581516 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.581497 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xvgs2\"" Jul 20 19:15:17.581659 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.581644 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 19:15:17.582555 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.582304 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 19:15:17.582555 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.582335 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 19:15:17.583652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.583166 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdvmd\"" Jul 20 19:15:17.583652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.583260 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 19:15:17.583921 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.583800 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 19:15:17.584285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.584085 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g6nd5\"" Jul 20 19:15:17.584285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.584107 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 19:15:17.584285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.584125 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 19:15:17.584285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.584107 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 19:15:17.584554 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.584359 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 19:15:17.588503 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.588480 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:15:17.589628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.589609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal"] Jul 20 19:15:17.589702 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.589617 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:15:17.612022 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.611997 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbqjk" Jul 20 19:15:17.620865 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.620818 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbqjk" Jul 20 19:15:17.663050 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.663022 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 19:15:17.666906 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.666884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.667035 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.666912 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-cni-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667035 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.666932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-cni-bin\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667035 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.666954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-ovn\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.667035 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.666988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.667035 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-modprobe-d\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-system-cni-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667113 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-multus-certs\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-slash\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-hosts-file\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcrw\" (UniqueName: \"kubernetes.io/projected/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-kube-api-access-jjcrw\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-sys\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-tuned\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-socket-dir-parent\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-cni-multus\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-kubelet\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-etc-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk82d\" (UniqueName: \"kubernetes.io/projected/7499c9d3-0954-4d59-b467-4b5059a02b12-kube-api-access-fk82d\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-device-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667406 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-lib-modules\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-var-lib-kubelet\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-host\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbfd\" (UniqueName: \"kubernetes.io/projected/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-kube-api-access-xbbfd\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-kubelet\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-run-netns\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-os-release\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aeede71a-2728-4dbd-b660-e64fcd8b74d4-cni-binary-copy\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a2166e3-12e2-49ac-818e-d8b4963039cc-konnectivity-ca\") pod \"konnectivity-agent-mqd6q\" (UID: \"8a2166e3-12e2-49ac-818e-d8b4963039cc\") " pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcc18ed2-4175-46f7-8c7a-8b579144e47a-kubelet-config\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-daemon-config\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.667891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f9wk\" (UniqueName: \"kubernetes.io/projected/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-kube-api-access-5f9wk\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667819 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-tmp-dir\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-system-cni-dir\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cnibin\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-socket-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-registration-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-sys-fs\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.667997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-kubernetes\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-os-release\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-netns\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lzt7\" (UniqueName: \"kubernetes.io/projected/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-kube-api-access-2lzt7\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89zxc\" (UniqueName: \"kubernetes.io/projected/a05b29ad-5c41-4fcb-967a-54914db31116-kube-api-access-89zxc\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-run\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-tmp\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-run-ovn-kubernetes\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.668665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-cni-bin\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668238 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-env-overrides\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7499c9d3-0954-4d59-b467-4b5059a02b12-ovn-node-metrics-cert\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668311 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysctl-conf\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-hostroot\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klvcr\" (UniqueName: \"kubernetes.io/projected/aeede71a-2728-4dbd-b660-e64fcd8b74d4-kube-api-access-klvcr\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-host-slash\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn7l4\" (UniqueName: \"kubernetes.io/projected/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-kube-api-access-gn7l4\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysctl-d\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-cnibin\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-systemd-units\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-ovnkube-config\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a2166e3-12e2-49ac-818e-d8b4963039cc-agent-certs\") pod \"konnectivity-agent-mqd6q\" (UID: \"8a2166e3-12e2-49ac-818e-d8b4963039cc\") " pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.669324 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xrn7\" (UniqueName: \"kubernetes.io/projected/7c8d16c4-e37f-4d23-932c-761f378d2384-kube-api-access-7xrn7\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-systemd\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-systemd\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcc18ed2-4175-46f7-8c7a-8b579144e47a-dbus\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysconfig\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-host\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-etc-selinux\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-conf-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-etc-kubernetes\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-node-log\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.668977 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-log-socket\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.669000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-cni-netd\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.669025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-iptables-alerter-script\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.669093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-k8s-cni-cncf-io\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.669121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.669149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-var-lib-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.669891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.669174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-ovnkube-script-lib\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.670385 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.669199 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-serviceca\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.719899 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.719864 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c30068a5c68662c7012fb3acbabc0d.slice/crio-8ab9196b6c066b7f7204071096804f8bd2c30f731466a19c7219c31e81fc530d WatchSource:0}: Error finding container 8ab9196b6c066b7f7204071096804f8bd2c30f731466a19c7219c31e81fc530d: Status 404 returned error can't find the container with id 8ab9196b6c066b7f7204071096804f8bd2c30f731466a19c7219c31e81fc530d Jul 20 19:15:17.720471 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.720449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8911901eb3c917ae3f606fdd7e95c70.slice/crio-fcad82afb2561608828cb767274054ed9985ebc0e337d13505b2cea290b2f5e7 WatchSource:0}: Error finding container fcad82afb2561608828cb767274054ed9985ebc0e337d13505b2cea290b2f5e7: Status 404 returned error can't find the container with id fcad82afb2561608828cb767274054ed9985ebc0e337d13505b2cea290b2f5e7 Jul 20 19:15:17.726773 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.726756 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:15:17.748356 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.748313 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" event={"ID":"63c30068a5c68662c7012fb3acbabc0d","Type":"ContainerStarted","Data":"8ab9196b6c066b7f7204071096804f8bd2c30f731466a19c7219c31e81fc530d"} Jul 20 19:15:17.749526 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.749504 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" event={"ID":"a8911901eb3c917ae3f606fdd7e95c70","Type":"ContainerStarted","Data":"fcad82afb2561608828cb767274054ed9985ebc0e337d13505b2cea290b2f5e7"} Jul 20 19:15:17.769570 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-tmp-dir\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.769570 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-system-cni-dir\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cnibin\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-socket-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-registration-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-sys-fs\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-kubernetes\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769661 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-system-cni-dir\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769718 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cnibin\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-kubernetes\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.769766 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769737 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-registration-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-os-release\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769786 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-sys-fs\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-socket-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-netns\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769859 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-os-release\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lzt7\" (UniqueName: \"kubernetes.io/projected/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-kube-api-access-2lzt7\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89zxc\" (UniqueName: \"kubernetes.io/projected/a05b29ad-5c41-4fcb-967a-54914db31116-kube-api-access-89zxc\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769921 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-netns\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-tmp-dir\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.769939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-run\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-tmp\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-run-ovn-kubernetes\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-cni-bin\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770081 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-run\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-env-overrides\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770132 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-cni-bin\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770135 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-run-ovn-kubernetes\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.770306 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7499c9d3-0954-4d59-b467-4b5059a02b12-ovn-node-metrics-cert\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770196 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysctl-conf\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-hostroot\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-hostroot\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klvcr\" (UniqueName: \"kubernetes.io/projected/aeede71a-2728-4dbd-b660-e64fcd8b74d4-kube-api-access-klvcr\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-host-slash\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn7l4\" (UniqueName: \"kubernetes.io/projected/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-kube-api-access-gn7l4\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770354 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770374 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysctl-conf\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysctl-d\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770445 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-host-slash\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-cnibin\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-systemd-units\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-ovnkube-config\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a2166e3-12e2-49ac-818e-d8b4963039cc-agent-certs\") pod \"konnectivity-agent-mqd6q\" (UID: \"8a2166e3-12e2-49ac-818e-d8b4963039cc\") " pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.771278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xrn7\" (UniqueName: \"kubernetes.io/projected/7c8d16c4-e37f-4d23-932c-761f378d2384-kube-api-access-7xrn7\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770601 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-env-overrides\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770634 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-cnibin\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770649 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-systemd\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-systemd\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcc18ed2-4175-46f7-8c7a-8b579144e47a-dbus\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysconfig\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770795 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-host\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-etc-selinux\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-systemd-units\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-conf-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-conf-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-systemd\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770944 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-etc-kubernetes\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.770988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-etc-kubernetes\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.772172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-node-log\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771062 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysctl-d\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcc18ed2-4175-46f7-8c7a-8b579144e47a-dbus\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-node-log\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-log-socket\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771105 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-systemd\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-cni-netd\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-sysconfig\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-iptables-alerter-script\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771171 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-k8s-cni-cncf-io\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-host\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771190 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-etc-selinux\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771211 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-log-socket\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771225 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-var-lib-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771243 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-ovnkube-config\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-ovnkube-script-lib\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771256 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-k8s-cni-cncf-io\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.773239 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771240 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-cni-netd\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-serviceca\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771312 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-var-lib-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-serviceca\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771892 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7499c9d3-0954-4d59-b467-4b5059a02b12-ovnkube-script-lib\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-iptables-alerter-script\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-cni-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.771993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-cni-bin\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-cni-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-ovn\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772088 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-cni-bin\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-modprobe-d\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-ovn\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772172 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-run-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-system-cni-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-multus-certs\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-system-cni-dir\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-slash\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772252 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-modprobe-d\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772277 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-slash\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-hosts-file\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-run-multus-certs\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcrw\" (UniqueName: \"kubernetes.io/projected/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-kube-api-access-jjcrw\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-sys\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-tuned\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-socket-dir-parent\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-sys\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772322 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-hosts-file\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-cni-multus\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.774804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772496 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-kubelet\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772501 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-cni-multus\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-etc-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk82d\" (UniqueName: \"kubernetes.io/projected/7499c9d3-0954-4d59-b467-4b5059a02b12-kube-api-access-fk82d\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-socket-dir-parent\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-device-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-lib-modules\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-etc-openvswitch\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-var-lib-kubelet\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-host\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeede71a-2728-4dbd-b660-e64fcd8b74d4-host-var-lib-kubelet\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772675 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbfd\" (UniqueName: \"kubernetes.io/projected/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-kube-api-access-xbbfd\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-kubelet\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-run-netns\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-os-release\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-lib-modules\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aeede71a-2728-4dbd-b660-e64fcd8b74d4-cni-binary-copy\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.775407 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a2166e3-12e2-49ac-818e-d8b4963039cc-konnectivity-ca\") pod \"konnectivity-agent-mqd6q\" (UID: \"8a2166e3-12e2-49ac-818e-d8b4963039cc\") " pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a05b29ad-5c41-4fcb-967a-54914db31116-device-dir\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcc18ed2-4175-46f7-8c7a-8b579144e47a-kubelet-config\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-daemon-config\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772933 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-run-netns\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f9wk\" (UniqueName: \"kubernetes.io/projected/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-kube-api-access-5f9wk\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.773085 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.773151 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs podName:7c8d16c4-e37f-4d23-932c-761f378d2384 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:18.273129455 +0000 UTC m=+2.085997758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs") pod "network-metrics-daemon-9v9lk" (UID: "7c8d16c4-e37f-4d23-932c-761f378d2384") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.773197 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-os-release\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.773344 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-var-lib-kubelet\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.772675 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.773417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7499c9d3-0954-4d59-b467-4b5059a02b12-host-kubelet\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.773473 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcc18ed2-4175-46f7-8c7a-8b579144e47a-kubelet-config\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.773539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-host\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.773796 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:17.775961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.773809 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aeede71a-2728-4dbd-b660-e64fcd8b74d4-cni-binary-copy\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.776659 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.773863 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret podName:bcc18ed2-4175-46f7-8c7a-8b579144e47a nodeName:}" failed. No retries permitted until 2026-07-20 19:15:18.273845619 +0000 UTC m=+2.086713926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret") pod "global-pull-secret-syncer-xkvvv" (UID: "bcc18ed2-4175-46f7-8c7a-8b579144e47a") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:17.776659 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.773942 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a2166e3-12e2-49ac-818e-d8b4963039cc-konnectivity-ca\") pod \"konnectivity-agent-mqd6q\" (UID: \"8a2166e3-12e2-49ac-818e-d8b4963039cc\") " pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.776659 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.774268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aeede71a-2728-4dbd-b660-e64fcd8b74d4-multus-daemon-config\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.776659 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.774749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-tmp\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.776659 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.774821 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7499c9d3-0954-4d59-b467-4b5059a02b12-ovn-node-metrics-cert\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.776659 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.774882 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-etc-tuned\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.776659 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.774927 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a2166e3-12e2-49ac-818e-d8b4963039cc-agent-certs\") pod \"konnectivity-agent-mqd6q\" (UID: \"8a2166e3-12e2-49ac-818e-d8b4963039cc\") " pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.778858 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.778835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89zxc\" (UniqueName: \"kubernetes.io/projected/a05b29ad-5c41-4fcb-967a-54914db31116-kube-api-access-89zxc\") pod \"aws-ebs-csi-driver-node-lq859\" (UID: \"a05b29ad-5c41-4fcb-967a-54914db31116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.778967 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.778837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lzt7\" (UniqueName: \"kubernetes.io/projected/8e8ed9e4-f114-4d1c-95d3-8013a129f8d6-kube-api-access-2lzt7\") pod \"multus-additional-cni-plugins-r445h\" (UID: \"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6\") " pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:17.779238 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.779218 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn7l4\" (UniqueName: \"kubernetes.io/projected/3723b25a-0c1b-4a9c-a856-7ef29a1067e5-kube-api-access-gn7l4\") pod \"iptables-alerter-x5dpf\" (UID: \"3723b25a-0c1b-4a9c-a856-7ef29a1067e5\") " pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.779238 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.779228 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:17.779369 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.779250 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:17.779369 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.779265 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lcnz5 for pod openshift-network-diagnostics/network-check-target-7885c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:17.779369 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:17.779331 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5 podName:5d903ceb-9618-415f-afcb-7b65d88bb69d nodeName:}" failed. No retries permitted until 2026-07-20 19:15:18.279313241 +0000 UTC m=+2.092181531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lcnz5" (UniqueName: "kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5") pod "network-check-target-7885c" (UID: "5d903ceb-9618-415f-afcb-7b65d88bb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:17.779477 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.779394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klvcr\" (UniqueName: \"kubernetes.io/projected/aeede71a-2728-4dbd-b660-e64fcd8b74d4-kube-api-access-klvcr\") pod \"multus-9h7qp\" (UID: \"aeede71a-2728-4dbd-b660-e64fcd8b74d4\") " pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.779896 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.779879 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xrn7\" (UniqueName: \"kubernetes.io/projected/7c8d16c4-e37f-4d23-932c-761f378d2384-kube-api-access-7xrn7\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:17.783975 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.783944 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbfd\" (UniqueName: \"kubernetes.io/projected/44b7c85d-3986-4b6b-b241-c0b8ee8baac6-kube-api-access-xbbfd\") pod \"tuned-4h84s\" (UID: \"44b7c85d-3986-4b6b-b241-c0b8ee8baac6\") " pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.784157 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.784140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcrw\" (UniqueName: \"kubernetes.io/projected/79b0873e-f76f-475c-a02c-ad9bf9ee70b8-kube-api-access-jjcrw\") pod \"node-resolver-s9dxv\" (UID: \"79b0873e-f76f-475c-a02c-ad9bf9ee70b8\") " pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.784903 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.784885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f9wk\" (UniqueName: \"kubernetes.io/projected/d16ce0fc-ce28-49df-9a63-ac85e86b1e93-kube-api-access-5f9wk\") pod \"node-ca-j55gg\" (UID: \"d16ce0fc-ce28-49df-9a63-ac85e86b1e93\") " pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.785301 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.785280 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk82d\" (UniqueName: \"kubernetes.io/projected/7499c9d3-0954-4d59-b467-4b5059a02b12-kube-api-access-fk82d\") pod \"ovnkube-node-x66gd\" (UID: \"7499c9d3-0954-4d59-b467-4b5059a02b12\") " pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:17.901475 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.901372 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:17.910757 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.910729 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2166e3_12e2_49ac_818e_d8b4963039cc.slice/crio-0848fbd8adb3dcf813d2ca44eef414272d03d3077c26f8bbdd04cfb2e032c065 WatchSource:0}: Error finding container 0848fbd8adb3dcf813d2ca44eef414272d03d3077c26f8bbdd04cfb2e032c065: Status 404 returned error can't find the container with id 0848fbd8adb3dcf813d2ca44eef414272d03d3077c26f8bbdd04cfb2e032c065 Jul 20 19:15:17.918023 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.918003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" Jul 20 19:15:17.923777 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.923754 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4h84s" Jul 20 19:15:17.925533 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.925500 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05b29ad_5c41_4fcb_967a_54914db31116.slice/crio-2ddad720c98d8ad366b48993506209976ac25c80a0f59ab9ed6538dfebce36c2 WatchSource:0}: Error finding container 2ddad720c98d8ad366b48993506209976ac25c80a0f59ab9ed6538dfebce36c2: Status 404 returned error can't find the container with id 2ddad720c98d8ad366b48993506209976ac25c80a0f59ab9ed6538dfebce36c2 Jul 20 19:15:17.928198 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.928177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j55gg" Jul 20 19:15:17.931893 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.931865 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b7c85d_3986_4b6b_b241_c0b8ee8baac6.slice/crio-f7fb0df6fc83b6ef754332d5c895324756ba26c54af8860395acf5cd9cbc9d36 WatchSource:0}: Error finding container f7fb0df6fc83b6ef754332d5c895324756ba26c54af8860395acf5cd9cbc9d36: Status 404 returned error can't find the container with id f7fb0df6fc83b6ef754332d5c895324756ba26c54af8860395acf5cd9cbc9d36 Jul 20 19:15:17.937229 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.937203 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16ce0fc_ce28_49df_9a63_ac85e86b1e93.slice/crio-f40f11b7979fd3d5304707ebd73ad8002717f80839e4262fbf1fd5eca251c9a7 WatchSource:0}: Error finding container f40f11b7979fd3d5304707ebd73ad8002717f80839e4262fbf1fd5eca251c9a7: Status 404 returned error can't find the container with id f40f11b7979fd3d5304707ebd73ad8002717f80839e4262fbf1fd5eca251c9a7 Jul 20 19:15:17.958316 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.958287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9h7qp" Jul 20 19:15:17.966766 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.966737 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeede71a_2728_4dbd_b660_e64fcd8b74d4.slice/crio-b1d6740a241d400210ce6b5cda9eebc8cfc2211925bfbd819984e5f190c10633 WatchSource:0}: Error finding container b1d6740a241d400210ce6b5cda9eebc8cfc2211925bfbd819984e5f190c10633: Status 404 returned error can't find the container with id b1d6740a241d400210ce6b5cda9eebc8cfc2211925bfbd819984e5f190c10633 Jul 20 19:15:17.970302 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.970273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5dpf" Jul 20 19:15:17.978597 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.978560 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3723b25a_0c1b_4a9c_a856_7ef29a1067e5.slice/crio-27e224137ba46c130ac107247cc0fe10558f3b571a0e1bced890b7f0ab012dfb WatchSource:0}: Error finding container 27e224137ba46c130ac107247cc0fe10558f3b571a0e1bced890b7f0ab012dfb: Status 404 returned error can't find the container with id 27e224137ba46c130ac107247cc0fe10558f3b571a0e1bced890b7f0ab012dfb Jul 20 19:15:17.984106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.984086 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s9dxv" Jul 20 19:15:17.992100 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:17.992071 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b0873e_f76f_475c_a02c_ad9bf9ee70b8.slice/crio-2017dfdb9fc4c62378c9f0cdad17a7ae5bc6771719838dd691915728ba926a42 WatchSource:0}: Error finding container 2017dfdb9fc4c62378c9f0cdad17a7ae5bc6771719838dd691915728ba926a42: Status 404 returned error can't find the container with id 2017dfdb9fc4c62378c9f0cdad17a7ae5bc6771719838dd691915728ba926a42 Jul 20 19:15:17.999429 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:17.999399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r445h" Jul 20 19:15:18.003832 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.003813 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:18.010646 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:18.010623 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8ed9e4_f114_4d1c_95d3_8013a129f8d6.slice/crio-ed8b53caf64019cc99667c0b9ab457d0ee1a268eaaf4198d18e009ecdc6c81a4 WatchSource:0}: Error finding container ed8b53caf64019cc99667c0b9ab457d0ee1a268eaaf4198d18e009ecdc6c81a4: Status 404 returned error can't find the container with id ed8b53caf64019cc99667c0b9ab457d0ee1a268eaaf4198d18e009ecdc6c81a4 Jul 20 19:15:18.012144 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:15:18.012125 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7499c9d3_0954_4d59_b467_4b5059a02b12.slice/crio-0bb2c43bf6a77f4de5b84b98c20d0437a98317c2068a664b1902dedac0b56472 WatchSource:0}: Error finding container 0bb2c43bf6a77f4de5b84b98c20d0437a98317c2068a664b1902dedac0b56472: Status 404 returned error can't find the container with id 0bb2c43bf6a77f4de5b84b98c20d0437a98317c2068a664b1902dedac0b56472 Jul 20 19:15:18.104017 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.103982 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:18.150576 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.150540 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:18.277865 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.277250 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:18.277865 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.277296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:18.277865 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.277468 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:18.277865 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.277532 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs podName:7c8d16c4-e37f-4d23-932c-761f378d2384 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:19.277512922 +0000 UTC m=+3.090381211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs") pod "network-metrics-daemon-9v9lk" (UID: "7c8d16c4-e37f-4d23-932c-761f378d2384") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:18.277865 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.277570 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:18.277865 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.277640 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret podName:bcc18ed2-4175-46f7-8c7a-8b579144e47a nodeName:}" failed. No retries permitted until 2026-07-20 19:15:19.27761117 +0000 UTC m=+3.090479460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret") pod "global-pull-secret-syncer-xkvvv" (UID: "bcc18ed2-4175-46f7-8c7a-8b579144e47a") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:18.378186 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.378122 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:18.378407 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.378386 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:18.378496 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.378409 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:18.378496 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.378424 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lcnz5 for pod openshift-network-diagnostics/network-check-target-7885c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:18.378603 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.378516 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5 podName:5d903ceb-9618-415f-afcb-7b65d88bb69d nodeName:}" failed. No retries permitted until 2026-07-20 19:15:19.378495128 +0000 UTC m=+3.191363433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcnz5" (UniqueName: "kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5") pod "network-check-target-7885c" (UID: "5d903ceb-9618-415f-afcb-7b65d88bb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:18.623305 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.623126 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:10:18 +0000 UTC" deadline="2028-01-22 03:11:36.884662679 +0000 UTC" Jul 20 19:15:18.623305 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.623194 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13207h56m18.261473218s" Jul 20 19:15:18.749547 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.749355 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:18.750346 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.750078 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:18.751139 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:18.750793 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:18.766961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.766928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"0bb2c43bf6a77f4de5b84b98c20d0437a98317c2068a664b1902dedac0b56472"} Jul 20 19:15:18.783259 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.783227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerStarted","Data":"ed8b53caf64019cc99667c0b9ab457d0ee1a268eaaf4198d18e009ecdc6c81a4"} Jul 20 19:15:18.798807 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.798156 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5dpf" event={"ID":"3723b25a-0c1b-4a9c-a856-7ef29a1067e5","Type":"ContainerStarted","Data":"27e224137ba46c130ac107247cc0fe10558f3b571a0e1bced890b7f0ab012dfb"} Jul 20 19:15:18.824218 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.824181 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9h7qp" event={"ID":"aeede71a-2728-4dbd-b660-e64fcd8b74d4","Type":"ContainerStarted","Data":"b1d6740a241d400210ce6b5cda9eebc8cfc2211925bfbd819984e5f190c10633"} Jul 20 19:15:18.842947 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.842892 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j55gg" event={"ID":"d16ce0fc-ce28-49df-9a63-ac85e86b1e93","Type":"ContainerStarted","Data":"f40f11b7979fd3d5304707ebd73ad8002717f80839e4262fbf1fd5eca251c9a7"} Jul 20 19:15:18.862877 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.862834 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" event={"ID":"a05b29ad-5c41-4fcb-967a-54914db31116","Type":"ContainerStarted","Data":"2ddad720c98d8ad366b48993506209976ac25c80a0f59ab9ed6538dfebce36c2"} Jul 20 19:15:18.876075 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.875958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s9dxv" event={"ID":"79b0873e-f76f-475c-a02c-ad9bf9ee70b8","Type":"ContainerStarted","Data":"2017dfdb9fc4c62378c9f0cdad17a7ae5bc6771719838dd691915728ba926a42"} Jul 20 19:15:18.886229 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.886137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4h84s" event={"ID":"44b7c85d-3986-4b6b-b241-c0b8ee8baac6","Type":"ContainerStarted","Data":"f7fb0df6fc83b6ef754332d5c895324756ba26c54af8860395acf5cd9cbc9d36"} Jul 20 19:15:18.896871 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:18.896758 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqd6q" event={"ID":"8a2166e3-12e2-49ac-818e-d8b4963039cc","Type":"ContainerStarted","Data":"0848fbd8adb3dcf813d2ca44eef414272d03d3077c26f8bbdd04cfb2e032c065"} Jul 20 19:15:19.286992 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:19.286885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:19.286992 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:19.286941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:19.287235 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.287119 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:19.287235 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.287184 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs podName:7c8d16c4-e37f-4d23-932c-761f378d2384 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:21.287164768 +0000 UTC m=+5.100033063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs") pod "network-metrics-daemon-9v9lk" (UID: "7c8d16c4-e37f-4d23-932c-761f378d2384") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:19.287645 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.287619 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:19.287764 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.287682 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret podName:bcc18ed2-4175-46f7-8c7a-8b579144e47a nodeName:}" failed. No retries permitted until 2026-07-20 19:15:21.28766653 +0000 UTC m=+5.100534819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret") pod "global-pull-secret-syncer-xkvvv" (UID: "bcc18ed2-4175-46f7-8c7a-8b579144e47a") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:19.388233 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:19.388189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:19.388452 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.388394 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:19.388452 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.388417 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:19.388452 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.388431 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lcnz5 for pod openshift-network-diagnostics/network-check-target-7885c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:19.388658 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.388516 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5 podName:5d903ceb-9618-415f-afcb-7b65d88bb69d nodeName:}" failed. No retries permitted until 2026-07-20 19:15:21.388495365 +0000 UTC m=+5.201363668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcnz5" (UniqueName: "kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5") pod "network-check-target-7885c" (UID: "5d903ceb-9618-415f-afcb-7b65d88bb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:19.624493 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:19.624176 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:10:18 +0000 UTC" deadline="2028-02-27 16:59:50.093637335 +0000 UTC" Jul 20 19:15:19.624493 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:19.624217 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14085h44m30.469424902s" Jul 20 19:15:19.745804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:19.745765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:19.745986 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.745900 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:19.746343 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:19.746320 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:19.746455 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:19.746432 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:20.067663 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:20.067574 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:20.749461 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:20.749378 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:20.749951 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:20.749555 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:21.306767 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:21.306513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:21.306767 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:21.306568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:21.306767 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.306727 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:21.307052 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.306798 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs podName:7c8d16c4-e37f-4d23-932c-761f378d2384 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:25.306776861 +0000 UTC m=+9.119645172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs") pod "network-metrics-daemon-9v9lk" (UID: "7c8d16c4-e37f-4d23-932c-761f378d2384") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:21.307686 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.307193 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:21.307686 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.307259 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret podName:bcc18ed2-4175-46f7-8c7a-8b579144e47a nodeName:}" failed. No retries permitted until 2026-07-20 19:15:25.307240086 +0000 UTC m=+9.120108380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret") pod "global-pull-secret-syncer-xkvvv" (UID: "bcc18ed2-4175-46f7-8c7a-8b579144e47a") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:21.407840 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:21.407790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:21.408033 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.407991 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:21.408033 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.408015 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:21.408033 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.408027 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lcnz5 for pod openshift-network-diagnostics/network-check-target-7885c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:21.408324 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.408085 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5 podName:5d903ceb-9618-415f-afcb-7b65d88bb69d nodeName:}" failed. No retries permitted until 2026-07-20 19:15:25.408066274 +0000 UTC m=+9.220934559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcnz5" (UniqueName: "kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5") pod "network-check-target-7885c" (UID: "5d903ceb-9618-415f-afcb-7b65d88bb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:21.745795 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:21.745703 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:21.745795 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:21.745737 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:21.746096 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.745861 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:21.746096 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:21.745962 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:22.747957 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:22.747523 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:22.747957 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:22.747661 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:23.746023 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:23.745718 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:23.746023 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:23.745855 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:23.746301 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:23.746161 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:23.746301 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:23.746255 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:24.746525 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:24.746430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:24.746995 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:24.746568 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:25.337920 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:25.337852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:25.337920 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:25.337915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:25.338204 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.338071 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:25.338204 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.338159 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs podName:7c8d16c4-e37f-4d23-932c-761f378d2384 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:33.338135922 +0000 UTC m=+17.151004211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs") pod "network-metrics-daemon-9v9lk" (UID: "7c8d16c4-e37f-4d23-932c-761f378d2384") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:25.338204 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.338071 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:25.338375 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.338269 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret podName:bcc18ed2-4175-46f7-8c7a-8b579144e47a nodeName:}" failed. No retries permitted until 2026-07-20 19:15:33.338245574 +0000 UTC m=+17.151113861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret") pod "global-pull-secret-syncer-xkvvv" (UID: "bcc18ed2-4175-46f7-8c7a-8b579144e47a") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:25.439060 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:25.438953 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:25.439253 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.439193 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:25.439253 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.439228 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:25.439253 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.439244 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lcnz5 for pod openshift-network-diagnostics/network-check-target-7885c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:25.439412 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.439363 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5 podName:5d903ceb-9618-415f-afcb-7b65d88bb69d nodeName:}" failed. No retries permitted until 2026-07-20 19:15:33.439336773 +0000 UTC m=+17.252205064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcnz5" (UniqueName: "kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5") pod "network-check-target-7885c" (UID: "5d903ceb-9618-415f-afcb-7b65d88bb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:25.746162 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:25.746082 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:25.746344 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.746183 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:25.746573 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:25.746551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:25.746900 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:25.746666 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:26.746959 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:26.746924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:26.747401 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:26.747046 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:27.746758 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:27.746294 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:27.746758 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:27.746444 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:27.746758 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:27.746610 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:27.746758 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:27.746693 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:28.745900 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:28.745854 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:28.746141 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:28.746005 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:29.746237 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:29.746197 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:29.746730 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:29.746241 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:29.746730 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:29.746321 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:29.746730 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:29.746456 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:30.746267 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:30.746229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:30.746740 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:30.746380 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:31.745821 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:31.745777 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:31.746003 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:31.745826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:31.746003 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:31.745937 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:31.746137 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:31.746066 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:32.746030 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:32.745998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:32.746448 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:32.746116 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:33.401234 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:33.401195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:33.401234 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:33.401238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:33.401522 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.401373 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:33.401522 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.401373 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:33.401522 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.401466 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs podName:7c8d16c4-e37f-4d23-932c-761f378d2384 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:49.401446005 +0000 UTC m=+33.214314313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs") pod "network-metrics-daemon-9v9lk" (UID: "7c8d16c4-e37f-4d23-932c-761f378d2384") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:33.401968 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.401531 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret podName:bcc18ed2-4175-46f7-8c7a-8b579144e47a nodeName:}" failed. No retries permitted until 2026-07-20 19:15:49.401509548 +0000 UTC m=+33.214377845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret") pod "global-pull-secret-syncer-xkvvv" (UID: "bcc18ed2-4175-46f7-8c7a-8b579144e47a") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:33.502282 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:33.502241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:33.505328 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.502812 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:33.505328 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.502868 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:33.505328 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.502889 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lcnz5 for pod openshift-network-diagnostics/network-check-target-7885c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:33.505328 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.503001 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5 podName:5d903ceb-9618-415f-afcb-7b65d88bb69d nodeName:}" failed. No retries permitted until 2026-07-20 19:15:49.50297772 +0000 UTC m=+33.315846086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcnz5" (UniqueName: "kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5") pod "network-check-target-7885c" (UID: "5d903ceb-9618-415f-afcb-7b65d88bb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:33.745627 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:33.745545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:33.745627 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:33.745582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:33.745846 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.745671 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:33.745846 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:33.745803 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:34.746013 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:34.745969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:34.746617 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:34.746122 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:35.745676 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:35.745640 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:35.745858 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:35.745641 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:35.745858 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:35.745752 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:35.745939 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:35.745889 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:36.746842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:36.746806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:36.747268 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:36.746919 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:37.745672 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:37.745634 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:37.745878 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:37.745634 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:37.745878 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:37.745763 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:37.745878 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:37.745844 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:38.746067 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:38.746026 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:38.746481 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:38.746179 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:39.745789 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.745473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:39.745929 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:39.745862 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:39.745929 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.745506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:39.745929 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:39.745918 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:39.944752 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.944713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqd6q" event={"ID":"8a2166e3-12e2-49ac-818e-d8b4963039cc","Type":"ContainerStarted","Data":"b1d3cbd3915b28a3ebb250e9a048541856c6822016910734a9e7b10cee113bb8"} Jul 20 19:15:39.947143 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.947118 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"60b37239b62eefa6f060a15a2ef1ea3552df0cdd6f4b5b06e0d38ec9158882a7"} Jul 20 19:15:39.947285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.947188 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"c77371fe6ec6d960ec76e31c30fc17db59a632e07d96e01fb4561745a71d72ca"} Jul 20 19:15:39.947285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.947226 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"45bdc51f539a843cf57a49437033e8f3385c33dcb1c38947bcf1d91d4530c1d2"} Jul 20 19:15:39.947285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.947259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"9cb7ca38b2320c2574c98c6fafa91131f09b04bd058ab2945c906a8e82c84a3d"} Jul 20 19:15:39.948749 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.948728 2575 generic.go:356] "Generic (PLEG): container finished" podID="8e8ed9e4-f114-4d1c-95d3-8013a129f8d6" containerID="a38b57e91117d60943f0eccf95e863d84019377b95cff28b4984c5ebb8b5b29a" exitCode=0 Jul 20 19:15:39.948848 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.948802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerDied","Data":"a38b57e91117d60943f0eccf95e863d84019377b95cff28b4984c5ebb8b5b29a"} Jul 20 19:15:39.950263 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.950241 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9h7qp" event={"ID":"aeede71a-2728-4dbd-b660-e64fcd8b74d4","Type":"ContainerStarted","Data":"366625066fa80df0437d64f579ff46880124a00ab7b6ac29e3a53cfcc1cd0821"} Jul 20 19:15:39.951648 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.951613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j55gg" event={"ID":"d16ce0fc-ce28-49df-9a63-ac85e86b1e93","Type":"ContainerStarted","Data":"a74c73021d148254fd83dd6e8812491674b6175225d8b359fd411e122d784196"} Jul 20 19:15:39.953021 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.953003 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" event={"ID":"a05b29ad-5c41-4fcb-967a-54914db31116","Type":"ContainerStarted","Data":"672fed572817cfe4a4f7d3227e275961476c0ce7e76f4f5834f22cb392bf2247"} Jul 20 19:15:39.954489 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.954460 2575 generic.go:356] "Generic (PLEG): container finished" podID="63c30068a5c68662c7012fb3acbabc0d" containerID="a0b0a553777786437bdc8c7d466000769c2b9cd3a45b5e1c890ec44e290e9cf2" exitCode=0 Jul 20 19:15:39.954586 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.954522 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" event={"ID":"63c30068a5c68662c7012fb3acbabc0d","Type":"ContainerDied","Data":"a0b0a553777786437bdc8c7d466000769c2b9cd3a45b5e1c890ec44e290e9cf2"} Jul 20 19:15:39.958163 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.958130 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" event={"ID":"a8911901eb3c917ae3f606fdd7e95c70","Type":"ContainerStarted","Data":"3d4ba1c1a809636c391a208d0361c158269835764119ab35efd56c1d0b343bf7"} Jul 20 19:15:39.959153 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.959099 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mqd6q" podStartSLOduration=1.953367254 podStartE2EDuration="22.959083583s" totalImagesPullingTime="21.005716329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:39.958762501 +0000 UTC m=+23.771630808" watchObservedRunningTime="2026-07-20 19:15:39.959083583 +0000 UTC m=+23.771951888" Jul 20 19:15:39.959778 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.959755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s9dxv" event={"ID":"79b0873e-f76f-475c-a02c-ad9bf9ee70b8","Type":"ContainerStarted","Data":"5a0385a18d24ad519693039f33bfa7c1cb36ab7956d8fee1a30e137815c19228"} Jul 20 19:15:39.961179 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.961149 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4h84s" event={"ID":"44b7c85d-3986-4b6b-b241-c0b8ee8baac6","Type":"ContainerStarted","Data":"9d112349ac40cc583874cfec1ce8e250b31b6539ce2207601ba402878a7c6173"} Jul 20 19:15:39.971763 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.971726 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-129.ec2.internal" podStartSLOduration=21.971710357 podStartE2EDuration="21.971710357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:39.970901258 +0000 UTC m=+23.783769566" watchObservedRunningTime="2026-07-20 19:15:39.971710357 +0000 UTC m=+23.784578662" Jul 20 19:15:39.986053 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:39.986010 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j55gg" podStartSLOduration=10.349059513 podStartE2EDuration="22.985995673s" totalImagesPullingTime="12.63693616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:39.985887198 +0000 UTC m=+23.798755504" watchObservedRunningTime="2026-07-20 19:15:39.985995673 +0000 UTC m=+23.798863978" Jul 20 19:15:40.023883 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.023835 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9h7qp" podStartSLOduration=1.977673304 podStartE2EDuration="23.02381846s" totalImagesPullingTime="21.046145156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:40.023140751 +0000 UTC m=+23.836009058" watchObservedRunningTime="2026-07-20 19:15:40.02381846 +0000 UTC m=+23.836686765" Jul 20 19:15:40.060968 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.060913 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4h84s" podStartSLOduration=1.99194874 podStartE2EDuration="23.060891511s" totalImagesPullingTime="21.068942771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:40.040855234 +0000 UTC m=+23.853723539" watchObservedRunningTime="2026-07-20 19:15:40.060891511 +0000 UTC m=+23.873759818" Jul 20 19:15:40.071102 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.071076 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:40.746381 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.746348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:40.746597 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:40.746514 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:40.950148 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.949936 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 19:15:40.967250 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.967214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"329996463be70b135e648f26052ce2c1aaa50b54a63829196145d022a7e73928"} Jul 20 19:15:40.967478 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.967339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"b5cc0c4336315629e40c0499926462616f6923e57b8c759a9642e5442fe52b1b"} Jul 20 19:15:40.968839 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.968804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5dpf" event={"ID":"3723b25a-0c1b-4a9c-a856-7ef29a1067e5","Type":"ContainerStarted","Data":"4512aad9ffd67b8a92f2c62633854be5fb0eb2f7577cebad4752bff39b0dbb98"} Jul 20 19:15:40.971153 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.971127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" event={"ID":"a05b29ad-5c41-4fcb-967a-54914db31116","Type":"ContainerStarted","Data":"fc7daf899cb10c2ce9ca0f3b81958f1ac3f80f7ec1f4940e7df56f5534d0dcd6"} Jul 20 19:15:40.993372 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.993320 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x5dpf" podStartSLOduration=2.994601073 podStartE2EDuration="23.993300766s" totalImagesPullingTime="20.998699693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:40.992888025 +0000 UTC m=+24.805756350" watchObservedRunningTime="2026-07-20 19:15:40.993300766 +0000 UTC m=+24.806169075" Jul 20 19:15:40.993532 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:40.993452 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s9dxv" podStartSLOduration=3.068884276 podStartE2EDuration="23.993441935s" totalImagesPullingTime="20.924557659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:40.06037967 +0000 UTC m=+23.873247976" watchObservedRunningTime="2026-07-20 19:15:40.993441935 +0000 UTC m=+24.806310241" Jul 20 19:15:41.634528 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:41.634390 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:15:40.950132141Z","UUID":"28c94db5-219d-4f83-94de-f35bbd8e4ce6","Handler":null,"Name":"","Endpoint":""} Jul 20 19:15:41.636095 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:41.636072 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 19:15:41.636224 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:41.636109 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 19:15:41.745933 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:41.745897 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:41.746111 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:41.745907 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:41.746111 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:41.746029 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:41.746111 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:41.746067 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:41.974238 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:41.974162 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" event={"ID":"63c30068a5c68662c7012fb3acbabc0d","Type":"ContainerStarted","Data":"22d44db49e1cf1d4a9c60a6830d0866722f7a8009e68396a6809a8be708be79f"} Jul 20 19:15:41.989426 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:41.989378 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-129.ec2.internal" podStartSLOduration=23.989364623 podStartE2EDuration="23.989364623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:41.988909976 +0000 UTC m=+25.801778281" watchObservedRunningTime="2026-07-20 19:15:41.989364623 +0000 UTC m=+25.802232929" Jul 20 19:15:42.745617 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:42.745581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:42.745803 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:42.745735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:42.983475 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:42.983431 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"e0a7ae920696d48ddcdf4bd90b2ac9955d1538f08897a3004f79ea329ce745dd"} Jul 20 19:15:42.985774 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:42.985741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" event={"ID":"a05b29ad-5c41-4fcb-967a-54914db31116","Type":"ContainerStarted","Data":"a87e5b08b1df5da5bdc37d8de309b6057fe336514e040d79b3a3b2392a0a338c"} Jul 20 19:15:43.006002 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:43.005898 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq859" podStartSLOduration=2.433197801 podStartE2EDuration="26.005883107s" totalImagesPullingTime="23.572685306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:43.005578626 +0000 UTC m=+26.818446951" watchObservedRunningTime="2026-07-20 19:15:43.005883107 +0000 UTC m=+26.818751412" Jul 20 19:15:43.745983 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:43.745947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:43.746211 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:43.745948 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:43.746211 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:43.746073 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:43.746211 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:43.746183 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:43.783558 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:43.783518 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:43.784269 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:43.784242 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:43.988937 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:43.988909 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mqd6q" Jul 20 19:15:44.746298 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:44.746107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:44.746443 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:44.746396 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:44.994214 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:44.994180 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" event={"ID":"7499c9d3-0954-4d59-b467-4b5059a02b12","Type":"ContainerStarted","Data":"374bf5ead7e20675c31f499b0fec6efb7e9b897b3032fb2752534e3606c5e8ec"} Jul 20 19:15:44.994804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:44.994443 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:44.996098 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:44.996068 2575 generic.go:356] "Generic (PLEG): container finished" podID="8e8ed9e4-f114-4d1c-95d3-8013a129f8d6" containerID="9d28c8b981f9137446280451ecbe06826e1bf5b6dbbd63652eb772f51ad38434" exitCode=0 Jul 20 19:15:44.996218 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:44.996138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerDied","Data":"9d28c8b981f9137446280451ecbe06826e1bf5b6dbbd63652eb772f51ad38434"} Jul 20 19:15:45.010120 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:45.010090 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:45.024558 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:45.024509 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" podStartSLOduration=6.702536132 podStartE2EDuration="28.024493827s" totalImagesPullingTime="21.321957695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:45.024046841 +0000 UTC m=+28.836915174" watchObservedRunningTime="2026-07-20 19:15:45.024493827 +0000 UTC m=+28.837362133" Jul 20 19:15:45.745501 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:45.745474 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:45.745669 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:45.745474 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:45.745669 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:45.745576 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:45.745669 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:45.745626 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:45.999075 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:45.999001 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:45.999632 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:45.999095 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:46.013931 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.013904 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:15:46.552774 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.552523 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkvvv"] Jul 20 19:15:46.552947 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.552800 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:46.552947 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:46.552887 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:46.555856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.555819 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7885c"] Jul 20 19:15:46.555983 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.555915 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:46.556037 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:46.556012 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:46.556406 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.556387 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9v9lk"] Jul 20 19:15:46.556508 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.556498 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:46.556601 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:46.556584 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:46.847423 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:46.847307 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s9dxv_79b0873e-f76f-475c-a02c-ad9bf9ee70b8/dns-node-resolver/0.log" Jul 20 19:15:47.002684 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:47.002648 2575 generic.go:356] "Generic (PLEG): container finished" podID="8e8ed9e4-f114-4d1c-95d3-8013a129f8d6" containerID="c274e67f9dc1e3b5cc010910e599f7c854f9666e05b99e0cce8a5cd16106a203" exitCode=0 Jul 20 19:15:47.003191 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:47.002694 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerDied","Data":"c274e67f9dc1e3b5cc010910e599f7c854f9666e05b99e0cce8a5cd16106a203"} Jul 20 19:15:47.746385 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:47.746348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:47.746604 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:47.746497 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:47.787170 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:47.787141 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j55gg_d16ce0fc-ce28-49df-9a63-ac85e86b1e93/node-ca/0.log" Jul 20 19:15:48.746372 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:48.746328 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:48.746770 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:48.746497 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:48.746770 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:48.746543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:48.746770 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:48.746649 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:49.009957 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:49.009919 2575 generic.go:356] "Generic (PLEG): container finished" podID="8e8ed9e4-f114-4d1c-95d3-8013a129f8d6" containerID="e25b03cc28608e53e111314748842bc41b2d77092d3c0f8a0e4cb468a65183cf" exitCode=0 Jul 20 19:15:49.010130 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:49.009981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerDied","Data":"e25b03cc28608e53e111314748842bc41b2d77092d3c0f8a0e4cb468a65183cf"} Jul 20 19:15:49.420626 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:49.420587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:49.420626 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:49.420637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:49.420860 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.420741 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:49.420860 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.420806 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret podName:bcc18ed2-4175-46f7-8c7a-8b579144e47a nodeName:}" failed. No retries permitted until 2026-07-20 19:16:21.420790441 +0000 UTC m=+65.233658729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret") pod "global-pull-secret-syncer-xkvvv" (UID: "bcc18ed2-4175-46f7-8c7a-8b579144e47a") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:49.420860 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.420747 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:49.420982 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.420889 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs podName:7c8d16c4-e37f-4d23-932c-761f378d2384 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:21.420872785 +0000 UTC m=+65.233741078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs") pod "network-metrics-daemon-9v9lk" (UID: "7c8d16c4-e37f-4d23-932c-761f378d2384") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:49.521512 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:49.521473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:49.521675 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.521623 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:49.521675 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.521643 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:49.521675 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.521653 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lcnz5 for pod openshift-network-diagnostics/network-check-target-7885c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:49.521785 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.521706 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5 podName:5d903ceb-9618-415f-afcb-7b65d88bb69d nodeName:}" failed. No retries permitted until 2026-07-20 19:16:21.521691384 +0000 UTC m=+65.334559680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcnz5" (UniqueName: "kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5") pod "network-check-target-7885c" (UID: "5d903ceb-9618-415f-afcb-7b65d88bb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:49.746038 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:49.745998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:49.746217 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:49.746137 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:50.746225 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:50.746174 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:50.746732 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:50.746317 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:50.746732 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:50.746365 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:50.746732 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:50.746482 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:51.746249 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:51.746199 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:51.746733 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:51.746366 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:52.746402 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:52.746367 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:52.746872 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:52.746508 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:52.746872 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:52.746565 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:52.746872 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:52.746668 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:53.746389 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:53.746351 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:53.746585 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:53.746483 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:54.024548 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:54.024452 2575 generic.go:356] "Generic (PLEG): container finished" podID="8e8ed9e4-f114-4d1c-95d3-8013a129f8d6" containerID="8fc35aa057d822a1b40b2106724f606e708a13c537b3dc446b1ccd4927ae23e6" exitCode=0 Jul 20 19:15:54.024548 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:54.024491 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerDied","Data":"8fc35aa057d822a1b40b2106724f606e708a13c537b3dc446b1ccd4927ae23e6"} Jul 20 19:15:54.746356 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:54.746324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:54.746530 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:54.746367 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:54.746530 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:54.746484 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:54.746608 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:54.746579 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:55.029619 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:55.029341 2575 generic.go:356] "Generic (PLEG): container finished" podID="8e8ed9e4-f114-4d1c-95d3-8013a129f8d6" containerID="692dcd856e120c761f233f55f75ee0697d6a255f5cbdf8edc1aecc7d5468d93a" exitCode=0 Jul 20 19:15:55.029619 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:55.029404 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerDied","Data":"692dcd856e120c761f233f55f75ee0697d6a255f5cbdf8edc1aecc7d5468d93a"} Jul 20 19:15:55.745994 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:55.745956 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:55.746172 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:55.746073 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:56.038376 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:56.038291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r445h" event={"ID":"8e8ed9e4-f114-4d1c-95d3-8013a129f8d6","Type":"ContainerStarted","Data":"2ec8e2d101d4ca79693ca03d6672e7489fc5acfd1d6528924e2e687ec0017c56"} Jul 20 19:15:56.062128 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:56.062073 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r445h" podStartSLOduration=7.40755123 podStartE2EDuration="39.062056498s" totalImagesPullingTime="31.654505268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:56.060408155 +0000 UTC m=+39.873276463" watchObservedRunningTime="2026-07-20 19:15:56.062056498 +0000 UTC m=+39.874924803" Jul 20 19:15:56.746915 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:56.746878 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:56.747072 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:56.746966 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:56.747072 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:56.747017 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:56.747157 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:56.747100 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:57.745927 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:57.745890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:57.746296 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:57.746005 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:15:58.745602 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:58.745568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:15:58.745783 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:58.745569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:15:58.745783 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:58.745692 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:15:58.745783 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:58.745757 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:15:59.745907 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:15:59.745871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:15:59.746294 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:15:59.745989 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:16:00.745993 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:00.745952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:00.746381 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:00.746070 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:16:00.746381 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:00.746148 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:00.746381 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:00.746258 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:16:01.745572 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:01.745535 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:01.745740 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:01.745650 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:16:02.745974 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:02.745936 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:02.746459 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:02.746047 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:16:02.746459 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:02.746130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:02.746459 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:02.746234 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:16:03.746307 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:03.746262 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:03.746731 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:03.746381 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:16:04.745589 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:04.745562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:04.745745 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:04.745562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:04.745745 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:04.745665 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:16:04.745745 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:04.745725 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:16:05.746067 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:05.746036 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:05.746492 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:05.746144 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:16:06.746731 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:06.746686 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:06.747122 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:06.746789 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:16:06.747122 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:06.746876 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:06.747122 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:06.746978 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:16:07.745921 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:07.745878 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:07.746099 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:07.745992 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:16:08.745584 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:08.745548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:08.745584 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:08.745585 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:08.746078 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:08.745657 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkvvv" podUID="bcc18ed2-4175-46f7-8c7a-8b579144e47a" Jul 20 19:16:08.746078 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:08.745789 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7885c" podUID="5d903ceb-9618-415f-afcb-7b65d88bb69d" Jul 20 19:16:09.745859 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:09.745835 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:09.746211 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:09.746002 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v9lk" podUID="7c8d16c4-e37f-4d23-932c-761f378d2384" Jul 20 19:16:10.002645 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.002565 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-129.ec2.internal" event="NodeReady" Jul 20 19:16:10.002795 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.002711 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 19:16:10.076843 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.076805 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-54xdf"] Jul 20 19:16:10.097783 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.097749 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dd9dh"] Jul 20 19:16:10.097955 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.097875 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.100581 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.100557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 19:16:10.100720 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.100708 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bcdr2\"" Jul 20 19:16:10.100931 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.100915 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 19:16:10.118376 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.118350 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd9dh"] Jul 20 19:16:10.118507 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.118398 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-54xdf"] Jul 20 19:16:10.118507 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.118443 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bbr7w"] Jul 20 19:16:10.118626 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.118609 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.121467 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.121443 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 19:16:10.121591 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.121565 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 19:16:10.121833 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.121817 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 19:16:10.121888 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.121837 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 19:16:10.122922 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.122475 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxtng\"" Jul 20 19:16:10.136508 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.136476 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbr7w"] Jul 20 19:16:10.136632 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.136560 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.141820 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.141802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 19:16:10.142391 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.142366 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 19:16:10.142523 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.142406 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 19:16:10.143478 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.143464 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tf5d7\"" Jul 20 19:16:10.271646 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df81c97f-3744-4cb0-9db2-d112a7043ade-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.271646 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e02ac804-8a07-468e-9c17-21d5098b5782-cert\") pod \"ingress-canary-bbr7w\" (UID: \"e02ac804-8a07-468e-9c17-21d5098b5782\") " pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.271646 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp9z4\" (UniqueName: \"kubernetes.io/projected/df81c97f-3744-4cb0-9db2-d112a7043ade-kube-api-access-dp9z4\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.271907 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271716 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/608e3dfb-ec68-4166-b943-26df269dda57-metrics-tls\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.271907 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmhft\" (UniqueName: \"kubernetes.io/projected/608e3dfb-ec68-4166-b943-26df269dda57-kube-api-access-bmhft\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.271907 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df81c97f-3744-4cb0-9db2-d112a7043ade-data-volume\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.271907 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df81c97f-3744-4cb0-9db2-d112a7043ade-crio-socket\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.271907 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271860 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608e3dfb-ec68-4166-b943-26df269dda57-tmp-dir\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.271907 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89scl\" (UniqueName: \"kubernetes.io/projected/e02ac804-8a07-468e-9c17-21d5098b5782-kube-api-access-89scl\") pod \"ingress-canary-bbr7w\" (UID: \"e02ac804-8a07-468e-9c17-21d5098b5782\") " pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.272105 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df81c97f-3744-4cb0-9db2-d112a7043ade-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.272105 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.271926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/608e3dfb-ec68-4166-b943-26df269dda57-config-volume\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.372943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.372904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df81c97f-3744-4cb0-9db2-d112a7043ade-crio-socket\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.372943 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.372946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608e3dfb-ec68-4166-b943-26df269dda57-tmp-dir\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.372967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89scl\" (UniqueName: \"kubernetes.io/projected/e02ac804-8a07-468e-9c17-21d5098b5782-kube-api-access-89scl\") pod \"ingress-canary-bbr7w\" (UID: \"e02ac804-8a07-468e-9c17-21d5098b5782\") " pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.372989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df81c97f-3744-4cb0-9db2-d112a7043ade-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/608e3dfb-ec68-4166-b943-26df269dda57-config-volume\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df81c97f-3744-4cb0-9db2-d112a7043ade-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e02ac804-8a07-468e-9c17-21d5098b5782-cert\") pod \"ingress-canary-bbr7w\" (UID: \"e02ac804-8a07-468e-9c17-21d5098b5782\") " pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp9z4\" (UniqueName: \"kubernetes.io/projected/df81c97f-3744-4cb0-9db2-d112a7043ade-kube-api-access-dp9z4\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/608e3dfb-ec68-4166-b943-26df269dda57-metrics-tls\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373162 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df81c97f-3744-4cb0-9db2-d112a7043ade-crio-socket\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.373194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmhft\" (UniqueName: \"kubernetes.io/projected/608e3dfb-ec68-4166-b943-26df269dda57-kube-api-access-bmhft\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.373626 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df81c97f-3744-4cb0-9db2-d112a7043ade-data-volume\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.373626 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373340 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608e3dfb-ec68-4166-b943-26df269dda57-tmp-dir\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.373626 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df81c97f-3744-4cb0-9db2-d112a7043ade-data-volume\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.373732 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373695 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/608e3dfb-ec68-4166-b943-26df269dda57-config-volume\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.373788 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.373745 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df81c97f-3744-4cb0-9db2-d112a7043ade-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.377226 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.377201 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df81c97f-3744-4cb0-9db2-d112a7043ade-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.377338 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.377227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/608e3dfb-ec68-4166-b943-26df269dda57-metrics-tls\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.377405 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.377390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e02ac804-8a07-468e-9c17-21d5098b5782-cert\") pod \"ingress-canary-bbr7w\" (UID: \"e02ac804-8a07-468e-9c17-21d5098b5782\") " pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.388507 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.388482 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmhft\" (UniqueName: \"kubernetes.io/projected/608e3dfb-ec68-4166-b943-26df269dda57-kube-api-access-bmhft\") pod \"dns-default-54xdf\" (UID: \"608e3dfb-ec68-4166-b943-26df269dda57\") " pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.388944 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.388920 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp9z4\" (UniqueName: \"kubernetes.io/projected/df81c97f-3744-4cb0-9db2-d112a7043ade-kube-api-access-dp9z4\") pod \"insights-runtime-extractor-dd9dh\" (UID: \"df81c97f-3744-4cb0-9db2-d112a7043ade\") " pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.391292 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.391260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89scl\" (UniqueName: \"kubernetes.io/projected/e02ac804-8a07-468e-9c17-21d5098b5782-kube-api-access-89scl\") pod \"ingress-canary-bbr7w\" (UID: \"e02ac804-8a07-468e-9c17-21d5098b5782\") " pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.408464 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.408438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:10.428586 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.428554 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd9dh" Jul 20 19:16:10.444734 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.444706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbr7w" Jul 20 19:16:10.662780 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.662747 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd9dh"] Jul 20 19:16:10.746044 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.746003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:10.746529 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.746164 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:10.748663 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.748636 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:16:10.749368 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.749347 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxxp2\"" Jul 20 19:16:10.749499 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.749399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:16:10.749625 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.749611 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:16:10.850879 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.850484 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-54xdf"] Jul 20 19:16:10.853001 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:10.852970 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608e3dfb_ec68_4166_b943_26df269dda57.slice/crio-d5f1e543ae5178acd0ac281c039dc7c2853f70b59a27e5044d85321cab597870 WatchSource:0}: Error finding container d5f1e543ae5178acd0ac281c039dc7c2853f70b59a27e5044d85321cab597870: Status 404 returned error can't find the container with id d5f1e543ae5178acd0ac281c039dc7c2853f70b59a27e5044d85321cab597870 Jul 20 19:16:10.856619 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:10.856596 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbr7w"] Jul 20 19:16:10.858948 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:10.858923 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02ac804_8a07_468e_9c17_21d5098b5782.slice/crio-42d95ef4f456e32b97abdd7afbd1e95cb682ef9784a9536058c6e174360cbe49 WatchSource:0}: Error finding container 42d95ef4f456e32b97abdd7afbd1e95cb682ef9784a9536058c6e174360cbe49: Status 404 returned error can't find the container with id 42d95ef4f456e32b97abdd7afbd1e95cb682ef9784a9536058c6e174360cbe49 Jul 20 19:16:11.073359 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:11.073320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbr7w" event={"ID":"e02ac804-8a07-468e-9c17-21d5098b5782","Type":"ContainerStarted","Data":"42d95ef4f456e32b97abdd7afbd1e95cb682ef9784a9536058c6e174360cbe49"} Jul 20 19:16:11.074277 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:11.074255 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd9dh" event={"ID":"df81c97f-3744-4cb0-9db2-d112a7043ade","Type":"ContainerStarted","Data":"28c12ccce8b25add08bca0d03a34e958d1f99d9009882a57d6e2b07efbf14f3f"} Jul 20 19:16:11.075284 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:11.075261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54xdf" event={"ID":"608e3dfb-ec68-4166-b943-26df269dda57","Type":"ContainerStarted","Data":"d5f1e543ae5178acd0ac281c039dc7c2853f70b59a27e5044d85321cab597870"} Jul 20 19:16:11.745630 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:11.745593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:11.749226 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:11.749156 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nkhbx\"" Jul 20 19:16:11.749639 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:11.749430 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:16:13.279136 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.279100 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cbc7d7c99-6cgsm"] Jul 20 19:16:13.283497 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.282368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.285741 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.285710 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2zkc2\"" Jul 20 19:16:13.287635 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.287614 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 19:16:13.289824 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.289613 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 19:16:13.289824 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.289620 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 19:16:13.289824 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.289704 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 19:16:13.290037 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.289897 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 19:16:13.290037 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.289998 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 19:16:13.290037 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.289997 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 19:16:13.292544 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.292387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-trusted-ca-bundle\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.292544 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.292459 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-config\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.292544 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.292512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-serving-cert\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.292799 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.292588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-oauth-serving-cert\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.292799 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.292672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-oauth-config\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.292799 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.292699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-service-ca\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.292799 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.292724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmkdd\" (UniqueName: \"kubernetes.io/projected/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-kube-api-access-kmkdd\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.295264 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.295247 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 19:16:13.304376 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.304349 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbc7d7c99-6cgsm"] Jul 20 19:16:13.393746 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.393708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-serving-cert\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.393746 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.393757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-oauth-serving-cert\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.394011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.393810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-oauth-config\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.394011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.393866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-service-ca\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.394011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.393891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkdd\" (UniqueName: \"kubernetes.io/projected/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-kube-api-access-kmkdd\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.394011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.393949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-trusted-ca-bundle\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.394011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.393974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-config\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.394895 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.394847 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-service-ca\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.395047 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.394923 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-oauth-serving-cert\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.395250 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.395227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-trusted-ca-bundle\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.395392 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.395366 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-config\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.396676 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.396650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-serving-cert\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.396948 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.396927 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-oauth-config\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.402319 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.402295 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmkdd\" (UniqueName: \"kubernetes.io/projected/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-kube-api-access-kmkdd\") pod \"console-cbc7d7c99-6cgsm\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:13.594050 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:13.593963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:15.026789 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.026754 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv"] Jul 20 19:16:15.042380 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.042345 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv"] Jul 20 19:16:15.042554 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.042513 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" Jul 20 19:16:15.046157 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.046033 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s744f\"" Jul 20 19:16:15.046157 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.046105 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 19:16:15.105530 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.105494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eca1074b-01ac-4240-9c74-76e6e5af5402-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9v5lv\" (UID: \"eca1074b-01ac-4240-9c74-76e6e5af5402\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" Jul 20 19:16:15.206493 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.206452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eca1074b-01ac-4240-9c74-76e6e5af5402-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9v5lv\" (UID: \"eca1074b-01ac-4240-9c74-76e6e5af5402\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" Jul 20 19:16:15.209388 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.209355 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eca1074b-01ac-4240-9c74-76e6e5af5402-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9v5lv\" (UID: \"eca1074b-01ac-4240-9c74-76e6e5af5402\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" Jul 20 19:16:15.353643 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:15.353546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" Jul 20 19:16:16.629260 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:16.627529 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv"] Jul 20 19:16:16.640356 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:16.640233 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca1074b_01ac_4240_9c74_76e6e5af5402.slice/crio-bc1174c5045873fef1285c956d6e5bc33d30bc8830153cfa1a1fe9b484261007 WatchSource:0}: Error finding container bc1174c5045873fef1285c956d6e5bc33d30bc8830153cfa1a1fe9b484261007: Status 404 returned error can't find the container with id bc1174c5045873fef1285c956d6e5bc33d30bc8830153cfa1a1fe9b484261007 Jul 20 19:16:16.642229 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:16.642141 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbc7d7c99-6cgsm"] Jul 20 19:16:16.649458 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:16.649400 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f06e8ff_d2a9_4d85_9374_f1ec7626515b.slice/crio-1aa23256553fe0d8f5819bf4b4c1cac803e490742d884a6f9bee877de8e77775 WatchSource:0}: Error finding container 1aa23256553fe0d8f5819bf4b4c1cac803e490742d884a6f9bee877de8e77775: Status 404 returned error can't find the container with id 1aa23256553fe0d8f5819bf4b4c1cac803e490742d884a6f9bee877de8e77775 Jul 20 19:16:17.096443 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.096303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbr7w" event={"ID":"e02ac804-8a07-468e-9c17-21d5098b5782","Type":"ContainerStarted","Data":"1371c044dd242df92a815893059d93bc0438fe4f65b65bef0df56997bc5d9c93"} Jul 20 19:16:17.098100 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.098067 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd9dh" event={"ID":"df81c97f-3744-4cb0-9db2-d112a7043ade","Type":"ContainerStarted","Data":"5c40f37cc3e81047244f3e0b1dfe33dfeec324e749f324825fa146982b37baab"} Jul 20 19:16:17.099961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.099932 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54xdf" event={"ID":"608e3dfb-ec68-4166-b943-26df269dda57","Type":"ContainerStarted","Data":"2743d93dfe3c284323b4b1198554fd199263fa293c03ea134c5258d5a0c940f2"} Jul 20 19:16:17.100160 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.099979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54xdf" event={"ID":"608e3dfb-ec68-4166-b943-26df269dda57","Type":"ContainerStarted","Data":"7ed37f98cd7cdbf0e6c73765c95a3f02c69fb25081b10e6291795a38db160ef4"} Jul 20 19:16:17.100160 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.100023 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:17.101383 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.101355 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbc7d7c99-6cgsm" event={"ID":"0f06e8ff-d2a9-4d85-9374-f1ec7626515b","Type":"ContainerStarted","Data":"1aa23256553fe0d8f5819bf4b4c1cac803e490742d884a6f9bee877de8e77775"} Jul 20 19:16:17.102727 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.102708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" event={"ID":"eca1074b-01ac-4240-9c74-76e6e5af5402","Type":"ContainerStarted","Data":"bc1174c5045873fef1285c956d6e5bc33d30bc8830153cfa1a1fe9b484261007"} Jul 20 19:16:17.115517 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.115463 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bbr7w" podStartSLOduration=1.508242569 podStartE2EDuration="7.115442376s" totalImagesPullingTime="5.607199807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:17.115304782 +0000 UTC m=+60.928173088" watchObservedRunningTime="2026-07-20 19:16:17.115442376 +0000 UTC m=+60.928310683" Jul 20 19:16:17.134173 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:17.134112 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-54xdf" podStartSLOduration=1.5241722690000001 podStartE2EDuration="7.134093451s" totalImagesPullingTime="5.609921182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:17.132659705 +0000 UTC m=+60.945528013" watchObservedRunningTime="2026-07-20 19:16:17.134093451 +0000 UTC m=+60.946961757" Jul 20 19:16:18.019231 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:18.018524 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x66gd" Jul 20 19:16:19.110365 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:19.110323 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" event={"ID":"eca1074b-01ac-4240-9c74-76e6e5af5402","Type":"ContainerStarted","Data":"f94755f8ef2d28dd92f0faa93402d2564f5a8b3f618d54dd9f820f50a261e060"} Jul 20 19:16:19.110837 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:19.110584 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" Jul 20 19:16:19.116196 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:19.116171 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" Jul 20 19:16:19.129430 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:19.129362 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9v5lv" podStartSLOduration=2.592557268 podStartE2EDuration="4.129341359s" totalImagesPullingTime="1.536784091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:19.128820736 +0000 UTC m=+62.941689043" watchObservedRunningTime="2026-07-20 19:16:19.129341359 +0000 UTC m=+62.942209666" Jul 20 19:16:20.094908 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.094876 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-2ln96"] Jul 20 19:16:20.097111 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.097082 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.100367 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.100334 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 19:16:20.100559 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.100388 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 19:16:20.100559 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.100403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 19:16:20.100748 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.100588 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 19:16:20.100748 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.100640 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 19:16:20.100748 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.100680 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gswdj\"" Jul 20 19:16:20.108581 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.108554 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-2ln96"] Jul 20 19:16:20.148581 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.148544 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.149012 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.148590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.149012 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.148626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btsd6\" (UniqueName: \"kubernetes.io/projected/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-kube-api-access-btsd6\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.149012 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.148676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.249984 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.249944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.250164 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.250057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.250164 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.250089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.250164 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.250121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btsd6\" (UniqueName: \"kubernetes.io/projected/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-kube-api-access-btsd6\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.250944 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.250909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.252883 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.252855 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.252997 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.252921 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.263945 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.263917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btsd6\" (UniqueName: \"kubernetes.io/projected/76ba9bc4-ad7e-4705-adc8-08bd1b628bff-kube-api-access-btsd6\") pod \"prometheus-operator-5945b5cfd-2ln96\" (UID: \"76ba9bc4-ad7e-4705-adc8-08bd1b628bff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:20.408351 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:20.408271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" Jul 20 19:16:21.458515 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.458477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:21.458515 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.458516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:21.461446 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.461398 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:16:21.461446 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.461398 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:16:21.471566 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.471531 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c8d16c4-e37f-4d23-932c-761f378d2384-metrics-certs\") pod \"network-metrics-daemon-9v9lk\" (UID: \"7c8d16c4-e37f-4d23-932c-761f378d2384\") " pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:21.471763 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.471737 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcc18ed2-4175-46f7-8c7a-8b579144e47a-original-pull-secret\") pod \"global-pull-secret-syncer-xkvvv\" (UID: \"bcc18ed2-4175-46f7-8c7a-8b579144e47a\") " pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:21.556079 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.556008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkvvv" Jul 20 19:16:21.559076 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.558944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:21.573548 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.564444 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:16:21.576061 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.576032 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:16:21.582706 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.582641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnz5\" (UniqueName: \"kubernetes.io/projected/5d903ceb-9618-415f-afcb-7b65d88bb69d-kube-api-access-lcnz5\") pod \"network-check-target-7885c\" (UID: \"5d903ceb-9618-415f-afcb-7b65d88bb69d\") " pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:21.611869 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.611744 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-2ln96"] Jul 20 19:16:21.615152 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:21.615121 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ba9bc4_ad7e_4705_adc8_08bd1b628bff.slice/crio-2744df8df008f3b2c24549b3e559543782ac3a8d9926570e4a224f615363a67a WatchSource:0}: Error finding container 2744df8df008f3b2c24549b3e559543782ac3a8d9926570e4a224f615363a67a: Status 404 returned error can't find the container with id 2744df8df008f3b2c24549b3e559543782ac3a8d9926570e4a224f615363a67a Jul 20 19:16:21.661426 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.661384 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nkhbx\"" Jul 20 19:16:21.669579 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.669542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v9lk" Jul 20 19:16:21.704555 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.704478 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkvvv"] Jul 20 19:16:21.709735 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:21.709659 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc18ed2_4175_46f7_8c7a_8b579144e47a.slice/crio-9d57dc49c6a292b095248612dba73fdad3a95414cd424609477143d640d92c49 WatchSource:0}: Error finding container 9d57dc49c6a292b095248612dba73fdad3a95414cd424609477143d640d92c49: Status 404 returned error can't find the container with id 9d57dc49c6a292b095248612dba73fdad3a95414cd424609477143d640d92c49 Jul 20 19:16:21.803763 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.803733 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9v9lk"] Jul 20 19:16:21.806770 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:21.806741 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8d16c4_e37f_4d23_932c_761f378d2384.slice/crio-02cdd9596722a79889ea34ba40c00422707723afde71e4466fee66d4346da9b4 WatchSource:0}: Error finding container 02cdd9596722a79889ea34ba40c00422707723afde71e4466fee66d4346da9b4: Status 404 returned error can't find the container with id 02cdd9596722a79889ea34ba40c00422707723afde71e4466fee66d4346da9b4 Jul 20 19:16:21.863357 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.863328 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxxp2\"" Jul 20 19:16:21.871501 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.871467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:21.999786 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:21.999707 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7885c"] Jul 20 19:16:22.002857 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:22.002823 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d903ceb_9618_415f_afcb_7b65d88bb69d.slice/crio-2f938e130f427f9580b6701f48c622a76a99c956bd565bf4978d4094b670467b WatchSource:0}: Error finding container 2f938e130f427f9580b6701f48c622a76a99c956bd565bf4978d4094b670467b: Status 404 returned error can't find the container with id 2f938e130f427f9580b6701f48c622a76a99c956bd565bf4978d4094b670467b Jul 20 19:16:22.123031 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:22.122989 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkvvv" event={"ID":"bcc18ed2-4175-46f7-8c7a-8b579144e47a","Type":"ContainerStarted","Data":"9d57dc49c6a292b095248612dba73fdad3a95414cd424609477143d640d92c49"} Jul 20 19:16:22.124466 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:22.124433 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9v9lk" event={"ID":"7c8d16c4-e37f-4d23-932c-761f378d2384","Type":"ContainerStarted","Data":"02cdd9596722a79889ea34ba40c00422707723afde71e4466fee66d4346da9b4"} Jul 20 19:16:22.127124 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:22.127095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd9dh" event={"ID":"df81c97f-3744-4cb0-9db2-d112a7043ade","Type":"ContainerStarted","Data":"702656fe1b12dd788cc48b5a312469eab9438b5920580d61ff366f61870429fb"} Jul 20 19:16:22.129485 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:22.129176 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbc7d7c99-6cgsm" event={"ID":"0f06e8ff-d2a9-4d85-9374-f1ec7626515b","Type":"ContainerStarted","Data":"5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6"} Jul 20 19:16:22.130575 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:22.130547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7885c" event={"ID":"5d903ceb-9618-415f-afcb-7b65d88bb69d","Type":"ContainerStarted","Data":"2f938e130f427f9580b6701f48c622a76a99c956bd565bf4978d4094b670467b"} Jul 20 19:16:22.132046 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:22.132019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" event={"ID":"76ba9bc4-ad7e-4705-adc8-08bd1b628bff","Type":"ContainerStarted","Data":"2744df8df008f3b2c24549b3e559543782ac3a8d9926570e4a224f615363a67a"} Jul 20 19:16:22.147003 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:22.146794 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cbc7d7c99-6cgsm" podStartSLOduration=4.312417105 podStartE2EDuration="9.146770782s" totalImagesPullingTime="4.834353677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:22.145994916 +0000 UTC m=+65.958863226" watchObservedRunningTime="2026-07-20 19:16:22.146770782 +0000 UTC m=+65.959639089" Jul 20 19:16:23.594937 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:23.594698 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:23.594937 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:23.594821 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:23.596715 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:23.596299 2575 patch_prober.go:28] interesting pod/console-cbc7d7c99-6cgsm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 20 19:16:23.596715 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:23.596372 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cbc7d7c99-6cgsm" podUID="0f06e8ff-d2a9-4d85-9374-f1ec7626515b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 20 19:16:24.144731 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:24.144686 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" event={"ID":"76ba9bc4-ad7e-4705-adc8-08bd1b628bff","Type":"ContainerStarted","Data":"5376e5f8b80c2150527650474c251bc97ef6d44a3ef8167f03b225ec79b84278"} Jul 20 19:16:24.145016 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:24.144756 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" event={"ID":"76ba9bc4-ad7e-4705-adc8-08bd1b628bff","Type":"ContainerStarted","Data":"9ed268d09c3cfbada4ba8f4a8787ba8c046b0ac6ba49db8ee961835e2315777f"} Jul 20 19:16:24.147816 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:24.147762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9v9lk" event={"ID":"7c8d16c4-e37f-4d23-932c-761f378d2384","Type":"ContainerStarted","Data":"f6ab3c6ed585629fb483ac7e29d7e7074addb177830b1117aa922f6ae45cd8e7"} Jul 20 19:16:24.147946 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:24.147840 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9v9lk" event={"ID":"7c8d16c4-e37f-4d23-932c-761f378d2384","Type":"ContainerStarted","Data":"948e201d73168739eac1eb476a77fe5164b20e53d7ba88c18d487235c4a49512"} Jul 20 19:16:24.215787 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:24.214635 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-2ln96" podStartSLOduration=2.571215779 podStartE2EDuration="4.214613031s" totalImagesPullingTime="1.643397252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:24.18155379 +0000 UTC m=+67.994422107" watchObservedRunningTime="2026-07-20 19:16:24.214613031 +0000 UTC m=+68.027481338" Jul 20 19:16:24.215787 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:24.215476 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9v9lk" podStartSLOduration=65.759416393 podStartE2EDuration="1m7.215464469s" totalImagesPullingTime="1.456048076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:24.213680063 +0000 UTC m=+68.026548369" watchObservedRunningTime="2026-07-20 19:16:24.215464469 +0000 UTC m=+68.028332775" Jul 20 19:16:26.480364 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.480323 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-qsdx8"] Jul 20 19:16:26.503303 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.503272 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x5fcw"] Jul 20 19:16:26.503515 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.503371 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.505804 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.505645 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 20 19:16:26.506055 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.506032 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4qjz9\"" Jul 20 19:16:26.507064 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.507043 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 20 19:16:26.507172 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.507049 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 20 19:16:26.519206 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.519174 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-qsdx8"] Jul 20 19:16:26.519333 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.519286 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.522496 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.522476 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 19:16:26.522621 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.522593 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 19:16:26.522621 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.522598 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4x4qd\"" Jul 20 19:16:26.522734 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.522709 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 19:16:26.599891 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.599846 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-root\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600069 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.599898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600069 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.599995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-wtmp\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600069 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-sys\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600224 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.600224 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600224 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/388ba5fb-f852-4bd3-93e6-e24759b327ac-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.600224 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388ba5fb-f852-4bd3-93e6-e24759b327ac-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.600396 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5n9v\" (UniqueName: \"kubernetes.io/projected/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-api-access-f5n9v\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.600396 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efad72ee-773d-484d-b52d-3eadc570bb22-metrics-client-ca\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600396 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fptg\" (UniqueName: \"kubernetes.io/projected/efad72ee-773d-484d-b52d-3eadc570bb22-kube-api-access-8fptg\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600396 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-tls\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600609 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600432 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-textfile\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.600609 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.600609 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.600489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.701523 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701482 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-tls\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.701523 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-textfile\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-root\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:26.701652 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-wtmp\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:26.701731 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-tls podName:efad72ee-773d-484d-b52d-3eadc570bb22 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:27.201711059 +0000 UTC m=+71.014579362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-tls") pod "node-exporter-x5fcw" (UID: "efad72ee-773d-484d-b52d-3eadc570bb22") : secret "node-exporter-tls" not found Jul 20 19:16:26.701776 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-sys\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/388ba5fb-f852-4bd3-93e6-e24759b327ac-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701840 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-wtmp\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388ba5fb-f852-4bd3-93e6-e24759b327ac-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5n9v\" (UniqueName: \"kubernetes.io/projected/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-api-access-f5n9v\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701884 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-textfile\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efad72ee-773d-484d-b52d-3eadc570bb22-metrics-client-ca\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fptg\" (UniqueName: \"kubernetes.io/projected/efad72ee-773d-484d-b52d-3eadc570bb22-kube-api-access-8fptg\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.701932 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-root\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702583 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.702081 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efad72ee-773d-484d-b52d-3eadc570bb22-sys\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702637 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.702600 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702790 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.702743 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/388ba5fb-f852-4bd3-93e6-e24759b327ac-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.702917 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.702863 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efad72ee-773d-484d-b52d-3eadc570bb22-metrics-client-ca\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.702917 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.702890 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388ba5fb-f852-4bd3-93e6-e24759b327ac-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.703206 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.703165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.704473 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.704449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.704576 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.704492 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.704576 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.704523 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.713509 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.713481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5n9v\" (UniqueName: \"kubernetes.io/projected/388ba5fb-f852-4bd3-93e6-e24759b327ac-kube-api-access-f5n9v\") pod \"kube-state-metrics-56c5594674-qsdx8\" (UID: \"388ba5fb-f852-4bd3-93e6-e24759b327ac\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:26.713509 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.713500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fptg\" (UniqueName: \"kubernetes.io/projected/efad72ee-773d-484d-b52d-3eadc570bb22-kube-api-access-8fptg\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:26.815346 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:26.815276 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" Jul 20 19:16:27.109345 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.109255 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-54xdf" Jul 20 19:16:27.205950 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.205911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-tls\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:27.208534 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.208506 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efad72ee-773d-484d-b52d-3eadc570bb22-node-exporter-tls\") pod \"node-exporter-x5fcw\" (UID: \"efad72ee-773d-484d-b52d-3eadc570bb22\") " pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:27.433529 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.433446 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5fcw" Jul 20 19:16:27.542757 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.542720 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:16:27.545510 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.545481 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.549961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.547774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 19:16:27.549961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.548976 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 19:16:27.549961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.549236 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 19:16:27.549961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.549443 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 19:16:27.549961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.549670 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 19:16:27.549961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.549832 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 19:16:27.550355 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.550036 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4zrhp\"" Jul 20 19:16:27.550355 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.550071 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 19:16:27.550628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.550605 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 19:16:27.550628 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.550624 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 19:16:27.576017 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.566422 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:16:27.608337 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608337 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608620 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608620 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608393 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2wnj\" (UniqueName: \"kubernetes.io/projected/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-kube-api-access-w2wnj\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608620 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608620 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-web-config\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608620 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608620 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608899 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-config-out\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608899 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608681 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608899 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608899 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.608899 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.608821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709526 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-config-out\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709717 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709717 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.709856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.710075 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2wnj\" (UniqueName: \"kubernetes.io/projected/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-kube-api-access-w2wnj\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.710075 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.710075 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-web-config\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.710075 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.710075 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.709991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.711120 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.710814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.711120 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.710904 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.711120 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.710985 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.713122 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.713059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.713715 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.713671 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.714444 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.713980 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-config-out\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.714444 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.714380 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.714594 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.714528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.714712 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.714688 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.715133 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.715105 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.715865 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.715839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-web-config\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.716468 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.716442 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.721761 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.721736 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2wnj\" (UniqueName: \"kubernetes.io/projected/3bc8efe5-c32f-4e16-bbd8-f1769539adf6-kube-api-access-w2wnj\") pod \"alertmanager-main-0\" (UID: \"3bc8efe5-c32f-4e16-bbd8-f1769539adf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:27.858472 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:27.858439 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:16:28.509876 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:28.509796 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-qsdx8"] Jul 20 19:16:28.515579 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:28.515208 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388ba5fb_f852_4bd3_93e6_e24759b327ac.slice/crio-68fa6ec9054c50295222dee8ac8a77d0707ae997327009304dc42a84152a4c87 WatchSource:0}: Error finding container 68fa6ec9054c50295222dee8ac8a77d0707ae997327009304dc42a84152a4c87: Status 404 returned error can't find the container with id 68fa6ec9054c50295222dee8ac8a77d0707ae997327009304dc42a84152a4c87 Jul 20 19:16:28.532739 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:28.532511 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:16:28.535346 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:28.535313 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc8efe5_c32f_4e16_bbd8_f1769539adf6.slice/crio-97ce96a772c25dd27d0cfd893503ff542521ef3270b47d148887e2620cf07c4c WatchSource:0}: Error finding container 97ce96a772c25dd27d0cfd893503ff542521ef3270b47d148887e2620cf07c4c: Status 404 returned error can't find the container with id 97ce96a772c25dd27d0cfd893503ff542521ef3270b47d148887e2620cf07c4c Jul 20 19:16:29.169388 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.169281 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" event={"ID":"388ba5fb-f852-4bd3-93e6-e24759b327ac","Type":"ContainerStarted","Data":"68fa6ec9054c50295222dee8ac8a77d0707ae997327009304dc42a84152a4c87"} Jul 20 19:16:29.171874 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.171805 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd9dh" event={"ID":"df81c97f-3744-4cb0-9db2-d112a7043ade","Type":"ContainerStarted","Data":"829e74dcd3b9967162ddecb9e31b1b6b20a1087e879d324d11070781a6a08514"} Jul 20 19:16:29.173736 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.173703 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5fcw" event={"ID":"efad72ee-773d-484d-b52d-3eadc570bb22","Type":"ContainerStarted","Data":"79da77def7d44bb446ef7aa58aa7b8526fb9355f625067f683027d57cf4d2471"} Jul 20 19:16:29.176097 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.176029 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7885c" event={"ID":"5d903ceb-9618-415f-afcb-7b65d88bb69d","Type":"ContainerStarted","Data":"756338f9a6e437a48eddc1d14219d27007044986d884326f2edc601e674051b3"} Jul 20 19:16:29.176430 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.176372 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:16:29.178519 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.178480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkvvv" event={"ID":"bcc18ed2-4175-46f7-8c7a-8b579144e47a","Type":"ContainerStarted","Data":"07e95d63506a9e1f12873f0af78dde4e9bcfa2617df0b40e71fd34f960b72856"} Jul 20 19:16:29.180292 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.180264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerStarted","Data":"97ce96a772c25dd27d0cfd893503ff542521ef3270b47d148887e2620cf07c4c"} Jul 20 19:16:29.223488 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.223425 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dd9dh" podStartSLOduration=1.740573687 podStartE2EDuration="19.2233872s" totalImagesPullingTime="17.482813513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:16:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:29.200157798 +0000 UTC m=+73.013026096" watchObservedRunningTime="2026-07-20 19:16:29.2233872 +0000 UTC m=+73.036255507" Jul 20 19:16:29.224746 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.224700 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7885c" podStartSLOduration=65.869760051 podStartE2EDuration="1m12.224688977s" totalImagesPullingTime="6.354928926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:29.22261109 +0000 UTC m=+73.035479421" watchObservedRunningTime="2026-07-20 19:16:29.224688977 +0000 UTC m=+73.037557282" Jul 20 19:16:29.243577 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.243406 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xkvvv" podStartSLOduration=65.596930633 podStartE2EDuration="1m12.243389757s" totalImagesPullingTime="6.646459124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:29.242813892 +0000 UTC m=+73.055682199" watchObservedRunningTime="2026-07-20 19:16:29.243389757 +0000 UTC m=+73.056258058" Jul 20 19:16:29.505677 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.505643 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss"] Jul 20 19:16:29.512196 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.512161 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.515342 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.515316 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 20 19:16:29.515796 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.515774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-el2s7tpp7vrt1\"" Jul 20 19:16:29.515949 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.515866 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tp58x\"" Jul 20 19:16:29.516023 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.515997 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 20 19:16:29.516084 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.515998 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 20 19:16:29.516317 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.516295 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 20 19:16:29.516494 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.516299 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 20 19:16:29.524946 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.524915 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss"] Jul 20 19:16:29.624688 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2z28\" (UniqueName: \"kubernetes.io/projected/4c71dc14-502e-45ab-ae29-ac4bcc030cac-kube-api-access-x2z28\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.624883 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-grpc-tls\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.624883 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.624883 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-tls\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.624883 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.625080 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.625080 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.625080 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.624961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c71dc14-502e-45ab-ae29-ac4bcc030cac-metrics-client-ca\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.725844 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.725809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2z28\" (UniqueName: \"kubernetes.io/projected/4c71dc14-502e-45ab-ae29-ac4bcc030cac-kube-api-access-x2z28\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726024 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.725878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-grpc-tls\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726024 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.725910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726024 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.725938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-tls\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726024 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.725975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726024 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.726020 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726279 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.726045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726279 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.726072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c71dc14-502e-45ab-ae29-ac4bcc030cac-metrics-client-ca\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.726931 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.726881 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c71dc14-502e-45ab-ae29-ac4bcc030cac-metrics-client-ca\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.729220 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.729168 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.729220 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.729179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-grpc-tls\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.729389 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.729362 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.729477 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.729463 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.729794 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.729774 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-tls\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.729993 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.729973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c71dc14-502e-45ab-ae29-ac4bcc030cac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.737204 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.737176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2z28\" (UniqueName: \"kubernetes.io/projected/4c71dc14-502e-45ab-ae29-ac4bcc030cac-kube-api-access-x2z28\") pod \"thanos-querier-5dbdc4d6d8-59sss\" (UID: \"4c71dc14-502e-45ab-ae29-ac4bcc030cac\") " pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:29.824448 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:29.824349 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:30.118685 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.118584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss"] Jul 20 19:16:30.130320 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:30.130281 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c71dc14_502e_45ab_ae29_ac4bcc030cac.slice/crio-42903a1dc7e46e2d77d8f49861c3f478fa361e35a653e222247a9963cd0f57bb WatchSource:0}: Error finding container 42903a1dc7e46e2d77d8f49861c3f478fa361e35a653e222247a9963cd0f57bb: Status 404 returned error can't find the container with id 42903a1dc7e46e2d77d8f49861c3f478fa361e35a653e222247a9963cd0f57bb Jul 20 19:16:30.187881 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.187765 2575 generic.go:356] "Generic (PLEG): container finished" podID="3bc8efe5-c32f-4e16-bbd8-f1769539adf6" containerID="7eec6afd0f15c2442f23d53b22f25dcf5dbf80f61db4923746b8b66b6a83c83b" exitCode=0 Jul 20 19:16:30.187881 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.187872 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerDied","Data":"7eec6afd0f15c2442f23d53b22f25dcf5dbf80f61db4923746b8b66b6a83c83b"} Jul 20 19:16:30.189482 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.189364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" event={"ID":"4c71dc14-502e-45ab-ae29-ac4bcc030cac","Type":"ContainerStarted","Data":"42903a1dc7e46e2d77d8f49861c3f478fa361e35a653e222247a9963cd0f57bb"} Jul 20 19:16:30.191939 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.191833 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" event={"ID":"388ba5fb-f852-4bd3-93e6-e24759b327ac","Type":"ContainerStarted","Data":"ced1e534736c9eb041323253edcddb6ba1cc5efa482707d82db2d8c7235c47d1"} Jul 20 19:16:30.191939 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.191900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" event={"ID":"388ba5fb-f852-4bd3-93e6-e24759b327ac","Type":"ContainerStarted","Data":"be1fd709e3b382b18f2749fb6166205ba3fdeabe2e6f1b3d5a87b7e3613e9f2d"} Jul 20 19:16:30.195862 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.194466 2575 generic.go:356] "Generic (PLEG): container finished" podID="efad72ee-773d-484d-b52d-3eadc570bb22" containerID="63e603fdc98909474fe9076922c685061f5bb4075587a434c3dd95df620879ac" exitCode=0 Jul 20 19:16:30.195862 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:30.194992 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5fcw" event={"ID":"efad72ee-773d-484d-b52d-3eadc570bb22","Type":"ContainerDied","Data":"63e603fdc98909474fe9076922c685061f5bb4075587a434c3dd95df620879ac"} Jul 20 19:16:31.210906 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:31.210869 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" event={"ID":"388ba5fb-f852-4bd3-93e6-e24759b327ac","Type":"ContainerStarted","Data":"1e76a683f16b06756656916ff73ea942d0c724b7882d8f90bcaa98c334b0f678"} Jul 20 19:16:31.214241 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:31.214214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5fcw" event={"ID":"efad72ee-773d-484d-b52d-3eadc570bb22","Type":"ContainerStarted","Data":"d86d43c5f092d9f6aea4fb1b155346449470507a66e495fcab1319f3dedb3fce"} Jul 20 19:16:31.214457 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:31.214435 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5fcw" event={"ID":"efad72ee-773d-484d-b52d-3eadc570bb22","Type":"ContainerStarted","Data":"43847c0485137753eee38bb29ef30b04ff345039e288aa318f9927cfbc38d491"} Jul 20 19:16:31.246940 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:31.246880 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-qsdx8" podStartSLOduration=3.803958804 podStartE2EDuration="5.246863978s" totalImagesPullingTime="1.442905174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:31.245617209 +0000 UTC m=+75.058485560" watchObservedRunningTime="2026-07-20 19:16:31.246863978 +0000 UTC m=+75.059732286" Jul 20 19:16:31.275433 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:31.275174 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x5fcw" podStartSLOduration=3.580365394 podStartE2EDuration="5.275151128s" totalImagesPullingTime="1.599308084s" totalInitContainerRuntime="95.47765ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:31.272692469 +0000 UTC m=+75.085560775" watchObservedRunningTime="2026-07-20 19:16:31.275151128 +0000 UTC m=+75.088019439" Jul 20 19:16:31.317348 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:31.317309 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cbc7d7c99-6cgsm"] Jul 20 19:16:32.221393 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.221364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerStarted","Data":"ed44c788ff682b4abd9b8f45ccde6d780e9aa407a4e65920aa2df49fc444426d"} Jul 20 19:16:32.221813 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.221455 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerStarted","Data":"5a895139a5c3291f367939fbbcf6690671a39e5832dad3a41f8933e7275bcf13"} Jul 20 19:16:32.221813 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.221485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerStarted","Data":"33b49f8e7cde7503229ea23918d7f41e4690c84abddeaf6f4a48bcbe9f69d1bd"} Jul 20 19:16:32.223493 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.223437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" event={"ID":"4c71dc14-502e-45ab-ae29-ac4bcc030cac","Type":"ContainerStarted","Data":"406ab083fd17ca9eceaf1e045e88ed61de62e08af1a27fd1102e31fe9da82410"} Jul 20 19:16:32.223493 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.223490 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" event={"ID":"4c71dc14-502e-45ab-ae29-ac4bcc030cac","Type":"ContainerStarted","Data":"ccf5c7d85efa0069e0c6d77f6c054c2acb79e3442b167174dee4a2f45c6c5d91"} Jul 20 19:16:32.223587 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.223516 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" event={"ID":"4c71dc14-502e-45ab-ae29-ac4bcc030cac","Type":"ContainerStarted","Data":"3954a69dbc89f9908d0464ba1f6653303738fe5e824c62548be7455c636b6582"} Jul 20 19:16:32.710381 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.710344 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:16:32.715580 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.713464 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.717627 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.717374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 19:16:32.719348 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.719181 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 19:16:32.719483 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.719435 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 19:16:32.719716 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.719679 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 19:16:32.719827 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.719797 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 19:16:32.721623 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.720004 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 19:16:32.721623 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.720161 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 19:16:32.721623 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.720222 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 19:16:32.721623 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.720242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ehgc9v3mu0go3\"" Jul 20 19:16:32.721623 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.720346 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 19:16:32.721623 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.720492 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gwwl7\"" Jul 20 19:16:32.721623 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.720552 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 19:16:32.723929 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.723908 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 19:16:32.724355 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.724328 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 19:16:32.725470 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.725449 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 19:16:32.726456 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.726295 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 19:16:32.739887 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.739852 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:16:32.746235 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.746206 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 19:16:32.752857 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.752828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.752857 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.752861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753083 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.752883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753083 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.752901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sdmd\" (UniqueName: \"kubernetes.io/projected/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-kube-api-access-4sdmd\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753083 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.752972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753083 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753083 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753083 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753362 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753362 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753362 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753362 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753306 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753362 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753362 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753704 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753704 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753704 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-config\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753704 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753704 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.753704 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.753540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854581 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854581 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sdmd\" (UniqueName: \"kubernetes.io/projected/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-kube-api-access-4sdmd\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854623 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.854842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855199 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855199 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855199 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855199 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855199 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-config\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855199 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.854988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855199 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.855006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.855727 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.855451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.856046 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.856015 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.856171 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.856144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.856400 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.856330 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.858126 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.855590 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.858126 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.857209 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.858126 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.857663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.858126 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.857724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.858126 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.857756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.858126 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.857825 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.859346 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.858893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.859346 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.859102 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.859346 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.859305 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.859595 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.859574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.861186 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.861161 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-config\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.864106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.863665 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.864106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.864048 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.864251 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.864160 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.864251 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.864218 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.864364 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.864339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.864364 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.864337 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.864869 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.864842 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:32.865853 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:32.865813 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sdmd\" (UniqueName: \"kubernetes.io/projected/3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30-kube-api-access-4sdmd\") pod \"prometheus-k8s-0\" (UID: \"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:33.046682 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:33.046602 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:33.235268 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:33.233643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerStarted","Data":"3a5beff671bcd5b55f1b48605eb02a4e5b6594ec98dcd111d120f082c8203570"} Jul 20 19:16:33.235268 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:33.233731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerStarted","Data":"12b3dd831152d7a38a37e663db7d3c0085e04f375a685797091ab78e0c58831f"} Jul 20 19:16:33.235268 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:33.233774 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3bc8efe5-c32f-4e16-bbd8-f1769539adf6","Type":"ContainerStarted","Data":"b20c494459da996942b249f5a5b20b0a176c0a9431d2ce3f35725b57bf159a76"} Jul 20 19:16:33.243842 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:33.242582 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" event={"ID":"4c71dc14-502e-45ab-ae29-ac4bcc030cac","Type":"ContainerStarted","Data":"4cfba732f75e1d94a3677b3db3616e9c60ef556944a68c25c83c7bd93ec3445d"} Jul 20 19:16:33.279120 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:33.279095 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:16:33.286323 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:16:33.284920 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba5ef99_8258_4d0e_abcd_d7bc6b83dd30.slice/crio-1da46cb61d87fd0799609dbe3738591be7732b79a3798a05ac23c96e70c6cb73 WatchSource:0}: Error finding container 1da46cb61d87fd0799609dbe3738591be7732b79a3798a05ac23c96e70c6cb73: Status 404 returned error can't find the container with id 1da46cb61d87fd0799609dbe3738591be7732b79a3798a05ac23c96e70c6cb73 Jul 20 19:16:34.249051 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.249010 2575 generic.go:356] "Generic (PLEG): container finished" podID="3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30" containerID="5514eee58d84060ce93c22e34cf94afc9789dad510d785ed1981613ba2fda5d9" exitCode=0 Jul 20 19:16:34.249480 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.249097 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerDied","Data":"5514eee58d84060ce93c22e34cf94afc9789dad510d785ed1981613ba2fda5d9"} Jul 20 19:16:34.249480 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.249175 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerStarted","Data":"1da46cb61d87fd0799609dbe3738591be7732b79a3798a05ac23c96e70c6cb73"} Jul 20 19:16:34.252478 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.252382 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" event={"ID":"4c71dc14-502e-45ab-ae29-ac4bcc030cac","Type":"ContainerStarted","Data":"1c1b05cc9fe27a609bdac31588413835ae1d5443f999d38bf59fae91e546a809"} Jul 20 19:16:34.252556 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.252484 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" event={"ID":"4c71dc14-502e-45ab-ae29-ac4bcc030cac","Type":"ContainerStarted","Data":"70e2f1bb4b2a1432ac3fb4156fd6fe54e3d0c636833056cd0e9d89125b68f3a1"} Jul 20 19:16:34.252863 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.252844 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:34.279554 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.279495 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.247919777 podStartE2EDuration="7.279478143s" totalImagesPullingTime="4.006664576s" totalInitContainerRuntime="24.89379ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:33.289881492 +0000 UTC m=+77.102749863" watchObservedRunningTime="2026-07-20 19:16:34.279478143 +0000 UTC m=+78.092346448" Jul 20 19:16:34.303459 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:34.303376 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" podStartSLOduration=2.547265118 podStartE2EDuration="5.303355855s" totalImagesPullingTime="2.756090737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:34.30288191 +0000 UTC m=+78.115750217" watchObservedRunningTime="2026-07-20 19:16:34.303355855 +0000 UTC m=+78.116224160" Jul 20 19:16:38.272203 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:38.272092 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerStarted","Data":"b4a275dd194c836a06de771ed469c9b072f92f74e88abb0cdbded349f4d37b4e"} Jul 20 19:16:38.272203 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:38.272182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerStarted","Data":"17e68b5b1806a7086a286069d055ade5a4e283c785a9ce72012a05f7b51c49de"} Jul 20 19:16:38.272601 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:38.272208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerStarted","Data":"a0ac8d9ef3173b8739da60df234e07a9534f0fe06827c3c053810d92bd9d9679"} Jul 20 19:16:38.272601 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:38.272240 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerStarted","Data":"974f2833ecf76dcb0c0a670ba47f6ad0a0b14197234d5cb9a33c7060a8535107"} Jul 20 19:16:38.272601 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:38.272266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerStarted","Data":"2b615575162458c945326f2d3da717e4ebbec863614d6ecff9f107d6ae519c94"} Jul 20 19:16:38.272601 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:38.272288 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30","Type":"ContainerStarted","Data":"6c55512bfb8b9166f420f7e394c19169e7b89ebc1d4ed1f13f43b26014595986"} Jul 20 19:16:38.310335 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:38.310283 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.286811542 podStartE2EDuration="6.310264215s" totalImagesPullingTime="2.998802411s" totalInitContainerRuntime="24.650262ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:38.308630464 +0000 UTC m=+82.121498772" watchObservedRunningTime="2026-07-20 19:16:38.310264215 +0000 UTC m=+82.123132521" Jul 20 19:16:40.262635 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:40.262601 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dbdc4d6d8-59sss" Jul 20 19:16:43.046730 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:43.046696 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:16:56.341702 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:56.341641 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cbc7d7c99-6cgsm" podUID="0f06e8ff-d2a9-4d85-9374-f1ec7626515b" containerName="console" containerID="cri-o://5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6" gracePeriod=15 Jul 20 19:16:57.122336 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.122303 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:57.281099 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281009 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-oauth-serving-cert\") pod \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " Jul 20 19:16:57.281099 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281047 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-oauth-config\") pod \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " Jul 20 19:16:57.281099 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281083 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-trusted-ca-bundle\") pod \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " Jul 20 19:16:57.281393 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281143 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-config\") pod \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " Jul 20 19:16:57.281393 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281169 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-serving-cert\") pod \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " Jul 20 19:16:57.281393 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281195 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmkdd\" (UniqueName: \"kubernetes.io/projected/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-kube-api-access-kmkdd\") pod \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " Jul 20 19:16:57.281393 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281230 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-service-ca\") pod \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\" (UID: \"0f06e8ff-d2a9-4d85-9374-f1ec7626515b\") " Jul 20 19:16:57.281701 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281655 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0f06e8ff-d2a9-4d85-9374-f1ec7626515b" (UID: "0f06e8ff-d2a9-4d85-9374-f1ec7626515b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:16:57.281701 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281667 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-config" (OuterVolumeSpecName: "console-config") pod "0f06e8ff-d2a9-4d85-9374-f1ec7626515b" (UID: "0f06e8ff-d2a9-4d85-9374-f1ec7626515b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:16:57.281701 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281687 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f06e8ff-d2a9-4d85-9374-f1ec7626515b" (UID: "0f06e8ff-d2a9-4d85-9374-f1ec7626515b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:16:57.281846 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.281653 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f06e8ff-d2a9-4d85-9374-f1ec7626515b" (UID: "0f06e8ff-d2a9-4d85-9374-f1ec7626515b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:16:57.283630 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.283596 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f06e8ff-d2a9-4d85-9374-f1ec7626515b" (UID: "0f06e8ff-d2a9-4d85-9374-f1ec7626515b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:16:57.283828 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.283807 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f06e8ff-d2a9-4d85-9374-f1ec7626515b" (UID: "0f06e8ff-d2a9-4d85-9374-f1ec7626515b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:16:57.283828 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.283813 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-kube-api-access-kmkdd" (OuterVolumeSpecName: "kube-api-access-kmkdd") pod "0f06e8ff-d2a9-4d85-9374-f1ec7626515b" (UID: "0f06e8ff-d2a9-4d85-9374-f1ec7626515b"). InnerVolumeSpecName "kube-api-access-kmkdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:16:57.348356 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.348322 2575 generic.go:356] "Generic (PLEG): container finished" podID="0f06e8ff-d2a9-4d85-9374-f1ec7626515b" containerID="5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6" exitCode=0 Jul 20 19:16:57.348758 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.348365 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbc7d7c99-6cgsm" Jul 20 19:16:57.348758 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.348375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbc7d7c99-6cgsm" event={"ID":"0f06e8ff-d2a9-4d85-9374-f1ec7626515b","Type":"ContainerDied","Data":"5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6"} Jul 20 19:16:57.348758 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.348440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbc7d7c99-6cgsm" event={"ID":"0f06e8ff-d2a9-4d85-9374-f1ec7626515b","Type":"ContainerDied","Data":"1aa23256553fe0d8f5819bf4b4c1cac803e490742d884a6f9bee877de8e77775"} Jul 20 19:16:57.348758 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.348465 2575 scope.go:117] "RemoveContainer" containerID="5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6" Jul 20 19:16:57.357504 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.357484 2575 scope.go:117] "RemoveContainer" containerID="5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6" Jul 20 19:16:57.357763 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:16:57.357742 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6\": container with ID starting with 5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6 not found: ID does not exist" containerID="5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6" Jul 20 19:16:57.357829 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.357769 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6"} err="failed to get container status \"5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6\": rpc error: code = NotFound desc = could not find container \"5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6\": container with ID starting with 5905cb497f8bd8797580c0f20692d5fef04cb03fa6052f441c7e3112200f04a6 not found: ID does not exist" Jul 20 19:16:57.369675 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.369649 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cbc7d7c99-6cgsm"] Jul 20 19:16:57.373543 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.373519 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cbc7d7c99-6cgsm"] Jul 20 19:16:57.386652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.382842 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-config\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:16:57.386652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.382896 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-serving-cert\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:16:57.386652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.382912 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmkdd\" (UniqueName: \"kubernetes.io/projected/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-kube-api-access-kmkdd\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:16:57.386652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.382927 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-service-ca\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:16:57.386652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.382947 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-oauth-serving-cert\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:16:57.386652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.383000 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-console-oauth-config\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:16:57.386652 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:57.383027 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f06e8ff-d2a9-4d85-9374-f1ec7626515b-trusted-ca-bundle\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.751174 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:16:58.751134 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f06e8ff-d2a9-4d85-9374-f1ec7626515b" path="/var/lib/kubelet/pods/0f06e8ff-d2a9-4d85-9374-f1ec7626515b/volumes" Jul 20 19:17:00.197639 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:17:00.197609 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7885c" Jul 20 19:17:10.702367 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:17:10.702334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbr7w_e02ac804-8a07-468e-9c17-21d5098b5782/serve-healthcheck-canary/0.log" Jul 20 19:17:33.046828 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:17:33.046790 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:17:33.066252 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:17:33.066225 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:17:33.514952 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:17:33.514924 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:19:30.142591 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.142554 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx"] Jul 20 19:19:30.143102 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.142857 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f06e8ff-d2a9-4d85-9374-f1ec7626515b" containerName="console" Jul 20 19:19:30.143102 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.142868 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f06e8ff-d2a9-4d85-9374-f1ec7626515b" containerName="console" Jul 20 19:19:30.143102 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.142921 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f06e8ff-d2a9-4d85-9374-f1ec7626515b" containerName="console" Jul 20 19:19:30.144862 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.144846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.147126 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.147102 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 19:19:30.147333 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.147320 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wq4rd\"" Jul 20 19:19:30.148023 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.148009 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 19:19:30.157795 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.157774 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx"] Jul 20 19:19:30.229764 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.229735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbpph\" (UniqueName: \"kubernetes.io/projected/c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3-kube-api-access-qbpph\") pod \"cert-manager-cainjector-559cdd8c87-p8vcx\" (UID: \"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.229944 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.229771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p8vcx\" (UID: \"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.330567 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.330527 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbpph\" (UniqueName: \"kubernetes.io/projected/c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3-kube-api-access-qbpph\") pod \"cert-manager-cainjector-559cdd8c87-p8vcx\" (UID: \"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.330567 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.330569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p8vcx\" (UID: \"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.339720 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.339687 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p8vcx\" (UID: \"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.339837 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.339750 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbpph\" (UniqueName: \"kubernetes.io/projected/c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3-kube-api-access-qbpph\") pod \"cert-manager-cainjector-559cdd8c87-p8vcx\" (UID: \"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.461961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.461929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" Jul 20 19:19:30.603994 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.603944 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx"] Jul 20 19:19:30.606171 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:19:30.606140 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc29c66be_8a34_4c3c_9eea_5e9f4fb97ef3.slice/crio-54a0638d8e33521db2f0e405e9a1210960ef10e15aadc24eb9743a5c711260f9 WatchSource:0}: Error finding container 54a0638d8e33521db2f0e405e9a1210960ef10e15aadc24eb9743a5c711260f9: Status 404 returned error can't find the container with id 54a0638d8e33521db2f0e405e9a1210960ef10e15aadc24eb9743a5c711260f9 Jul 20 19:19:30.938210 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:30.938178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" event={"ID":"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3","Type":"ContainerStarted","Data":"54a0638d8e33521db2f0e405e9a1210960ef10e15aadc24eb9743a5c711260f9"} Jul 20 19:19:34.957278 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:34.957229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" event={"ID":"c29c66be-8a34-4c3c-9eea-5e9f4fb97ef3","Type":"ContainerStarted","Data":"6b441a7a0c4b9fd597ed766933d7d880b2ab4f64026e79503de9adc38d3e100e"} Jul 20 19:19:34.980825 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:34.980781 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8vcx" podStartSLOduration=1.624078562 podStartE2EDuration="4.980765142s" totalImagesPullingTime="3.35668658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:19:34.979081521 +0000 UTC m=+258.791949826" watchObservedRunningTime="2026-07-20 19:19:34.980765142 +0000 UTC m=+258.793633448" Jul 20 19:19:49.081433 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.081338 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-24qjf"] Jul 20 19:19:49.083741 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.083723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.086022 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.086001 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kjjhm\"" Jul 20 19:19:49.095936 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.095915 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-24qjf"] Jul 20 19:19:49.198989 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.198955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88d7aaca-ab6f-4380-8d31-15863ec7a531-bound-sa-token\") pod \"cert-manager-55b4d954d5-24qjf\" (UID: \"88d7aaca-ab6f-4380-8d31-15863ec7a531\") " pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.198989 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.198993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzc76\" (UniqueName: \"kubernetes.io/projected/88d7aaca-ab6f-4380-8d31-15863ec7a531-kube-api-access-zzc76\") pod \"cert-manager-55b4d954d5-24qjf\" (UID: \"88d7aaca-ab6f-4380-8d31-15863ec7a531\") " pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.300300 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.300262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88d7aaca-ab6f-4380-8d31-15863ec7a531-bound-sa-token\") pod \"cert-manager-55b4d954d5-24qjf\" (UID: \"88d7aaca-ab6f-4380-8d31-15863ec7a531\") " pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.300300 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.300304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc76\" (UniqueName: \"kubernetes.io/projected/88d7aaca-ab6f-4380-8d31-15863ec7a531-kube-api-access-zzc76\") pod \"cert-manager-55b4d954d5-24qjf\" (UID: \"88d7aaca-ab6f-4380-8d31-15863ec7a531\") " pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.308643 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.308616 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88d7aaca-ab6f-4380-8d31-15863ec7a531-bound-sa-token\") pod \"cert-manager-55b4d954d5-24qjf\" (UID: \"88d7aaca-ab6f-4380-8d31-15863ec7a531\") " pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.308834 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.308815 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzc76\" (UniqueName: \"kubernetes.io/projected/88d7aaca-ab6f-4380-8d31-15863ec7a531-kube-api-access-zzc76\") pod \"cert-manager-55b4d954d5-24qjf\" (UID: \"88d7aaca-ab6f-4380-8d31-15863ec7a531\") " pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.392881 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.392795 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-24qjf" Jul 20 19:19:49.527727 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:49.527686 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-24qjf"] Jul 20 19:19:49.530951 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:19:49.530922 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88d7aaca_ab6f_4380_8d31_15863ec7a531.slice/crio-96c43a5b2cdbff467cc0c8297f87784561767f6fbb198e4951f9d66b0ee03570 WatchSource:0}: Error finding container 96c43a5b2cdbff467cc0c8297f87784561767f6fbb198e4951f9d66b0ee03570: Status 404 returned error can't find the container with id 96c43a5b2cdbff467cc0c8297f87784561767f6fbb198e4951f9d66b0ee03570 Jul 20 19:19:50.016001 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:50.015966 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-24qjf" event={"ID":"88d7aaca-ab6f-4380-8d31-15863ec7a531","Type":"ContainerStarted","Data":"1f41460bb0e6e6771fef73a0e81ee6001a13f2c39af50ba8b597388eea42865c"} Jul 20 19:19:50.016001 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:50.016007 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-24qjf" event={"ID":"88d7aaca-ab6f-4380-8d31-15863ec7a531","Type":"ContainerStarted","Data":"96c43a5b2cdbff467cc0c8297f87784561767f6fbb198e4951f9d66b0ee03570"} Jul 20 19:19:50.033699 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:19:50.033647 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-24qjf" podStartSLOduration=1.0336288790000001 podStartE2EDuration="1.033628879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:19:50.032716349 +0000 UTC m=+273.845584678" watchObservedRunningTime="2026-07-20 19:19:50.033628879 +0000 UTC m=+273.846497190" Jul 20 19:20:00.474244 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.474197 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq"] Jul 20 19:20:00.480670 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.480649 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.483488 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.483458 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 19:20:00.483597 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.483490 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6dd72\"" Jul 20 19:20:00.483867 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.483844 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 19:20:00.483992 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.483971 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 19:20:00.484387 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.484371 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 19:20:00.490173 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.490152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.490270 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.490188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vv7g\" (UniqueName: \"kubernetes.io/projected/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-kube-api-access-6vv7g\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.490270 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.490225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.490360 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.490300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.490360 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.490323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.503550 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.503529 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq"] Jul 20 19:20:00.591123 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.591095 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.591313 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.591130 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vv7g\" (UniqueName: \"kubernetes.io/projected/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-kube-api-access-6vv7g\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.591313 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.591166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.591313 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.591226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.591313 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.591248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.591745 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.591718 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.593504 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.593474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.593611 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.593572 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.593673 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.593621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.602543 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.602516 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vv7g\" (UniqueName: \"kubernetes.io/projected/777d3f10-e46a-4ebf-9f1f-bd35dcb10d04-kube-api-access-6vv7g\") pod \"opendatahub-operator-controller-manager-8569dc75f9-vlvcq\" (UID: \"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.791325 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.791240 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:00.934169 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:00.934142 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq"] Jul 20 19:20:00.936315 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:20:00.936287 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777d3f10_e46a_4ebf_9f1f_bd35dcb10d04.slice/crio-18b29f44dd50b7099fa1974376409213f365d93930943d45397599001fe6567a WatchSource:0}: Error finding container 18b29f44dd50b7099fa1974376409213f365d93930943d45397599001fe6567a: Status 404 returned error can't find the container with id 18b29f44dd50b7099fa1974376409213f365d93930943d45397599001fe6567a Jul 20 19:20:01.058756 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:01.058674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" event={"ID":"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04","Type":"ContainerStarted","Data":"18b29f44dd50b7099fa1974376409213f365d93930943d45397599001fe6567a"} Jul 20 19:20:04.074091 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:04.074054 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" event={"ID":"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04","Type":"ContainerStarted","Data":"72c7207907685a8188dfac9682de32d12b35923d94b221d135398cdba5b62b88"} Jul 20 19:20:05.079800 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:05.079755 2575 generic.go:356] "Generic (PLEG): container finished" podID="777d3f10-e46a-4ebf-9f1f-bd35dcb10d04" containerID="72c7207907685a8188dfac9682de32d12b35923d94b221d135398cdba5b62b88" exitCode=0 Jul 20 19:20:05.080190 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:05.079830 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" event={"ID":"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04","Type":"ContainerDied","Data":"72c7207907685a8188dfac9682de32d12b35923d94b221d135398cdba5b62b88"} Jul 20 19:20:06.085587 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:06.085554 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" event={"ID":"777d3f10-e46a-4ebf-9f1f-bd35dcb10d04","Type":"ContainerStarted","Data":"2b29d21e34dc6889ae0820a8c7919cfedca24ed79ec7aacc65824110f4b0b272"} Jul 20 19:20:06.085974 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:06.085637 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:06.117852 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:06.117799 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" podStartSLOduration=1.7125395879999998 podStartE2EDuration="6.117778874s" totalImagesPullingTime="3.355376732s" totalInitContainerRuntime="1.049862554s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:06.115905019 +0000 UTC m=+289.928773351" watchObservedRunningTime="2026-07-20 19:20:06.117778874 +0000 UTC m=+289.930647182" Jul 20 19:20:16.595099 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:16.595074 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 19:20:17.092497 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:17.092467 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-vlvcq" Jul 20 19:20:20.163228 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.163193 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c"] Jul 20 19:20:20.166808 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.166784 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.170271 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.170245 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 19:20:20.170436 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.170306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:20:20.171216 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.171193 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 19:20:20.171328 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.171218 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 19:20:20.172859 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.172842 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 19:20:20.183084 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.183059 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nf6bd\"" Jul 20 19:20:20.200057 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.200026 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c"] Jul 20 19:20:20.261253 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.261219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f458c3-3288-4bb3-b357-d49b8d428a36-metrics-cert\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.261479 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.261286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5mc\" (UniqueName: \"kubernetes.io/projected/f4f458c3-3288-4bb3-b357-d49b8d428a36-kube-api-access-sd5mc\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.261479 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.261347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4f458c3-3288-4bb3-b357-d49b8d428a36-manager-config\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.261479 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.261395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4f458c3-3288-4bb3-b357-d49b8d428a36-cert\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.362044 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.362005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4f458c3-3288-4bb3-b357-d49b8d428a36-manager-config\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.362222 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.362049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4f458c3-3288-4bb3-b357-d49b8d428a36-cert\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.362222 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.362108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f458c3-3288-4bb3-b357-d49b8d428a36-metrics-cert\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.362222 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.362156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5mc\" (UniqueName: \"kubernetes.io/projected/f4f458c3-3288-4bb3-b357-d49b8d428a36-kube-api-access-sd5mc\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.362924 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.362894 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4f458c3-3288-4bb3-b357-d49b8d428a36-manager-config\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.364744 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.364723 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4f458c3-3288-4bb3-b357-d49b8d428a36-cert\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.364861 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.364772 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f458c3-3288-4bb3-b357-d49b8d428a36-metrics-cert\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.400925 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.400893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5mc\" (UniqueName: \"kubernetes.io/projected/f4f458c3-3288-4bb3-b357-d49b8d428a36-kube-api-access-sd5mc\") pod \"lws-controller-manager-554c775d9-xrk8c\" (UID: \"f4f458c3-3288-4bb3-b357-d49b8d428a36\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.477342 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.477300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:20.546355 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.546313 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq"] Jul 20 19:20:20.550748 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.550723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.556582 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.556501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 20 19:20:20.556756 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.556648 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 19:20:20.556957 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.556902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m2vql\"" Jul 20 19:20:20.557535 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.557286 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 19:20:20.557535 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.557302 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 20 19:20:20.569915 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.569869 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq"] Jul 20 19:20:20.627651 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.627604 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c"] Jul 20 19:20:20.649611 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:20:20.649579 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f458c3_3288_4bb3_b357_d49b8d428a36.slice/crio-eac42b71d0fc7dcff09832d4cffe1aa8e85755ed080569d4c89de4e9fcaffc51 WatchSource:0}: Error finding container eac42b71d0fc7dcff09832d4cffe1aa8e85755ed080569d4c89de4e9fcaffc51: Status 404 returned error can't find the container with id eac42b71d0fc7dcff09832d4cffe1aa8e85755ed080569d4c89de4e9fcaffc51 Jul 20 19:20:20.651596 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.651578 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:20:20.665926 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.665900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krzb5\" (UniqueName: \"kubernetes.io/projected/33badbbb-1dde-47c2-b930-181fba0eefc0-kube-api-access-krzb5\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.666078 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.666023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33badbbb-1dde-47c2-b930-181fba0eefc0-tls-certs\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.666078 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.666049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33badbbb-1dde-47c2-b930-181fba0eefc0-tmp\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.766657 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.766571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33badbbb-1dde-47c2-b930-181fba0eefc0-tls-certs\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.766657 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.766619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33badbbb-1dde-47c2-b930-181fba0eefc0-tmp\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.766834 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.766685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krzb5\" (UniqueName: \"kubernetes.io/projected/33badbbb-1dde-47c2-b930-181fba0eefc0-kube-api-access-krzb5\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.768844 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.768813 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33badbbb-1dde-47c2-b930-181fba0eefc0-tmp\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.769046 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.769028 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33badbbb-1dde-47c2-b930-181fba0eefc0-tls-certs\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.783207 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.783184 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krzb5\" (UniqueName: \"kubernetes.io/projected/33badbbb-1dde-47c2-b930-181fba0eefc0-kube-api-access-krzb5\") pod \"kube-auth-proxy-6469fb7d96-cmblq\" (UID: \"33badbbb-1dde-47c2-b930-181fba0eefc0\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:20.863373 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:20.863332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" Jul 20 19:20:21.015200 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:21.015160 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq"] Jul 20 19:20:21.020997 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:20:21.020966 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33badbbb_1dde_47c2_b930_181fba0eefc0.slice/crio-3ecb46a6ec7fd079504037c07a82f8dde8298b5d26fd3d5e66df28d73e80858e WatchSource:0}: Error finding container 3ecb46a6ec7fd079504037c07a82f8dde8298b5d26fd3d5e66df28d73e80858e: Status 404 returned error can't find the container with id 3ecb46a6ec7fd079504037c07a82f8dde8298b5d26fd3d5e66df28d73e80858e Jul 20 19:20:21.150726 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:21.150681 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" event={"ID":"f4f458c3-3288-4bb3-b357-d49b8d428a36","Type":"ContainerStarted","Data":"eac42b71d0fc7dcff09832d4cffe1aa8e85755ed080569d4c89de4e9fcaffc51"} Jul 20 19:20:21.152123 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:21.152089 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" event={"ID":"33badbbb-1dde-47c2-b930-181fba0eefc0","Type":"ContainerStarted","Data":"3ecb46a6ec7fd079504037c07a82f8dde8298b5d26fd3d5e66df28d73e80858e"} Jul 20 19:20:24.173874 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:24.173815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" event={"ID":"f4f458c3-3288-4bb3-b357-d49b8d428a36","Type":"ContainerStarted","Data":"2969f09895f6b096a8a897c37b228002f6c5d02e11202c0b91ce4bf51be9d742"} Jul 20 19:20:24.174820 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:24.174767 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:20:24.176874 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:24.176679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" event={"ID":"33badbbb-1dde-47c2-b930-181fba0eefc0","Type":"ContainerStarted","Data":"edfeb77dbcfae296515dcd04a04fccaa0b50c68d16bf622ff9630c793bd3bb34"} Jul 20 19:20:24.198961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:24.198906 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" podStartSLOduration=0.790526975 podStartE2EDuration="4.198883002s" totalImagesPullingTime="3.408356027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:24.198002239 +0000 UTC m=+308.010870572" watchObservedRunningTime="2026-07-20 19:20:24.198883002 +0000 UTC m=+308.011751307" Jul 20 19:20:24.220459 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:24.220379 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-cmblq" podStartSLOduration=1.18112054 podStartE2EDuration="4.220357811s" totalImagesPullingTime="3.039237271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:24.219507917 +0000 UTC m=+308.032376224" watchObservedRunningTime="2026-07-20 19:20:24.220357811 +0000 UTC m=+308.033226121" Jul 20 19:20:36.187885 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:20:36.187856 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-554c775d9-xrk8c" Jul 20 19:22:06.187333 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.187298 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn"] Jul 20 19:22:06.190705 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.190682 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.193893 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.193872 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 20 19:22:06.194016 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.193893 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 20 19:22:06.194016 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.193939 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 19:22:06.194016 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.193939 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5xgj\"" Jul 20 19:22:06.194016 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.193894 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 19:22:06.208439 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.208399 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn"] Jul 20 19:22:06.308782 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.308747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3044d031-9753-46d4-afac-73d015d0ac0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.308961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.308818 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3044d031-9753-46d4-afac-73d015d0ac0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.308961 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.308839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbb72\" (UniqueName: \"kubernetes.io/projected/3044d031-9753-46d4-afac-73d015d0ac0b-kube-api-access-gbb72\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.409715 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.409677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbb72\" (UniqueName: \"kubernetes.io/projected/3044d031-9753-46d4-afac-73d015d0ac0b-kube-api-access-gbb72\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.409881 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.409763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3044d031-9753-46d4-afac-73d015d0ac0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.409881 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.409847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3044d031-9753-46d4-afac-73d015d0ac0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.409960 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:06.409908 2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 20 19:22:06.409994 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:06.409979 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3044d031-9753-46d4-afac-73d015d0ac0b-plugin-serving-cert podName:3044d031-9753-46d4-afac-73d015d0ac0b nodeName:}" failed. No retries permitted until 2026-07-20 19:22:06.909962998 +0000 UTC m=+410.722831282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3044d031-9753-46d4-afac-73d015d0ac0b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-mt8cn" (UID: "3044d031-9753-46d4-afac-73d015d0ac0b") : secret "plugin-serving-cert" not found Jul 20 19:22:06.410468 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.410452 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3044d031-9753-46d4-afac-73d015d0ac0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.422636 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.422610 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbb72\" (UniqueName: \"kubernetes.io/projected/3044d031-9753-46d4-afac-73d015d0ac0b-kube-api-access-gbb72\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.915930 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.915887 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3044d031-9753-46d4-afac-73d015d0ac0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:06.918371 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:06.918334 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3044d031-9753-46d4-afac-73d015d0ac0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mt8cn\" (UID: \"3044d031-9753-46d4-afac-73d015d0ac0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:07.099333 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:07.099297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" Jul 20 19:22:07.233394 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:07.233213 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn"] Jul 20 19:22:07.236202 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:22:07.236173 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3044d031_9753_46d4_afac_73d015d0ac0b.slice/crio-e84169573608ea0cb2b195ed98d773d562ac2c63cf14f0f2df95770affa7eef0 WatchSource:0}: Error finding container e84169573608ea0cb2b195ed98d773d562ac2c63cf14f0f2df95770affa7eef0: Status 404 returned error can't find the container with id e84169573608ea0cb2b195ed98d773d562ac2c63cf14f0f2df95770affa7eef0 Jul 20 19:22:07.627972 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:07.627934 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" event={"ID":"3044d031-9753-46d4-afac-73d015d0ac0b","Type":"ContainerStarted","Data":"e84169573608ea0cb2b195ed98d773d562ac2c63cf14f0f2df95770affa7eef0"} Jul 20 19:22:15.663740 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.663692 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv"] Jul 20 19:22:15.667441 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.667395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:15.670140 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.670112 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xhgnr\"" Jul 20 19:22:15.682341 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.682314 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv"] Jul 20 19:22:15.702508 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.702471 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6br9b\" (UniqueName: \"kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b\") pod \"kuadrant-operator-controller-manager-86878c769f-cdblv\" (UID: \"ec056340-4663-4a39-b4cc-e660f75d1951\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:15.702680 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.702532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec056340-4663-4a39-b4cc-e660f75d1951-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cdblv\" (UID: \"ec056340-4663-4a39-b4cc-e660f75d1951\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:15.803938 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.803899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6br9b\" (UniqueName: \"kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b\") pod \"kuadrant-operator-controller-manager-86878c769f-cdblv\" (UID: \"ec056340-4663-4a39-b4cc-e660f75d1951\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:15.804139 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.803947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec056340-4663-4a39-b4cc-e660f75d1951-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cdblv\" (UID: \"ec056340-4663-4a39-b4cc-e660f75d1951\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:15.804350 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.804327 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec056340-4663-4a39-b4cc-e660f75d1951-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cdblv\" (UID: \"ec056340-4663-4a39-b4cc-e660f75d1951\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:15.811373 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.811343 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv"] Jul 20 19:22:15.811668 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:15.811643 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6br9b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" podUID="ec056340-4663-4a39-b4cc-e660f75d1951" Jul 20 19:22:15.819405 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.819375 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv"] Jul 20 19:22:15.819633 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:15.819613 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6br9b for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv: failed to fetch token: pods "kuadrant-operator-controller-manager-86878c769f-cdblv" not found Jul 20 19:22:15.819718 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:15.819704 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b podName:ec056340-4663-4a39-b4cc-e660f75d1951 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:16.319682132 +0000 UTC m=+420.132550435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6br9b" (UniqueName: "kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b") pod "kuadrant-operator-controller-manager-86878c769f-cdblv" (UID: "ec056340-4663-4a39-b4cc-e660f75d1951") : failed to fetch token: pods "kuadrant-operator-controller-manager-86878c769f-cdblv" not found Jul 20 19:22:15.836615 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.836574 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9"] Jul 20 19:22:15.840173 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.840150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:15.852583 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.852556 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9"] Jul 20 19:22:15.904545 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.904513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27912c5-c0c1-4742-9070-d65203441364-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vhgc9\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:15.904722 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:15.904568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zfc\" (UniqueName: \"kubernetes.io/projected/b27912c5-c0c1-4742-9070-d65203441364-kube-api-access-f5zfc\") pod \"kuadrant-operator-controller-manager-86878c769f-vhgc9\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:16.005555 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.005513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27912c5-c0c1-4742-9070-d65203441364-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vhgc9\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:16.005727 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.005566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zfc\" (UniqueName: \"kubernetes.io/projected/b27912c5-c0c1-4742-9070-d65203441364-kube-api-access-f5zfc\") pod \"kuadrant-operator-controller-manager-86878c769f-vhgc9\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:16.005991 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.005965 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27912c5-c0c1-4742-9070-d65203441364-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vhgc9\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:16.014061 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.014030 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zfc\" (UniqueName: \"kubernetes.io/projected/b27912c5-c0c1-4742-9070-d65203441364-kube-api-access-f5zfc\") pod \"kuadrant-operator-controller-manager-86878c769f-vhgc9\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:16.152305 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.152264 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:16.309162 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.309088 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9"] Jul 20 19:22:16.313066 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:22:16.313021 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27912c5_c0c1_4742_9070_d65203441364.slice/crio-ca6dd421df2591b89fa8d8c27b6bf95e7e77e7924626c5485ea1f0baa4a409f4 WatchSource:0}: Error finding container ca6dd421df2591b89fa8d8c27b6bf95e7e77e7924626c5485ea1f0baa4a409f4: Status 404 returned error can't find the container with id ca6dd421df2591b89fa8d8c27b6bf95e7e77e7924626c5485ea1f0baa4a409f4 Jul 20 19:22:16.409460 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.409405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6br9b\" (UniqueName: \"kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b\") pod \"kuadrant-operator-controller-manager-86878c769f-cdblv\" (UID: \"ec056340-4663-4a39-b4cc-e660f75d1951\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:16.411834 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:16.411816 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6br9b for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-cdblv" not found Jul 20 19:22:16.411925 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:16.411878 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b podName:ec056340-4663-4a39-b4cc-e660f75d1951 nodeName:}" failed. No retries permitted until 2026-07-20 19:22:17.411855976 +0000 UTC m=+421.224724261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6br9b" (UniqueName: "kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b") pod "kuadrant-operator-controller-manager-86878c769f-cdblv" (UID: "ec056340-4663-4a39-b4cc-e660f75d1951") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-cdblv" not found Jul 20 19:22:16.679070 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.678981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" event={"ID":"b27912c5-c0c1-4742-9070-d65203441364","Type":"ContainerStarted","Data":"ca6dd421df2591b89fa8d8c27b6bf95e7e77e7924626c5485ea1f0baa4a409f4"} Jul 20 19:22:16.679070 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.679051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:16.681593 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:16.681564 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cdblv\" is forbidden: User \"system:node:ip-10-0-135-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-129.ec2.internal' and this object" podUID="ec056340-4663-4a39-b4cc-e660f75d1951" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:16.689435 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.689392 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:16.691703 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:16.691671 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cdblv\" is forbidden: User \"system:node:ip-10-0-135-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-129.ec2.internal' and this object" podUID="ec056340-4663-4a39-b4cc-e660f75d1951" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:16.711592 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.711561 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec056340-4663-4a39-b4cc-e660f75d1951-extensions-socket-volume\") pod \"ec056340-4663-4a39-b4cc-e660f75d1951\" (UID: \"ec056340-4663-4a39-b4cc-e660f75d1951\") " Jul 20 19:22:16.711875 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.711848 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec056340-4663-4a39-b4cc-e660f75d1951-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ec056340-4663-4a39-b4cc-e660f75d1951" (UID: "ec056340-4663-4a39-b4cc-e660f75d1951"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:22:16.711939 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.711881 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6br9b\" (UniqueName: \"kubernetes.io/projected/ec056340-4663-4a39-b4cc-e660f75d1951-kube-api-access-6br9b\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:22:16.750160 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:16.750117 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cdblv\" is forbidden: User \"system:node:ip-10-0-135-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-129.ec2.internal' and this object" podUID="ec056340-4663-4a39-b4cc-e660f75d1951" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:16.752686 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.752661 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec056340-4663-4a39-b4cc-e660f75d1951" path="/var/lib/kubelet/pods/ec056340-4663-4a39-b4cc-e660f75d1951/volumes" Jul 20 19:22:16.812872 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:16.812838 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec056340-4663-4a39-b4cc-e660f75d1951-extensions-socket-volume\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:22:17.684147 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:17.684114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:17.689343 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:22:17.689311 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cdblv\" is forbidden: User \"system:node:ip-10-0-135-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-129.ec2.internal' and this object" podUID="ec056340-4663-4a39-b4cc-e660f75d1951" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdblv" Jul 20 19:22:32.759521 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:32.759485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" event={"ID":"3044d031-9753-46d4-afac-73d015d0ac0b","Type":"ContainerStarted","Data":"7cc050f41bd5fc5e04df7a56128d3da24e0d6fb30fb91a296064d6b27fe409fe"} Jul 20 19:22:32.807006 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:32.806945 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mt8cn" podStartSLOduration=2.194480178 podStartE2EDuration="26.806921594s" totalImagesPullingTime="24.612441416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:32.803559141 +0000 UTC m=+436.616427477" watchObservedRunningTime="2026-07-20 19:22:32.806921594 +0000 UTC m=+436.619789902" Jul 20 19:22:38.789788 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:38.789742 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" event={"ID":"b27912c5-c0c1-4742-9070-d65203441364","Type":"ContainerStarted","Data":"d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf"} Jul 20 19:22:38.790236 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:38.789805 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:22:38.809770 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:38.809723 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" podStartSLOduration=2.151681882 podStartE2EDuration="23.809707582s" totalImagesPullingTime="21.6580257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:38.808277796 +0000 UTC m=+442.621146102" watchObservedRunningTime="2026-07-20 19:22:38.809707582 +0000 UTC m=+442.622575887" Jul 20 19:22:49.797186 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:22:49.797151 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:23:09.549489 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:09.549453 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-n8qc9"] Jul 20 19:23:09.553144 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:09.553118 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n8qc9" Jul 20 19:23:09.555197 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:09.555176 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-crzwk\"" Jul 20 19:23:09.559220 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:09.559199 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n8qc9"] Jul 20 19:23:09.706770 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:09.706735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzplm\" (UniqueName: \"kubernetes.io/projected/b9c765a6-888b-474a-9e27-88fb04d8fa42-kube-api-access-bzplm\") pod \"authorino-58cd955675-n8qc9\" (UID: \"b9c765a6-888b-474a-9e27-88fb04d8fa42\") " pod="kuadrant-system/authorino-58cd955675-n8qc9" Jul 20 19:23:09.807443 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:09.807338 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzplm\" (UniqueName: \"kubernetes.io/projected/b9c765a6-888b-474a-9e27-88fb04d8fa42-kube-api-access-bzplm\") pod \"authorino-58cd955675-n8qc9\" (UID: \"b9c765a6-888b-474a-9e27-88fb04d8fa42\") " pod="kuadrant-system/authorino-58cd955675-n8qc9" Jul 20 19:23:09.869061 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:09.869027 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzplm\" (UniqueName: \"kubernetes.io/projected/b9c765a6-888b-474a-9e27-88fb04d8fa42-kube-api-access-bzplm\") pod \"authorino-58cd955675-n8qc9\" (UID: \"b9c765a6-888b-474a-9e27-88fb04d8fa42\") " pod="kuadrant-system/authorino-58cd955675-n8qc9" Jul 20 19:23:10.164184 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:10.164099 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n8qc9" Jul 20 19:23:10.299880 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:10.299851 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n8qc9"] Jul 20 19:23:10.303060 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:23:10.303027 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9c765a6_888b_474a_9e27_88fb04d8fa42.slice/crio-053e9724bb6266fb81a98cb4944ccac08a8ee2d605c952b09c0bf409765957f1 WatchSource:0}: Error finding container 053e9724bb6266fb81a98cb4944ccac08a8ee2d605c952b09c0bf409765957f1: Status 404 returned error can't find the container with id 053e9724bb6266fb81a98cb4944ccac08a8ee2d605c952b09c0bf409765957f1 Jul 20 19:23:10.929765 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:10.929729 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n8qc9" event={"ID":"b9c765a6-888b-474a-9e27-88fb04d8fa42","Type":"ContainerStarted","Data":"053e9724bb6266fb81a98cb4944ccac08a8ee2d605c952b09c0bf409765957f1"} Jul 20 19:23:13.948480 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:13.948444 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n8qc9" event={"ID":"b9c765a6-888b-474a-9e27-88fb04d8fa42","Type":"ContainerStarted","Data":"ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4"} Jul 20 19:23:13.963614 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:13.963239 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-n8qc9" podStartSLOduration=1.431900015 podStartE2EDuration="4.963218164s" totalImagesPullingTime="3.531318149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:13.963084537 +0000 UTC m=+477.775952843" watchObservedRunningTime="2026-07-20 19:23:13.963218164 +0000 UTC m=+477.776086471" Jul 20 19:23:14.497921 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:14.497890 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n8qc9"] Jul 20 19:23:15.957547 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:15.957507 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-n8qc9" podUID="b9c765a6-888b-474a-9e27-88fb04d8fa42" containerName="authorino" containerID="cri-o://ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4" gracePeriod=30 Jul 20 19:23:16.208708 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.208641 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n8qc9" Jul 20 19:23:16.367669 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.367634 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzplm\" (UniqueName: \"kubernetes.io/projected/b9c765a6-888b-474a-9e27-88fb04d8fa42-kube-api-access-bzplm\") pod \"b9c765a6-888b-474a-9e27-88fb04d8fa42\" (UID: \"b9c765a6-888b-474a-9e27-88fb04d8fa42\") " Jul 20 19:23:16.369929 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.369904 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c765a6-888b-474a-9e27-88fb04d8fa42-kube-api-access-bzplm" (OuterVolumeSpecName: "kube-api-access-bzplm") pod "b9c765a6-888b-474a-9e27-88fb04d8fa42" (UID: "b9c765a6-888b-474a-9e27-88fb04d8fa42"). InnerVolumeSpecName "kube-api-access-bzplm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:23:16.468580 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.468493 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzplm\" (UniqueName: \"kubernetes.io/projected/b9c765a6-888b-474a-9e27-88fb04d8fa42-kube-api-access-bzplm\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:23:16.962938 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.962895 2575 generic.go:356] "Generic (PLEG): container finished" podID="b9c765a6-888b-474a-9e27-88fb04d8fa42" containerID="ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4" exitCode=0 Jul 20 19:23:16.963353 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.962945 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n8qc9" Jul 20 19:23:16.963353 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.962971 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n8qc9" event={"ID":"b9c765a6-888b-474a-9e27-88fb04d8fa42","Type":"ContainerDied","Data":"ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4"} Jul 20 19:23:16.963353 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.963013 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n8qc9" event={"ID":"b9c765a6-888b-474a-9e27-88fb04d8fa42","Type":"ContainerDied","Data":"053e9724bb6266fb81a98cb4944ccac08a8ee2d605c952b09c0bf409765957f1"} Jul 20 19:23:16.963353 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.963035 2575 scope.go:117] "RemoveContainer" containerID="ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4" Jul 20 19:23:16.970988 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.970971 2575 scope.go:117] "RemoveContainer" containerID="ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4" Jul 20 19:23:16.971231 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:23:16.971210 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4\": container with ID starting with ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4 not found: ID does not exist" containerID="ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4" Jul 20 19:23:16.971353 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.971235 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4"} err="failed to get container status \"ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4\": rpc error: code = NotFound desc = could not find container \"ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4\": container with ID starting with ad39f31f0351baf504cbcf3dc5f4cc8983c481a00bfd523504c7e6e1a45cf8e4 not found: ID does not exist" Jul 20 19:23:16.980579 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.980557 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n8qc9"] Jul 20 19:23:16.982608 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:16.982588 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-n8qc9"] Jul 20 19:23:18.752024 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:18.751992 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c765a6-888b-474a-9e27-88fb04d8fa42" path="/var/lib/kubelet/pods/b9c765a6-888b-474a-9e27-88fb04d8fa42/volumes" Jul 20 19:23:43.411271 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.411234 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55657bb78c-rws9z"] Jul 20 19:23:43.411767 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.411606 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c765a6-888b-474a-9e27-88fb04d8fa42" containerName="authorino" Jul 20 19:23:43.411767 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.411618 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c765a6-888b-474a-9e27-88fb04d8fa42" containerName="authorino" Jul 20 19:23:43.411767 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.411686 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c765a6-888b-474a-9e27-88fb04d8fa42" containerName="authorino" Jul 20 19:23:43.414697 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.414680 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:43.425315 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.425291 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 19:23:43.425464 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.425292 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 19:23:43.425464 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.425293 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5h8p\"" Jul 20 19:23:43.438693 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.438663 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55657bb78c-rws9z"] Jul 20 19:23:43.496290 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.496254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfjfm\" (UniqueName: \"kubernetes.io/projected/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-kube-api-access-jfjfm\") pod \"maas-controller-55657bb78c-rws9z\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:43.496290 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.496301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert\") pod \"maas-controller-55657bb78c-rws9z\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:43.597480 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.597435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfjfm\" (UniqueName: \"kubernetes.io/projected/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-kube-api-access-jfjfm\") pod \"maas-controller-55657bb78c-rws9z\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:43.597668 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.597499 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert\") pod \"maas-controller-55657bb78c-rws9z\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:43.597668 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:23:43.597642 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 20 19:23:43.597822 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:23:43.597714 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert podName:494cbf49-7d3f-4dc6-83b6-97ba62ce4d28 nodeName:}" failed. No retries permitted until 2026-07-20 19:23:44.097697689 +0000 UTC m=+507.910565973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert") pod "maas-controller-55657bb78c-rws9z" (UID: "494cbf49-7d3f-4dc6-83b6-97ba62ce4d28") : secret "maas-controller-webhook-cert" not found Jul 20 19:23:43.606617 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:43.606594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfjfm\" (UniqueName: \"kubernetes.io/projected/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-kube-api-access-jfjfm\") pod \"maas-controller-55657bb78c-rws9z\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:44.103843 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:44.103809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert\") pod \"maas-controller-55657bb78c-rws9z\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:44.106176 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:44.106148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert\") pod \"maas-controller-55657bb78c-rws9z\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:44.325106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:44.325072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:44.457571 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:44.457544 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55657bb78c-rws9z"] Jul 20 19:23:44.460600 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:23:44.460562 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494cbf49_7d3f_4dc6_83b6_97ba62ce4d28.slice/crio-3a7ba8a554e082edfd7391f4e700e719d7054280912353b9a97d1ea5d26ee9e5 WatchSource:0}: Error finding container 3a7ba8a554e082edfd7391f4e700e719d7054280912353b9a97d1ea5d26ee9e5: Status 404 returned error can't find the container with id 3a7ba8a554e082edfd7391f4e700e719d7054280912353b9a97d1ea5d26ee9e5 Jul 20 19:23:45.089949 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:45.089902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55657bb78c-rws9z" event={"ID":"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28","Type":"ContainerStarted","Data":"3a7ba8a554e082edfd7391f4e700e719d7054280912353b9a97d1ea5d26ee9e5"} Jul 20 19:23:47.103264 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:47.103171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55657bb78c-rws9z" event={"ID":"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28","Type":"ContainerStarted","Data":"2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52"} Jul 20 19:23:47.103653 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:47.103316 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:47.125698 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:47.125650 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55657bb78c-rws9z" podStartSLOduration=1.883908857 podStartE2EDuration="4.125634216s" totalImagesPullingTime="2.241725359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:47.124127273 +0000 UTC m=+510.936995581" watchObservedRunningTime="2026-07-20 19:23:47.125634216 +0000 UTC m=+510.938502521" Jul 20 19:23:58.109685 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:58.109650 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:58.690501 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:58.690466 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55657bb78c-rws9z"] Jul 20 19:23:58.690706 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:58.690665 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55657bb78c-rws9z" podUID="494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" containerName="manager" containerID="cri-o://2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52" gracePeriod=30 Jul 20 19:23:58.936069 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:58.936044 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:59.043806 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.043707 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert\") pod \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " Jul 20 19:23:59.043806 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.043760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfjfm\" (UniqueName: \"kubernetes.io/projected/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-kube-api-access-jfjfm\") pod \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\" (UID: \"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28\") " Jul 20 19:23:59.045888 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.045855 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" (UID: "494cbf49-7d3f-4dc6-83b6-97ba62ce4d28"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:23:59.045998 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.045913 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-kube-api-access-jfjfm" (OuterVolumeSpecName: "kube-api-access-jfjfm") pod "494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" (UID: "494cbf49-7d3f-4dc6-83b6-97ba62ce4d28"). InnerVolumeSpecName "kube-api-access-jfjfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:23:59.144908 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.144872 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-webhook-cert\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:23:59.144908 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.144900 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfjfm\" (UniqueName: \"kubernetes.io/projected/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28-kube-api-access-jfjfm\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:23:59.156675 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.156640 2575 generic.go:356] "Generic (PLEG): container finished" podID="494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" containerID="2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52" exitCode=0 Jul 20 19:23:59.156816 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.156687 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55657bb78c-rws9z" Jul 20 19:23:59.156816 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.156730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55657bb78c-rws9z" event={"ID":"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28","Type":"ContainerDied","Data":"2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52"} Jul 20 19:23:59.156816 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.156785 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55657bb78c-rws9z" event={"ID":"494cbf49-7d3f-4dc6-83b6-97ba62ce4d28","Type":"ContainerDied","Data":"3a7ba8a554e082edfd7391f4e700e719d7054280912353b9a97d1ea5d26ee9e5"} Jul 20 19:23:59.156816 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.156814 2575 scope.go:117] "RemoveContainer" containerID="2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52" Jul 20 19:23:59.165744 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.165728 2575 scope.go:117] "RemoveContainer" containerID="2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52" Jul 20 19:23:59.165992 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:23:59.165976 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52\": container with ID starting with 2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52 not found: ID does not exist" containerID="2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52" Jul 20 19:23:59.166032 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.166003 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52"} err="failed to get container status \"2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52\": rpc error: code = NotFound desc = could not find container \"2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52\": container with ID starting with 2dc11dbb7db9a63d6b9031931d34f6a51223520d7cdac245930f39c574c23c52 not found: ID does not exist" Jul 20 19:23:59.177400 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.177377 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55657bb78c-rws9z"] Jul 20 19:23:59.181395 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:23:59.181374 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55657bb78c-rws9z"] Jul 20 19:24:00.751256 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:00.751222 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" path="/var/lib/kubelet/pods/494cbf49-7d3f-4dc6-83b6-97ba62ce4d28/volumes" Jul 20 19:24:21.690092 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.690055 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-b22bt"] Jul 20 19:24:21.690538 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.690390 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" containerName="manager" Jul 20 19:24:21.690538 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.690401 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" containerName="manager" Jul 20 19:24:21.690538 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.690476 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="494cbf49-7d3f-4dc6-83b6-97ba62ce4d28" containerName="manager" Jul 20 19:24:21.695219 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.695186 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:21.698517 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.698491 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 20 19:24:21.698656 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.698567 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-89659\"" Jul 20 19:24:21.706802 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.706772 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-b22bt"] Jul 20 19:24:21.741780 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.741735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c7b020-6dd8-46e6-ae34-cb87842482a9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-b22bt\" (UID: \"08c7b020-6dd8-46e6-ae34-cb87842482a9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:21.741955 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.741877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bv8m\" (UniqueName: \"kubernetes.io/projected/08c7b020-6dd8-46e6-ae34-cb87842482a9-kube-api-access-2bv8m\") pod \"payload-processing-5bf47cd988-b22bt\" (UID: \"08c7b020-6dd8-46e6-ae34-cb87842482a9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:21.843310 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.843276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bv8m\" (UniqueName: \"kubernetes.io/projected/08c7b020-6dd8-46e6-ae34-cb87842482a9-kube-api-access-2bv8m\") pod \"payload-processing-5bf47cd988-b22bt\" (UID: \"08c7b020-6dd8-46e6-ae34-cb87842482a9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:21.843310 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.843310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c7b020-6dd8-46e6-ae34-cb87842482a9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-b22bt\" (UID: \"08c7b020-6dd8-46e6-ae34-cb87842482a9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:21.844064 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.844033 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08c7b020-6dd8-46e6-ae34-cb87842482a9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-b22bt\" (UID: \"08c7b020-6dd8-46e6-ae34-cb87842482a9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:21.852810 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:21.852786 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bv8m\" (UniqueName: \"kubernetes.io/projected/08c7b020-6dd8-46e6-ae34-cb87842482a9-kube-api-access-2bv8m\") pod \"payload-processing-5bf47cd988-b22bt\" (UID: \"08c7b020-6dd8-46e6-ae34-cb87842482a9\") " pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:22.006725 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:22.006635 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:22.140676 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:22.140652 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-b22bt"] Jul 20 19:24:22.142891 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:24:22.142861 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c7b020_6dd8_46e6_ae34_cb87842482a9.slice/crio-894fd862eab8ed869772249f09dacd2e7fce7d46a9b9177c96cbe716decc0396 WatchSource:0}: Error finding container 894fd862eab8ed869772249f09dacd2e7fce7d46a9b9177c96cbe716decc0396: Status 404 returned error can't find the container with id 894fd862eab8ed869772249f09dacd2e7fce7d46a9b9177c96cbe716decc0396 Jul 20 19:24:22.259431 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:22.259317 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" event={"ID":"08c7b020-6dd8-46e6-ae34-cb87842482a9","Type":"ContainerStarted","Data":"894fd862eab8ed869772249f09dacd2e7fce7d46a9b9177c96cbe716decc0396"} Jul 20 19:24:24.271076 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:24.271041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" event={"ID":"08c7b020-6dd8-46e6-ae34-cb87842482a9","Type":"ContainerStarted","Data":"ebfe5969e77039f84773c4e1aafc303f4872f4840002bd5a487e352c10c8fea8"} Jul 20 19:24:24.271475 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:24.271150 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:24.288774 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:24.288714 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" podStartSLOduration=1.730895013 podStartE2EDuration="3.2886978s" totalImagesPullingTime="1.557802787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:24:24.286880195 +0000 UTC m=+548.099748502" watchObservedRunningTime="2026-07-20 19:24:24.2886978 +0000 UTC m=+548.101566106" Jul 20 19:24:35.278458 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:35.278402 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-b22bt" Jul 20 19:24:49.970977 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:49.970938 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt"] Jul 20 19:24:49.973478 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:49.973452 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:49.977284 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:49.977261 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4pg4h\"" Jul 20 19:24:49.977461 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:49.977296 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 19:24:49.977461 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:49.977303 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 19:24:49.977461 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:49.977379 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 20 19:24:49.983200 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:49.983173 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt"] Jul 20 19:24:50.101094 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.101050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.101274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.101149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47w2\" (UniqueName: \"kubernetes.io/projected/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-kube-api-access-v47w2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.101274 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.101216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.101351 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.101279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.101351 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.101310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.101445 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.101354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.202813 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.202775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.202996 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.202826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.202996 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.202857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.202996 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.202880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.202996 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.202914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.202996 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.202959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47w2\" (UniqueName: \"kubernetes.io/projected/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-kube-api-access-v47w2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.203317 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.203200 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.203317 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.203245 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.203396 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.203326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.205351 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.205323 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.205522 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.205504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.210528 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.210510 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47w2\" (UniqueName: \"kubernetes.io/projected/e7b44c0f-574d-46f7-a4df-98b5fbcdeab5-kube-api-access-v47w2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt\" (UID: \"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.285544 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.285445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:24:50.422526 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:50.422498 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt"] Jul 20 19:24:50.424882 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:24:50.424857 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b44c0f_574d_46f7_a4df_98b5fbcdeab5.slice/crio-466f439e65d756dbfa234a2b5e78464a0e14e47bb58ef2d16cf720c28f227655 WatchSource:0}: Error finding container 466f439e65d756dbfa234a2b5e78464a0e14e47bb58ef2d16cf720c28f227655: Status 404 returned error can't find the container with id 466f439e65d756dbfa234a2b5e78464a0e14e47bb58ef2d16cf720c28f227655 Jul 20 19:24:51.394065 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:51.394026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" event={"ID":"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5","Type":"ContainerStarted","Data":"466f439e65d756dbfa234a2b5e78464a0e14e47bb58ef2d16cf720c28f227655"} Jul 20 19:24:52.399710 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:52.399674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" event={"ID":"e7b44c0f-574d-46f7-a4df-98b5fbcdeab5","Type":"ContainerStarted","Data":"c9a3195465511dbe91ef6ad2f327fd1c7ec9531308178e721b588963dfb88448"} Jul 20 19:24:52.415647 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:24:52.415587 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" podStartSLOduration=2.233236573 podStartE2EDuration="3.415566057s" totalImagesPullingTime="1.182329484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:24:52.415017148 +0000 UTC m=+576.227885453" watchObservedRunningTime="2026-07-20 19:24:52.415566057 +0000 UTC m=+576.228434363" Jul 20 19:25:00.286459 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:00.286394 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:25:00.286872 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:00.286480 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:25:00.299207 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:00.299175 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:25:00.448363 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:00.448334 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt" Jul 20 19:25:58.188890 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.188842 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth"] Jul 20 19:25:58.191457 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.191433 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.193899 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.193881 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 20 19:25:58.202739 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.202715 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth"] Jul 20 19:25:58.311047 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.311013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.311047 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.311050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.311259 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.311092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4101c0-bd80-43f0-b5a2-397c79260039-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.311259 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.311173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh28\" (UniqueName: \"kubernetes.io/projected/0d4101c0-bd80-43f0-b5a2-397c79260039-kube-api-access-kmh28\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.311259 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.311207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.311259 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.311246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412387 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh28\" (UniqueName: \"kubernetes.io/projected/0d4101c0-bd80-43f0-b5a2-397c79260039-kube-api-access-kmh28\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412387 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412684 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412684 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412684 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412684 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4101c0-bd80-43f0-b5a2-397c79260039-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412902 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412902 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412841 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.412987 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.412939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.414835 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.414808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4101c0-bd80-43f0-b5a2-397c79260039-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.415053 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.415037 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4101c0-bd80-43f0-b5a2-397c79260039-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.420207 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.420186 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh28\" (UniqueName: \"kubernetes.io/projected/0d4101c0-bd80-43f0-b5a2-397c79260039-kube-api-access-kmh28\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth\" (UID: \"0d4101c0-bd80-43f0-b5a2-397c79260039\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.501972 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.501872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:25:58.636354 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.636312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth"] Jul 20 19:25:58.639448 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:25:58.639393 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4101c0_bd80_43f0_b5a2_397c79260039.slice/crio-ef6ea29efdf783b58f6f1144423d2c6045cf4b736fa5a84f76bee411d88353bb WatchSource:0}: Error finding container ef6ea29efdf783b58f6f1144423d2c6045cf4b736fa5a84f76bee411d88353bb: Status 404 returned error can't find the container with id ef6ea29efdf783b58f6f1144423d2c6045cf4b736fa5a84f76bee411d88353bb Jul 20 19:25:58.640866 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.640848 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:25:58.709538 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:58.709499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" event={"ID":"0d4101c0-bd80-43f0-b5a2-397c79260039","Type":"ContainerStarted","Data":"ef6ea29efdf783b58f6f1144423d2c6045cf4b736fa5a84f76bee411d88353bb"} Jul 20 19:25:59.715850 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:59.715809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" event={"ID":"0d4101c0-bd80-43f0-b5a2-397c79260039","Type":"ContainerStarted","Data":"a3762843d66b50d4fecd3a9fef951a23f6b1c5128bb72ea8f6993717fe383a63"} Jul 20 19:25:59.737155 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:25:59.737096 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" podStartSLOduration=1.439934127 podStartE2EDuration="1.737078833s" totalImagesPullingTime="297.144706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:25:59.734930281 +0000 UTC m=+643.547798599" watchObservedRunningTime="2026-07-20 19:25:59.737078833 +0000 UTC m=+643.549947138" Jul 20 19:26:08.502408 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:08.502374 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:26:08.502840 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:08.502457 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:26:08.515220 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:08.515192 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:26:08.771379 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:08.771297 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth" Jul 20 19:26:10.882425 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:10.882382 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2"] Jul 20 19:26:10.884688 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:10.884668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:10.887118 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:10.887098 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 20 19:26:10.896132 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:10.896105 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2"] Jul 20 19:26:11.029697 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.029649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.029697 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.029699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25kjm\" (UniqueName: \"kubernetes.io/projected/86e8cda7-a57d-486c-91e7-0f7d112f77e7-kube-api-access-25kjm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.029948 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.029754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.029948 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.029871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.029948 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.029919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.029948 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.029938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e8cda7-a57d-486c-91e7-0f7d112f77e7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.130856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.130813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.130856 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.130853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e8cda7-a57d-486c-91e7-0f7d112f77e7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.131106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.130876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.131106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.130905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25kjm\" (UniqueName: \"kubernetes.io/projected/86e8cda7-a57d-486c-91e7-0f7d112f77e7-kube-api-access-25kjm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.131106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.130931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.131106 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.131054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.131349 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.131327 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.131400 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.131347 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.131528 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.131507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.133196 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.133140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86e8cda7-a57d-486c-91e7-0f7d112f77e7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.133427 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.133396 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e8cda7-a57d-486c-91e7-0f7d112f77e7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.139015 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.138988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25kjm\" (UniqueName: \"kubernetes.io/projected/86e8cda7-a57d-486c-91e7-0f7d112f77e7-kube-api-access-25kjm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2\" (UID: \"86e8cda7-a57d-486c-91e7-0f7d112f77e7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.195100 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.195060 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:11.332884 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.332846 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2"] Jul 20 19:26:11.336287 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:26:11.336259 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86e8cda7_a57d_486c_91e7_0f7d112f77e7.slice/crio-7839f3f2fd6616d727f20ed1a78cd84ff5173cf1a701f1874aeb116494f60a31 WatchSource:0}: Error finding container 7839f3f2fd6616d727f20ed1a78cd84ff5173cf1a701f1874aeb116494f60a31: Status 404 returned error can't find the container with id 7839f3f2fd6616d727f20ed1a78cd84ff5173cf1a701f1874aeb116494f60a31 Jul 20 19:26:11.775376 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.775338 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" event={"ID":"86e8cda7-a57d-486c-91e7-0f7d112f77e7","Type":"ContainerStarted","Data":"48df96ace3999037ae9a8a1e2006b0e903cf6a27b98e90cfa6516247b2075f4a"} Jul 20 19:26:11.775376 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.775382 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" event={"ID":"86e8cda7-a57d-486c-91e7-0f7d112f77e7","Type":"ContainerStarted","Data":"7839f3f2fd6616d727f20ed1a78cd84ff5173cf1a701f1874aeb116494f60a31"} Jul 20 19:26:11.793605 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:11.793552 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" podStartSLOduration=1.577794106 podStartE2EDuration="1.793533186s" totalImagesPullingTime="215.73908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:11.792611963 +0000 UTC m=+655.605480270" watchObservedRunningTime="2026-07-20 19:26:11.793533186 +0000 UTC m=+655.606401502" Jul 20 19:26:21.195485 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:21.195446 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:21.195968 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:21.195535 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:21.208160 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:21.208130 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:26:21.833968 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:26:21.833935 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2" Jul 20 19:27:07.649946 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.649905 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d6c87ddf8-7628x"] Jul 20 19:27:07.652235 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.652219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:07.655280 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.655246 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 20 19:27:07.655280 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.655245 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-crzwk\"" Jul 20 19:27:07.657618 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.657597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e46f969-6541-4cd2-bf58-0c071b73123f-tls-cert\") pod \"authorino-7d6c87ddf8-7628x\" (UID: \"6e46f969-6541-4cd2-bf58-0c071b73123f\") " pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:07.657741 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.657626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnml2\" (UniqueName: \"kubernetes.io/projected/6e46f969-6541-4cd2-bf58-0c071b73123f-kube-api-access-jnml2\") pod \"authorino-7d6c87ddf8-7628x\" (UID: \"6e46f969-6541-4cd2-bf58-0c071b73123f\") " pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:07.661646 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.661624 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6c87ddf8-7628x"] Jul 20 19:27:07.758182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.758146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e46f969-6541-4cd2-bf58-0c071b73123f-tls-cert\") pod \"authorino-7d6c87ddf8-7628x\" (UID: \"6e46f969-6541-4cd2-bf58-0c071b73123f\") " pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:07.758182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.758184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnml2\" (UniqueName: \"kubernetes.io/projected/6e46f969-6541-4cd2-bf58-0c071b73123f-kube-api-access-jnml2\") pod \"authorino-7d6c87ddf8-7628x\" (UID: \"6e46f969-6541-4cd2-bf58-0c071b73123f\") " pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:07.760888 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.760860 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e46f969-6541-4cd2-bf58-0c071b73123f-tls-cert\") pod \"authorino-7d6c87ddf8-7628x\" (UID: \"6e46f969-6541-4cd2-bf58-0c071b73123f\") " pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:07.766104 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.766073 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnml2\" (UniqueName: \"kubernetes.io/projected/6e46f969-6541-4cd2-bf58-0c071b73123f-kube-api-access-jnml2\") pod \"authorino-7d6c87ddf8-7628x\" (UID: \"6e46f969-6541-4cd2-bf58-0c071b73123f\") " pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:07.962194 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:07.962152 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6c87ddf8-7628x" Jul 20 19:27:08.111831 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:08.111805 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6c87ddf8-7628x"] Jul 20 19:27:08.113977 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:27:08.113942 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e46f969_6541_4cd2_bf58_0c071b73123f.slice/crio-418eeb68c095679aa81e1140ffc500527c65a65176bfcf07ae0deb08d4003f5c WatchSource:0}: Error finding container 418eeb68c095679aa81e1140ffc500527c65a65176bfcf07ae0deb08d4003f5c: Status 404 returned error can't find the container with id 418eeb68c095679aa81e1140ffc500527c65a65176bfcf07ae0deb08d4003f5c Jul 20 19:27:09.050257 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:09.050160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6c87ddf8-7628x" event={"ID":"6e46f969-6541-4cd2-bf58-0c071b73123f","Type":"ContainerStarted","Data":"837ceba9c6ffeed47bdf716955697411157d6bed4688c89fdf218c840ab86e6a"} Jul 20 19:27:09.050257 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:09.050219 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6c87ddf8-7628x" event={"ID":"6e46f969-6541-4cd2-bf58-0c071b73123f","Type":"ContainerStarted","Data":"418eeb68c095679aa81e1140ffc500527c65a65176bfcf07ae0deb08d4003f5c"} Jul 20 19:27:09.078215 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:27:09.078136 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d6c87ddf8-7628x" podStartSLOduration=1.504605272 podStartE2EDuration="2.078113803s" totalImagesPullingTime="573.508531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:09.075212683 +0000 UTC m=+712.888080988" watchObservedRunningTime="2026-07-20 19:27:09.078113803 +0000 UTC m=+712.890982110" Jul 20 19:34:02.076971 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:02.076930 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9"] Jul 20 19:34:02.077975 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:02.077917 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" podUID="b27912c5-c0c1-4742-9070-d65203441364" containerName="manager" containerID="cri-o://d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf" gracePeriod=10 Jul 20 19:34:05.537148 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:05.537120 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:34:05.597346 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:05.597259 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5zfc\" (UniqueName: \"kubernetes.io/projected/b27912c5-c0c1-4742-9070-d65203441364-kube-api-access-f5zfc\") pod \"b27912c5-c0c1-4742-9070-d65203441364\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " Jul 20 19:34:05.597346 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:05.597336 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27912c5-c0c1-4742-9070-d65203441364-extensions-socket-volume\") pod \"b27912c5-c0c1-4742-9070-d65203441364\" (UID: \"b27912c5-c0c1-4742-9070-d65203441364\") " Jul 20 19:34:05.597769 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:05.597745 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27912c5-c0c1-4742-9070-d65203441364-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b27912c5-c0c1-4742-9070-d65203441364" (UID: "b27912c5-c0c1-4742-9070-d65203441364"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:34:05.599496 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:05.599469 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27912c5-c0c1-4742-9070-d65203441364-kube-api-access-f5zfc" (OuterVolumeSpecName: "kube-api-access-f5zfc") pod "b27912c5-c0c1-4742-9070-d65203441364" (UID: "b27912c5-c0c1-4742-9070-d65203441364"). InnerVolumeSpecName "kube-api-access-f5zfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:34:05.698232 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:05.698193 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5zfc\" (UniqueName: \"kubernetes.io/projected/b27912c5-c0c1-4742-9070-d65203441364-kube-api-access-f5zfc\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:34:05.698232 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:05.698226 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27912c5-c0c1-4742-9070-d65203441364-extensions-socket-volume\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:34:06.036887 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.036853 2575 generic.go:356] "Generic (PLEG): container finished" podID="b27912c5-c0c1-4742-9070-d65203441364" containerID="d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf" exitCode=0 Jul 20 19:34:06.037071 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.036894 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" Jul 20 19:34:06.037071 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.036930 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" event={"ID":"b27912c5-c0c1-4742-9070-d65203441364","Type":"ContainerDied","Data":"d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf"} Jul 20 19:34:06.037071 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.036985 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9" event={"ID":"b27912c5-c0c1-4742-9070-d65203441364","Type":"ContainerDied","Data":"ca6dd421df2591b89fa8d8c27b6bf95e7e77e7924626c5485ea1f0baa4a409f4"} Jul 20 19:34:06.037071 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.037008 2575 scope.go:117] "RemoveContainer" containerID="d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf" Jul 20 19:34:06.047093 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.047076 2575 scope.go:117] "RemoveContainer" containerID="d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf" Jul 20 19:34:06.047366 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:34:06.047347 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf\": container with ID starting with d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf not found: ID does not exist" containerID="d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf" Jul 20 19:34:06.047437 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.047377 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf"} err="failed to get container status \"d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf\": rpc error: code = NotFound desc = could not find container \"d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf\": container with ID starting with d7a96e0d407db0ea82aa52ae1b0f31072cffce182b9ca9b24f67a4fd456cf9cf not found: ID does not exist" Jul 20 19:34:06.059905 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.059875 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9"] Jul 20 19:34:06.068121 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.068095 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vhgc9"] Jul 20 19:34:06.751951 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:34:06.751917 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27912c5-c0c1-4742-9070-d65203441364" path="/var/lib/kubelet/pods/b27912c5-c0c1-4742-9070-d65203441364/volumes" Jul 20 19:35:03.288111 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.288070 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl"] Jul 20 19:35:03.288622 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.288469 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27912c5-c0c1-4742-9070-d65203441364" containerName="manager" Jul 20 19:35:03.288622 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.288482 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27912c5-c0c1-4742-9070-d65203441364" containerName="manager" Jul 20 19:35:03.288622 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.288562 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27912c5-c0c1-4742-9070-d65203441364" containerName="manager" Jul 20 19:35:03.291803 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.291781 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.294673 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.294651 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xhgnr\"" Jul 20 19:35:03.309080 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.309044 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl"] Jul 20 19:35:03.424751 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.424705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9897795b-4f71-4192-8a2f-ff426115db4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jxvtl\" (UID: \"9897795b-4f71-4192-8a2f-ff426115db4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.424932 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.424843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b769k\" (UniqueName: \"kubernetes.io/projected/9897795b-4f71-4192-8a2f-ff426115db4b-kube-api-access-b769k\") pod \"kuadrant-operator-controller-manager-86878c769f-jxvtl\" (UID: \"9897795b-4f71-4192-8a2f-ff426115db4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.525511 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.525484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9897795b-4f71-4192-8a2f-ff426115db4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jxvtl\" (UID: \"9897795b-4f71-4192-8a2f-ff426115db4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.525665 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.525555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b769k\" (UniqueName: \"kubernetes.io/projected/9897795b-4f71-4192-8a2f-ff426115db4b-kube-api-access-b769k\") pod \"kuadrant-operator-controller-manager-86878c769f-jxvtl\" (UID: \"9897795b-4f71-4192-8a2f-ff426115db4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.525872 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.525852 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9897795b-4f71-4192-8a2f-ff426115db4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jxvtl\" (UID: \"9897795b-4f71-4192-8a2f-ff426115db4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.534441 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.534401 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b769k\" (UniqueName: \"kubernetes.io/projected/9897795b-4f71-4192-8a2f-ff426115db4b-kube-api-access-b769k\") pod \"kuadrant-operator-controller-manager-86878c769f-jxvtl\" (UID: \"9897795b-4f71-4192-8a2f-ff426115db4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.602695 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.602608 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:03.748067 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:03.747987 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl"] Jul 20 19:35:03.751146 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:35:03.751112 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9897795b_4f71_4192_8a2f_ff426115db4b.slice/crio-ed25d9cf7da137b65b703e4f60b0f8a80f98add7bc572ed39217b3ea6ff2b59d WatchSource:0}: Error finding container ed25d9cf7da137b65b703e4f60b0f8a80f98add7bc572ed39217b3ea6ff2b59d: Status 404 returned error can't find the container with id ed25d9cf7da137b65b703e4f60b0f8a80f98add7bc572ed39217b3ea6ff2b59d Jul 20 19:35:04.307010 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:04.306975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" event={"ID":"9897795b-4f71-4192-8a2f-ff426115db4b","Type":"ContainerStarted","Data":"1e830fc53f0f6bd8c4302c67481059e0a74a2d2c33a5aa4daa7b95349b83e456"} Jul 20 19:35:04.307536 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:04.307025 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" event={"ID":"9897795b-4f71-4192-8a2f-ff426115db4b","Type":"ContainerStarted","Data":"ed25d9cf7da137b65b703e4f60b0f8a80f98add7bc572ed39217b3ea6ff2b59d"} Jul 20 19:35:04.307536 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:04.307113 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:35:04.355289 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:04.355229 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" podStartSLOduration=1.355211938 podStartE2EDuration="1.355211938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:04.353500829 +0000 UTC m=+1188.166369155" watchObservedRunningTime="2026-07-20 19:35:04.355211938 +0000 UTC m=+1188.168080243" Jul 20 19:35:15.314359 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:35:15.314323 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxvtl" Jul 20 19:51:47.487009 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.486973 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6"] Jul 20 19:51:47.490404 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.490386 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.492900 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.492874 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2fb506\"/\"default-dockercfg-2lwjp\"" Jul 20 19:51:47.493029 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.492881 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2fb506\"/\"openshift-service-ca.crt\"" Jul 20 19:51:47.493787 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.493774 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2fb506\"/\"kube-root-ca.crt\"" Jul 20 19:51:47.493829 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.493814 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2fb506\"/\"test-model-2fb506-kserve-self-signed-certs\"" Jul 20 19:51:47.501291 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.501251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6"] Jul 20 19:51:47.598681 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.598642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfm4t\" (UniqueName: \"kubernetes.io/projected/ab7c3549-f363-4906-a85f-2e5ab7e80949-kube-api-access-rfm4t\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.598681 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.598682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-home\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.598911 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.598717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-tmp-dir\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.598911 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.598826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c3549-f363-4906-a85f-2e5ab7e80949-tls-certs\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.598911 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.598891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-dshm\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.599022 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.598982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-model-cache\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.699966 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.699929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-model-cache\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700152 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.699975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm4t\" (UniqueName: \"kubernetes.io/projected/ab7c3549-f363-4906-a85f-2e5ab7e80949-kube-api-access-rfm4t\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700152 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.699996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-home\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700152 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.700023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-tmp-dir\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700152 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.700065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c3549-f363-4906-a85f-2e5ab7e80949-tls-certs\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700152 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.700114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-dshm\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700404 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.700383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-model-cache\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700404 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.700398 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-home\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.700557 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.700517 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-tmp-dir\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.702378 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.702352 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-dshm\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.702663 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.702641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c3549-f363-4906-a85f-2e5ab7e80949-tls-certs\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.707983 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.707961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfm4t\" (UniqueName: \"kubernetes.io/projected/ab7c3549-f363-4906-a85f-2e5ab7e80949-kube-api-access-rfm4t\") pod \"test-model-2fb506-kserve-bc6d96b95-x6rq6\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.801525 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.801439 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:47.935009 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:47.934979 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6"] Jul 20 19:51:47.939442 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:51:47.939402 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab7c3549_f363_4906_a85f_2e5ab7e80949.slice/crio-901ed8aa6a59e867310353bfa125ba107ad2320fdf0d9c7e17a31c428d6cb0a6 WatchSource:0}: Error finding container 901ed8aa6a59e867310353bfa125ba107ad2320fdf0d9c7e17a31c428d6cb0a6: Status 404 returned error can't find the container with id 901ed8aa6a59e867310353bfa125ba107ad2320fdf0d9c7e17a31c428d6cb0a6 Jul 20 19:51:48.048305 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:48.048224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" event={"ID":"ab7c3549-f363-4906-a85f-2e5ab7e80949","Type":"ContainerStarted","Data":"c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4"} Jul 20 19:51:48.048305 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:48.048276 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" event={"ID":"ab7c3549-f363-4906-a85f-2e5ab7e80949","Type":"ContainerStarted","Data":"901ed8aa6a59e867310353bfa125ba107ad2320fdf0d9c7e17a31c428d6cb0a6"} Jul 20 19:51:48.067611 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:48.067511 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" podStartSLOduration=1.067490915 podStartE2EDuration="1.067490915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:51:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:51:48.065288364 +0000 UTC m=+2191.878156670" watchObservedRunningTime="2026-07-20 19:51:48.067490915 +0000 UTC m=+2191.880359220" Jul 20 19:51:57.801761 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:57.801721 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:57.802184 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:57.801781 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:57.819262 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:57.819230 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:51:58.115123 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:51:58.115029 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:52:30.656908 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:30.656839 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6"] Jul 20 19:52:45.686933 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:45.686827 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" podUID="ab7c3549-f363-4906-a85f-2e5ab7e80949" containerName="main" containerID="cri-o://c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4" gracePeriod=45 Jul 20 19:52:45.940321 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:45.940269 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:52:46.040794 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.040761 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-home\") pod \"ab7c3549-f363-4906-a85f-2e5ab7e80949\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " Jul 20 19:52:46.040983 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.040812 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-model-cache\") pod \"ab7c3549-f363-4906-a85f-2e5ab7e80949\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " Jul 20 19:52:46.040983 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.040845 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-dshm\") pod \"ab7c3549-f363-4906-a85f-2e5ab7e80949\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " Jul 20 19:52:46.040983 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.040940 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-tmp-dir\") pod \"ab7c3549-f363-4906-a85f-2e5ab7e80949\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " Jul 20 19:52:46.040983 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.040965 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c3549-f363-4906-a85f-2e5ab7e80949-tls-certs\") pod \"ab7c3549-f363-4906-a85f-2e5ab7e80949\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " Jul 20 19:52:46.041180 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.040997 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfm4t\" (UniqueName: \"kubernetes.io/projected/ab7c3549-f363-4906-a85f-2e5ab7e80949-kube-api-access-rfm4t\") pod \"ab7c3549-f363-4906-a85f-2e5ab7e80949\" (UID: \"ab7c3549-f363-4906-a85f-2e5ab7e80949\") " Jul 20 19:52:46.041180 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.041044 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-home" (OuterVolumeSpecName: "home") pod "ab7c3549-f363-4906-a85f-2e5ab7e80949" (UID: "ab7c3549-f363-4906-a85f-2e5ab7e80949"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:46.041180 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.041124 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab7c3549-f363-4906-a85f-2e5ab7e80949" (UID: "ab7c3549-f363-4906-a85f-2e5ab7e80949"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:46.041307 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.041205 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab7c3549-f363-4906-a85f-2e5ab7e80949" (UID: "ab7c3549-f363-4906-a85f-2e5ab7e80949"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:46.041384 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.041367 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-home\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:52:46.041435 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.041391 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-model-cache\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:52:46.041435 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.041404 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-tmp-dir\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:52:46.043117 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.043095 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-dshm" (OuterVolumeSpecName: "dshm") pod "ab7c3549-f363-4906-a85f-2e5ab7e80949" (UID: "ab7c3549-f363-4906-a85f-2e5ab7e80949"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:46.043117 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.043101 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab7c3549-f363-4906-a85f-2e5ab7e80949-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab7c3549-f363-4906-a85f-2e5ab7e80949" (UID: "ab7c3549-f363-4906-a85f-2e5ab7e80949"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:52:46.043283 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.043161 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab7c3549-f363-4906-a85f-2e5ab7e80949-kube-api-access-rfm4t" (OuterVolumeSpecName: "kube-api-access-rfm4t") pod "ab7c3549-f363-4906-a85f-2e5ab7e80949" (UID: "ab7c3549-f363-4906-a85f-2e5ab7e80949"). InnerVolumeSpecName "kube-api-access-rfm4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:52:46.142853 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.142815 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab7c3549-f363-4906-a85f-2e5ab7e80949-dshm\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:52:46.142853 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.142849 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c3549-f363-4906-a85f-2e5ab7e80949-tls-certs\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:52:46.142853 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.142861 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfm4t\" (UniqueName: \"kubernetes.io/projected/ab7c3549-f363-4906-a85f-2e5ab7e80949-kube-api-access-rfm4t\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:52:46.338454 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.338351 2575 generic.go:356] "Generic (PLEG): container finished" podID="ab7c3549-f363-4906-a85f-2e5ab7e80949" containerID="c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4" exitCode=0 Jul 20 19:52:46.338454 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.338430 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" Jul 20 19:52:46.338454 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.338433 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" event={"ID":"ab7c3549-f363-4906-a85f-2e5ab7e80949","Type":"ContainerDied","Data":"c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4"} Jul 20 19:52:46.338678 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.338472 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6" event={"ID":"ab7c3549-f363-4906-a85f-2e5ab7e80949","Type":"ContainerDied","Data":"901ed8aa6a59e867310353bfa125ba107ad2320fdf0d9c7e17a31c428d6cb0a6"} Jul 20 19:52:46.338678 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.338494 2575 scope.go:117] "RemoveContainer" containerID="c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4" Jul 20 19:52:46.347743 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.347722 2575 scope.go:117] "RemoveContainer" containerID="c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4" Jul 20 19:52:46.347989 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:52:46.347970 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4\": container with ID starting with c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4 not found: ID does not exist" containerID="c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4" Jul 20 19:52:46.348053 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.347997 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4"} err="failed to get container status \"c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4\": rpc error: code = NotFound desc = could not find container \"c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4\": container with ID starting with c8d9a3c657651e47b297a6504bb021a696140c91c6e6ad859834b337dc2850e4 not found: ID does not exist" Jul 20 19:52:46.361386 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.361356 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6"] Jul 20 19:52:46.365764 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.365741 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2fb506/test-model-2fb506-kserve-bc6d96b95-x6rq6"] Jul 20 19:52:46.751134 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:52:46.751104 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab7c3549-f363-4906-a85f-2e5ab7e80949" path="/var/lib/kubelet/pods/ab7c3549-f363-4906-a85f-2e5ab7e80949/volumes" Jul 20 19:57:55.467927 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.467882 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh"] Jul 20 19:57:55.468566 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.468285 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab7c3549-f363-4906-a85f-2e5ab7e80949" containerName="main" Jul 20 19:57:55.468566 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.468300 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab7c3549-f363-4906-a85f-2e5ab7e80949" containerName="main" Jul 20 19:57:55.468566 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.468373 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab7c3549-f363-4906-a85f-2e5ab7e80949" containerName="main" Jul 20 19:57:55.471687 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.471670 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.474240 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.474219 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"openshift-service-ca.crt\"" Jul 20 19:57:55.475319 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.475302 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"default-dockercfg-m7vr6\"" Jul 20 19:57:55.475433 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.475394 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"kube-root-ca.crt\"" Jul 20 19:57:55.475433 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.475405 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"sub-test-model-710890-kserve-self-signed-certs\"" Jul 20 19:57:55.481429 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.481390 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh"] Jul 20 19:57:55.613538 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.613498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-dshm\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.613538 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.613541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-home\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.613808 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.613672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-tmp-dir\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.613808 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.613716 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-model-cache\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.613808 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.613768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e45255-c3da-4a58-b0b4-61c52aba325e-tls-certs\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.613909 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.613832 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmhz\" (UniqueName: \"kubernetes.io/projected/18e45255-c3da-4a58-b0b4-61c52aba325e-kube-api-access-vtmhz\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.714991 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.714939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-dshm\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.714991 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-home\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.715245 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-tmp-dir\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.715245 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-model-cache\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.715245 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715229 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e45255-c3da-4a58-b0b4-61c52aba325e-tls-certs\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.715436 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715294 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmhz\" (UniqueName: \"kubernetes.io/projected/18e45255-c3da-4a58-b0b4-61c52aba325e-kube-api-access-vtmhz\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.715508 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-tmp-dir\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.715565 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715541 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-home\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.715614 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.715577 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-model-cache\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.717347 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.717318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-dshm\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.717747 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.717724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e45255-c3da-4a58-b0b4-61c52aba325e-tls-certs\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.723793 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.723740 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmhz\" (UniqueName: \"kubernetes.io/projected/18e45255-c3da-4a58-b0b4-61c52aba325e-kube-api-access-vtmhz\") pod \"sub-test-model-710890-kserve-5dd5777657-kn9gh\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.782155 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.782120 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:57:55.922525 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:55.922497 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh"] Jul 20 19:57:55.924943 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:57:55.924911 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18e45255_c3da_4a58_b0b4_61c52aba325e.slice/crio-573ddba7f39a814358cd48ccb883d55a68ac74a23e7aa00dce6fa6685d8b5a7d WatchSource:0}: Error finding container 573ddba7f39a814358cd48ccb883d55a68ac74a23e7aa00dce6fa6685d8b5a7d: Status 404 returned error can't find the container with id 573ddba7f39a814358cd48ccb883d55a68ac74a23e7aa00dce6fa6685d8b5a7d Jul 20 19:57:56.825521 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:56.825475 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" event={"ID":"18e45255-c3da-4a58-b0b4-61c52aba325e","Type":"ContainerStarted","Data":"e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1"} Jul 20 19:57:56.825987 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:56.825527 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" event={"ID":"18e45255-c3da-4a58-b0b4-61c52aba325e","Type":"ContainerStarted","Data":"573ddba7f39a814358cd48ccb883d55a68ac74a23e7aa00dce6fa6685d8b5a7d"} Jul 20 19:57:56.844911 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:57:56.844863 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" podStartSLOduration=1.844842876 podStartE2EDuration="1.844842876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:56.844074473 +0000 UTC m=+2560.656942778" watchObservedRunningTime="2026-07-20 19:57:56.844842876 +0000 UTC m=+2560.657711246" Jul 20 19:58:05.782578 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:58:05.782537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:58:05.782578 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:58:05.782581 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:58:05.794726 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:58:05.794697 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:58:05.879520 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:58:05.879492 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:58:59.779760 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:58:59.779706 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh"] Jul 20 19:59:14.799995 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:14.799949 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" podUID="18e45255-c3da-4a58-b0b4-61c52aba325e" containerName="main" containerID="cri-o://e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1" gracePeriod=45 Jul 20 19:59:15.061469 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.061375 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:59:15.159965 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.159924 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-home\") pod \"18e45255-c3da-4a58-b0b4-61c52aba325e\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " Jul 20 19:59:15.160182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.159995 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtmhz\" (UniqueName: \"kubernetes.io/projected/18e45255-c3da-4a58-b0b4-61c52aba325e-kube-api-access-vtmhz\") pod \"18e45255-c3da-4a58-b0b4-61c52aba325e\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " Jul 20 19:59:15.160182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160037 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-dshm\") pod \"18e45255-c3da-4a58-b0b4-61c52aba325e\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " Jul 20 19:59:15.160182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160057 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e45255-c3da-4a58-b0b4-61c52aba325e-tls-certs\") pod \"18e45255-c3da-4a58-b0b4-61c52aba325e\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " Jul 20 19:59:15.160182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160111 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-model-cache\") pod \"18e45255-c3da-4a58-b0b4-61c52aba325e\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " Jul 20 19:59:15.160182 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160160 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-tmp-dir\") pod \"18e45255-c3da-4a58-b0b4-61c52aba325e\" (UID: \"18e45255-c3da-4a58-b0b4-61c52aba325e\") " Jul 20 19:59:15.160475 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160278 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-home" (OuterVolumeSpecName: "home") pod "18e45255-c3da-4a58-b0b4-61c52aba325e" (UID: "18e45255-c3da-4a58-b0b4-61c52aba325e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:15.160475 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160366 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-model-cache" (OuterVolumeSpecName: "model-cache") pod "18e45255-c3da-4a58-b0b4-61c52aba325e" (UID: "18e45255-c3da-4a58-b0b4-61c52aba325e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:15.160588 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160546 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18e45255-c3da-4a58-b0b4-61c52aba325e" (UID: "18e45255-c3da-4a58-b0b4-61c52aba325e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:15.160631 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160599 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-home\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:59:15.160631 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.160619 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-model-cache\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:59:15.162378 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.162354 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e45255-c3da-4a58-b0b4-61c52aba325e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18e45255-c3da-4a58-b0b4-61c52aba325e" (UID: "18e45255-c3da-4a58-b0b4-61c52aba325e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:15.162670 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.162650 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-dshm" (OuterVolumeSpecName: "dshm") pod "18e45255-c3da-4a58-b0b4-61c52aba325e" (UID: "18e45255-c3da-4a58-b0b4-61c52aba325e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:15.162713 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.162651 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e45255-c3da-4a58-b0b4-61c52aba325e-kube-api-access-vtmhz" (OuterVolumeSpecName: "kube-api-access-vtmhz") pod "18e45255-c3da-4a58-b0b4-61c52aba325e" (UID: "18e45255-c3da-4a58-b0b4-61c52aba325e"). InnerVolumeSpecName "kube-api-access-vtmhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:59:15.202431 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.202380 2575 generic.go:356] "Generic (PLEG): container finished" podID="18e45255-c3da-4a58-b0b4-61c52aba325e" containerID="e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1" exitCode=0 Jul 20 19:59:15.202596 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.202441 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" Jul 20 19:59:15.202596 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.202442 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" event={"ID":"18e45255-c3da-4a58-b0b4-61c52aba325e","Type":"ContainerDied","Data":"e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1"} Jul 20 19:59:15.202596 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.202494 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh" event={"ID":"18e45255-c3da-4a58-b0b4-61c52aba325e","Type":"ContainerDied","Data":"573ddba7f39a814358cd48ccb883d55a68ac74a23e7aa00dce6fa6685d8b5a7d"} Jul 20 19:59:15.202596 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.202513 2575 scope.go:117] "RemoveContainer" containerID="e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1" Jul 20 19:59:15.212637 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.212616 2575 scope.go:117] "RemoveContainer" containerID="e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1" Jul 20 19:59:15.212903 ip-10-0-135-129 kubenswrapper[2575]: E0720 19:59:15.212882 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1\": container with ID starting with e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1 not found: ID does not exist" containerID="e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1" Jul 20 19:59:15.212971 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.212914 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1"} err="failed to get container status \"e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1\": rpc error: code = NotFound desc = could not find container \"e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1\": container with ID starting with e5a47610312d46cd061916900dc6186aa369e6e931082a9fc2ba98ac25b191f1 not found: ID does not exist" Jul 20 19:59:15.223951 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.223923 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh"] Jul 20 19:59:15.228181 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.228158 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-710890/sub-test-model-710890-kserve-5dd5777657-kn9gh"] Jul 20 19:59:15.261315 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.261281 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtmhz\" (UniqueName: \"kubernetes.io/projected/18e45255-c3da-4a58-b0b4-61c52aba325e-kube-api-access-vtmhz\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:59:15.261315 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.261309 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-dshm\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:59:15.261315 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.261321 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e45255-c3da-4a58-b0b4-61c52aba325e-tls-certs\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:59:15.261577 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:15.261334 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e45255-c3da-4a58-b0b4-61c52aba325e-tmp-dir\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 19:59:16.751756 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:16.751710 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e45255-c3da-4a58-b0b4-61c52aba325e" path="/var/lib/kubelet/pods/18e45255-c3da-4a58-b0b4-61c52aba325e/volumes" Jul 20 19:59:31.397972 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.397937 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc"] Jul 20 19:59:31.398529 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.398512 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e45255-c3da-4a58-b0b4-61c52aba325e" containerName="main" Jul 20 19:59:31.398617 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.398532 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e45255-c3da-4a58-b0b4-61c52aba325e" containerName="main" Jul 20 19:59:31.398671 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.398650 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e45255-c3da-4a58-b0b4-61c52aba325e" containerName="main" Jul 20 19:59:31.401780 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.401758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.405077 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.405049 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"openshift-service-ca.crt\"" Jul 20 19:59:31.405077 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.405068 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"default-dockercfg-9gg8r\"" Jul 20 19:59:31.405077 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.405051 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"rate-test-model-01f2d8-kserve-self-signed-certs\"" Jul 20 19:59:31.405296 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.405086 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"kube-root-ca.crt\"" Jul 20 19:59:31.410967 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.410939 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc"] Jul 20 19:59:31.512381 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.512344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-model-cache\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.512381 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.512381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d2079c-a755-4454-a82b-e589683d1588-tls-certs\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.512639 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.512470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-dshm\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.512639 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.512590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vhn6\" (UniqueName: \"kubernetes.io/projected/d8d2079c-a755-4454-a82b-e589683d1588-kube-api-access-4vhn6\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.512639 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.512618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-tmp-dir\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.512639 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.512637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-home\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.613815 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.613772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-tmp-dir\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.613815 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.613815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-home\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.614073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.613836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-model-cache\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.614073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.613852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d2079c-a755-4454-a82b-e589683d1588-tls-certs\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.614073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.613878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-dshm\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.614073 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.614008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vhn6\" (UniqueName: \"kubernetes.io/projected/d8d2079c-a755-4454-a82b-e589683d1588-kube-api-access-4vhn6\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.614273 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.614238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-tmp-dir\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.614273 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.614260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-model-cache\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.614372 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.614309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-home\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.616285 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.616264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-dshm\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.616503 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.616485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d2079c-a755-4454-a82b-e589683d1588-tls-certs\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.625745 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.625722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vhn6\" (UniqueName: \"kubernetes.io/projected/d8d2079c-a755-4454-a82b-e589683d1588-kube-api-access-4vhn6\") pod \"rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.713078 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.713046 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:31.846753 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:31.846730 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc"] Jul 20 19:59:31.849771 ip-10-0-135-129 kubenswrapper[2575]: W0720 19:59:31.849742 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8d2079c_a755_4454_a82b_e589683d1588.slice/crio-03a8228cdaca99107fc3ac1c7f4f186b3a44d4ca8bd7ee802f207f24cb41f3f4 WatchSource:0}: Error finding container 03a8228cdaca99107fc3ac1c7f4f186b3a44d4ca8bd7ee802f207f24cb41f3f4: Status 404 returned error can't find the container with id 03a8228cdaca99107fc3ac1c7f4f186b3a44d4ca8bd7ee802f207f24cb41f3f4 Jul 20 19:59:32.288837 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:32.288805 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" event={"ID":"d8d2079c-a755-4454-a82b-e589683d1588","Type":"ContainerStarted","Data":"4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536"} Jul 20 19:59:32.289065 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:32.288846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" event={"ID":"d8d2079c-a755-4454-a82b-e589683d1588","Type":"ContainerStarted","Data":"03a8228cdaca99107fc3ac1c7f4f186b3a44d4ca8bd7ee802f207f24cb41f3f4"} Jul 20 19:59:32.309259 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:32.309205 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" podStartSLOduration=1.309187391 podStartE2EDuration="1.309187391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:32.307853568 +0000 UTC m=+2656.120721875" watchObservedRunningTime="2026-07-20 19:59:32.309187391 +0000 UTC m=+2656.122055696" Jul 20 19:59:41.713470 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:41.713429 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:41.713894 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:41.713486 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:41.728046 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:41.728014 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 19:59:42.347011 ip-10-0-135-129 kubenswrapper[2575]: I0720 19:59:42.346979 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 20:00:26.119181 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:26.119146 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc"] Jul 20 20:00:41.139541 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.139464 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" podUID="d8d2079c-a755-4454-a82b-e589683d1588" containerName="main" containerID="cri-o://4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536" gracePeriod=45 Jul 20 20:00:41.398875 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.398811 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 20:00:41.565349 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565314 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-tmp-dir\") pod \"d8d2079c-a755-4454-a82b-e589683d1588\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " Jul 20 20:00:41.565567 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565366 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vhn6\" (UniqueName: \"kubernetes.io/projected/d8d2079c-a755-4454-a82b-e589683d1588-kube-api-access-4vhn6\") pod \"d8d2079c-a755-4454-a82b-e589683d1588\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " Jul 20 20:00:41.565567 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565450 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d2079c-a755-4454-a82b-e589683d1588-tls-certs\") pod \"d8d2079c-a755-4454-a82b-e589683d1588\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " Jul 20 20:00:41.565567 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565482 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-model-cache\") pod \"d8d2079c-a755-4454-a82b-e589683d1588\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " Jul 20 20:00:41.565567 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565506 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-home\") pod \"d8d2079c-a755-4454-a82b-e589683d1588\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " Jul 20 20:00:41.565771 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565572 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-dshm\") pod \"d8d2079c-a755-4454-a82b-e589683d1588\" (UID: \"d8d2079c-a755-4454-a82b-e589683d1588\") " Jul 20 20:00:41.565771 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565615 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8d2079c-a755-4454-a82b-e589683d1588" (UID: "d8d2079c-a755-4454-a82b-e589683d1588"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:00:41.565860 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565771 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-home" (OuterVolumeSpecName: "home") pod "d8d2079c-a755-4454-a82b-e589683d1588" (UID: "d8d2079c-a755-4454-a82b-e589683d1588"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:00:41.565860 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565788 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8d2079c-a755-4454-a82b-e589683d1588" (UID: "d8d2079c-a755-4454-a82b-e589683d1588"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:00:41.565972 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565915 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-model-cache\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 20:00:41.565972 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565932 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-home\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 20:00:41.565972 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.565941 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-tmp-dir\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 20:00:41.567676 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.567655 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-dshm" (OuterVolumeSpecName: "dshm") pod "d8d2079c-a755-4454-a82b-e589683d1588" (UID: "d8d2079c-a755-4454-a82b-e589683d1588"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:00:41.567763 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.567671 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8d2079c-a755-4454-a82b-e589683d1588-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8d2079c-a755-4454-a82b-e589683d1588" (UID: "d8d2079c-a755-4454-a82b-e589683d1588"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:00:41.567820 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.567795 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d2079c-a755-4454-a82b-e589683d1588-kube-api-access-4vhn6" (OuterVolumeSpecName: "kube-api-access-4vhn6") pod "d8d2079c-a755-4454-a82b-e589683d1588" (UID: "d8d2079c-a755-4454-a82b-e589683d1588"). InnerVolumeSpecName "kube-api-access-4vhn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:00:41.630320 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.630289 2575 generic.go:356] "Generic (PLEG): container finished" podID="d8d2079c-a755-4454-a82b-e589683d1588" containerID="4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536" exitCode=0 Jul 20 20:00:41.630487 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.630332 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" Jul 20 20:00:41.630487 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.630374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" event={"ID":"d8d2079c-a755-4454-a82b-e589683d1588","Type":"ContainerDied","Data":"4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536"} Jul 20 20:00:41.630487 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.630438 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc" event={"ID":"d8d2079c-a755-4454-a82b-e589683d1588","Type":"ContainerDied","Data":"03a8228cdaca99107fc3ac1c7f4f186b3a44d4ca8bd7ee802f207f24cb41f3f4"} Jul 20 20:00:41.630487 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.630462 2575 scope.go:117] "RemoveContainer" containerID="4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536" Jul 20 20:00:41.639339 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.639322 2575 scope.go:117] "RemoveContainer" containerID="4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536" Jul 20 20:00:41.639614 ip-10-0-135-129 kubenswrapper[2575]: E0720 20:00:41.639597 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536\": container with ID starting with 4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536 not found: ID does not exist" containerID="4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536" Jul 20 20:00:41.639672 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.639626 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536"} err="failed to get container status \"4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536\": rpc error: code = NotFound desc = could not find container \"4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536\": container with ID starting with 4de0ada4fc12ff76d361b52dcc92e6d4512f5684ae8d560738784964d8f6e536 not found: ID does not exist" Jul 20 20:00:41.661265 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.661209 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc"] Jul 20 20:00:41.666584 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.666560 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vhn6\" (UniqueName: \"kubernetes.io/projected/d8d2079c-a755-4454-a82b-e589683d1588-kube-api-access-4vhn6\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 20:00:41.666584 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.666586 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d2079c-a755-4454-a82b-e589683d1588-tls-certs\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 20:00:41.666727 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.666599 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8d2079c-a755-4454-a82b-e589683d1588-dshm\") on node \"ip-10-0-135-129.ec2.internal\" DevicePath \"\"" Jul 20 20:00:41.668152 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:41.668134 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/rate-test-model-01f2d8-kserve-5587b54fbc-gqfrc"] Jul 20 20:00:42.751813 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:00:42.751777 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d2079c-a755-4454-a82b-e589683d1588" path="/var/lib/kubelet/pods/d8d2079c-a755-4454-a82b-e589683d1588/volumes" Jul 20 20:01:30.089484 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:30.089441 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6c87ddf8-7628x_6e46f969-6541-4cd2-bf58-0c071b73123f/authorino/0.log" Jul 20 20:01:36.344068 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:36.344032 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-vlvcq_777d3f10-e46a-4ebf-9f1f-bd35dcb10d04/manager/0.log" Jul 20 20:01:36.356776 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:36.356749 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-vlvcq_777d3f10-e46a-4ebf-9f1f-bd35dcb10d04/copy-manifests/0.log" Jul 20 20:01:38.371863 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:38.371786 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6c87ddf8-7628x_6e46f969-6541-4cd2-bf58-0c071b73123f/authorino/0.log" Jul 20 20:01:38.703316 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:38.703291 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mt8cn_3044d031-9753-46d4-afac-73d015d0ac0b/kuadrant-console-plugin/0.log" Jul 20 20:01:38.933021 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:38.932988 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jxvtl_9897795b-4f71-4192-8a2f-ff426115db4b/manager/0.log" Jul 20 20:01:39.737953 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:39.737922 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-cmblq_33badbbb-1dde-47c2-b930-181fba0eefc0/kube-auth-proxy/0.log" Jul 20 20:01:40.194493 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:40.194465 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b22bt_08c7b020-6dd8-46e6-ae34-cb87842482a9/payload-processing/0.log" Jul 20 20:01:40.644515 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:40.644434 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qjdqt_e7b44c0f-574d-46f7-a4df-98b5fbcdeab5/main/0.log" Jul 20 20:01:40.976820 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:40.976777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gkth_0d4101c0-bd80-43f0-b5a2-397c79260039/main/0.log" Jul 20 20:01:41.196390 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:41.196359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-9xsw2_86e8cda7-a57d-486c-91e7-0f7d112f77e7/main/0.log" Jul 20 20:01:51.002405 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:51.002351 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xkvvv_bcc18ed2-4175-46f7-8c7a-8b579144e47a/global-pull-secret-syncer/0.log" Jul 20 20:01:51.222422 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:51.222389 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mqd6q_8a2166e3-12e2-49ac-818e-d8b4963039cc/konnectivity-agent/0.log" Jul 20 20:01:51.283747 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:51.283641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-129.ec2.internal_a8911901eb3c917ae3f606fdd7e95c70/haproxy/0.log" Jul 20 20:01:56.798082 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:56.798042 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6c87ddf8-7628x_6e46f969-6541-4cd2-bf58-0c071b73123f/authorino/0.log" Jul 20 20:01:56.991598 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:56.991569 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mt8cn_3044d031-9753-46d4-afac-73d015d0ac0b/kuadrant-console-plugin/0.log" Jul 20 20:01:57.409527 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:57.409490 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jxvtl_9897795b-4f71-4192-8a2f-ff426115db4b/manager/0.log" Jul 20 20:01:59.129723 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.129644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3bc8efe5-c32f-4e16-bbd8-f1769539adf6/alertmanager/0.log" Jul 20 20:01:59.160533 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.160508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3bc8efe5-c32f-4e16-bbd8-f1769539adf6/config-reloader/0.log" Jul 20 20:01:59.196389 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.196363 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3bc8efe5-c32f-4e16-bbd8-f1769539adf6/kube-rbac-proxy-web/0.log" Jul 20 20:01:59.227791 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.227768 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3bc8efe5-c32f-4e16-bbd8-f1769539adf6/kube-rbac-proxy/0.log" Jul 20 20:01:59.253578 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.253553 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3bc8efe5-c32f-4e16-bbd8-f1769539adf6/kube-rbac-proxy-metric/0.log" Jul 20 20:01:59.296548 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.296525 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3bc8efe5-c32f-4e16-bbd8-f1769539adf6/prom-label-proxy/0.log" Jul 20 20:01:59.364699 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.364670 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3bc8efe5-c32f-4e16-bbd8-f1769539adf6/init-config-reloader/0.log" Jul 20 20:01:59.522708 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.522679 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-qsdx8_388ba5fb-f852-4bd3-93e6-e24759b327ac/kube-state-metrics/0.log" Jul 20 20:01:59.558646 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.558611 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-qsdx8_388ba5fb-f852-4bd3-93e6-e24759b327ac/kube-rbac-proxy-main/0.log" Jul 20 20:01:59.602583 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.602546 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-qsdx8_388ba5fb-f852-4bd3-93e6-e24759b327ac/kube-rbac-proxy-self/0.log" Jul 20 20:01:59.862917 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.862842 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5fcw_efad72ee-773d-484d-b52d-3eadc570bb22/node-exporter/0.log" Jul 20 20:01:59.891569 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.891547 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5fcw_efad72ee-773d-484d-b52d-3eadc570bb22/kube-rbac-proxy/0.log" Jul 20 20:01:59.918872 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:01:59.918845 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5fcw_efad72ee-773d-484d-b52d-3eadc570bb22/init-textfile/0.log" Jul 20 20:02:00.277118 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.277086 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30/prometheus/0.log" Jul 20 20:02:00.318873 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.318844 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30/config-reloader/0.log" Jul 20 20:02:00.359155 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.359128 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30/thanos-sidecar/0.log" Jul 20 20:02:00.390802 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.390772 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30/kube-rbac-proxy-web/0.log" Jul 20 20:02:00.429039 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.428998 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30/kube-rbac-proxy/0.log" Jul 20 20:02:00.478819 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.478788 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30/kube-rbac-proxy-thanos/0.log" Jul 20 20:02:00.524792 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.524765 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ba5ef99-8258-4d0e-abcd-d7bc6b83dd30/init-config-reloader/0.log" Jul 20 20:02:00.571764 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.571664 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-2ln96_76ba9bc4-ad7e-4705-adc8-08bd1b628bff/prometheus-operator/0.log" Jul 20 20:02:00.627186 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.627156 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-2ln96_76ba9bc4-ad7e-4705-adc8-08bd1b628bff/kube-rbac-proxy/0.log" Jul 20 20:02:00.677540 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.677508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-9v5lv_eca1074b-01ac-4240-9c74-76e6e5af5402/prometheus-operator-admission-webhook/0.log" Jul 20 20:02:00.799047 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.799008 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8"] Jul 20 20:02:00.799462 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.799443 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d2079c-a755-4454-a82b-e589683d1588" containerName="main" Jul 20 20:02:00.799462 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.799463 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d2079c-a755-4454-a82b-e589683d1588" containerName="main" Jul 20 20:02:00.799615 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.799594 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d2079c-a755-4454-a82b-e589683d1588" containerName="main" Jul 20 20:02:00.802720 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.802699 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.806242 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.806218 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hzf79\"/\"default-dockercfg-ghgxr\"" Jul 20 20:02:00.806663 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.806640 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzf79\"/\"openshift-service-ca.crt\"" Jul 20 20:02:00.807552 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.807527 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzf79\"/\"kube-root-ca.crt\"" Jul 20 20:02:00.825289 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.825229 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8"] Jul 20 20:02:00.886048 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.886015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx9hs\" (UniqueName: \"kubernetes.io/projected/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-kube-api-access-nx9hs\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.886249 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.886065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-proc\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.886249 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.886085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-podres\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.886249 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.886223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-sys\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.886393 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.886267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-lib-modules\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.982220 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.982187 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdc4d6d8-59sss_4c71dc14-502e-45ab-ae29-ac4bcc030cac/thanos-query/0.log" Jul 20 20:02:00.987341 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987318 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-sys\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987459 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-lib-modules\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987459 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx9hs\" (UniqueName: \"kubernetes.io/projected/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-kube-api-access-nx9hs\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987568 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-sys\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987568 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-proc\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987568 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-podres\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987568 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-lib-modules\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987748 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-proc\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:00.987748 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:00.987666 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-podres\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:01.002735 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.002711 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx9hs\" (UniqueName: \"kubernetes.io/projected/239cfba1-3ba2-4fe8-8fef-ccdc13283a36-kube-api-access-nx9hs\") pod \"perf-node-gather-daemonset-pczs8\" (UID: \"239cfba1-3ba2-4fe8-8fef-ccdc13283a36\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:01.044652 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.044615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdc4d6d8-59sss_4c71dc14-502e-45ab-ae29-ac4bcc030cac/kube-rbac-proxy-web/0.log" Jul 20 20:02:01.104242 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.104170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdc4d6d8-59sss_4c71dc14-502e-45ab-ae29-ac4bcc030cac/kube-rbac-proxy/0.log" Jul 20 20:02:01.112716 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.112692 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:01.162662 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.162628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdc4d6d8-59sss_4c71dc14-502e-45ab-ae29-ac4bcc030cac/prom-label-proxy/0.log" Jul 20 20:02:01.228557 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.228532 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdc4d6d8-59sss_4c71dc14-502e-45ab-ae29-ac4bcc030cac/kube-rbac-proxy-rules/0.log" Jul 20 20:02:01.274382 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.274357 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8"] Jul 20 20:02:01.277379 ip-10-0-135-129 kubenswrapper[2575]: W0720 20:02:01.277335 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod239cfba1_3ba2_4fe8_8fef_ccdc13283a36.slice/crio-0719f4470f47b47226eb5a0a4d0c38335c70df56100d207fefd0b147001fab6a WatchSource:0}: Error finding container 0719f4470f47b47226eb5a0a4d0c38335c70df56100d207fefd0b147001fab6a: Status 404 returned error can't find the container with id 0719f4470f47b47226eb5a0a4d0c38335c70df56100d207fefd0b147001fab6a Jul 20 20:02:01.322815 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:01.322791 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdc4d6d8-59sss_4c71dc14-502e-45ab-ae29-ac4bcc030cac/kube-rbac-proxy-metrics/0.log" Jul 20 20:02:02.000742 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:02.000708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" event={"ID":"239cfba1-3ba2-4fe8-8fef-ccdc13283a36","Type":"ContainerStarted","Data":"683dbf6f2713d31ce56cf5a0174c58f7815c0ba8d032615dc3c2a60df17eeb70"} Jul 20 20:02:02.000928 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:02.000787 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" event={"ID":"239cfba1-3ba2-4fe8-8fef-ccdc13283a36","Type":"ContainerStarted","Data":"0719f4470f47b47226eb5a0a4d0c38335c70df56100d207fefd0b147001fab6a"} Jul 20 20:02:02.000928 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:02.000847 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:02.035152 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:02.035095 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" podStartSLOduration=2.035075538 podStartE2EDuration="2.035075538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:02.033954533 +0000 UTC m=+2805.846822840" watchObservedRunningTime="2026-07-20 20:02:02.035075538 +0000 UTC m=+2805.847943845" Jul 20 20:02:05.792884 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:05.792843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-54xdf_608e3dfb-ec68-4166-b943-26df269dda57/dns/0.log" Jul 20 20:02:05.831290 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:05.831260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-54xdf_608e3dfb-ec68-4166-b943-26df269dda57/kube-rbac-proxy/0.log" Jul 20 20:02:06.020597 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:06.020575 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s9dxv_79b0873e-f76f-475c-a02c-ad9bf9ee70b8/dns-node-resolver/0.log" Jul 20 20:02:06.994387 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:06.994355 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j55gg_d16ce0fc-ce28-49df-9a63-ac85e86b1e93/node-ca/0.log" Jul 20 20:02:08.015251 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:08.015223 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-pczs8" Jul 20 20:02:08.626625 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:08.626599 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-cmblq_33badbbb-1dde-47c2-b930-181fba0eefc0/kube-auth-proxy/0.log" Jul 20 20:02:08.847367 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:08.847338 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b22bt_08c7b020-6dd8-46e6-ae34-cb87842482a9/payload-processing/0.log" Jul 20 20:02:09.772307 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:09.772244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbr7w_e02ac804-8a07-468e-9c17-21d5098b5782/serve-healthcheck-canary/0.log" Jul 20 20:02:10.647385 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:10.647355 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd9dh_df81c97f-3744-4cb0-9db2-d112a7043ade/kube-rbac-proxy/0.log" Jul 20 20:02:10.709317 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:10.709287 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd9dh_df81c97f-3744-4cb0-9db2-d112a7043ade/exporter/0.log" Jul 20 20:02:10.749111 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:10.749080 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd9dh_df81c97f-3744-4cb0-9db2-d112a7043ade/extractor/0.log" Jul 20 20:02:11.701176 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:11.701148 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-cmblq_33badbbb-1dde-47c2-b930-181fba0eefc0/kube-auth-proxy/0.log" Jul 20 20:02:11.855614 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:11.855586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b22bt_08c7b020-6dd8-46e6-ae34-cb87842482a9/payload-processing/0.log" Jul 20 20:02:13.196192 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:13.196164 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-cmblq_33badbbb-1dde-47c2-b930-181fba0eefc0/kube-auth-proxy/0.log" Jul 20 20:02:13.317339 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:13.317312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-b22bt_08c7b020-6dd8-46e6-ae34-cb87842482a9/payload-processing/0.log" Jul 20 20:02:14.445258 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:14.445224 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-vlvcq_777d3f10-e46a-4ebf-9f1f-bd35dcb10d04/manager/0.log" Jul 20 20:02:14.466817 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:14.466789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-vlvcq_777d3f10-e46a-4ebf-9f1f-bd35dcb10d04/copy-manifests/0.log" Jul 20 20:02:15.683440 ip-10-0-135-129 kubenswrapper[2575]: I0720 20:02:15.683386 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-554c775d9-xrk8c_f4f458c3-3288-4bb3-b357-d49b8d428a36/manager/0.log"