Jul 06 20:58:37.410813 ip-10-0-136-218 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:58:37.818785 ip-10-0-136-218 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:58:37.818785 ip-10-0-136-218 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:58:37.818785 ip-10-0-136-218 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:58:37.818785 ip-10-0-136-218 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:58:37.818785 ip-10-0-136-218 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:58:37.820324 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.820225 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:58:37.824658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824640 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:37.824658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824659 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824663 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824667 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824670 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824673 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824676 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824679 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824682 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824684 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824689 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824699 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824702 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824705 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824707 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824710 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824713 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824715 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824718 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824720 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:37.824732 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824723 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824725 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824728 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824730 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824733 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824735 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824738 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824743 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824747 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824750 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824753 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824755 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824758 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824760 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824763 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824766 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824768 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824771 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824773 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:37.825185 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824775 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824778 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824780 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824783 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824786 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824788 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824791 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824793 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824795 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824799 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824801 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824804 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824806 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824809 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824811 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824814 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824817 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824820 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824822 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824825 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:37.825658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824828 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824830 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824832 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824835 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824837 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824840 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824842 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824845 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824849 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824852 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824855 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824857 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824860 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824864 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824866 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824869 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824872 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824874 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824876 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:37.826136 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824879 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824881 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824884 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824887 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824889 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824892 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824895 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824897 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824900 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824903 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824906 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824908 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824911 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824913 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824916 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824919 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824922 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824924 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824927 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824930 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:37.826610 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.824932 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826490 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826498 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826502 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826521 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826524 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826528 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826531 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826534 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826537 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826540 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826543 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826546 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826548 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826551 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826554 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826556 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826559 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826562 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:37.827089 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826564 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826568 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826570 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826573 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826576 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826578 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826582 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826586 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826590 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826593 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826595 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826598 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826600 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826603 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826605 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826607 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826610 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826613 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826616 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826619 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:37.827681 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826622 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826625 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826628 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826630 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826633 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826635 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826638 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826641 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826643 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826646 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826650 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826653 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826655 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826658 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826661 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826664 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826666 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826668 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826671 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826673 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:37.828176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826676 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826678 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826682 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826686 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826689 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826691 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826694 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826697 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826700 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826702 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826706 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826709 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826712 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826715 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826717 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826720 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826723 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826726 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826728 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826731 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:37.828682 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826735 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826737 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826740 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826743 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826746 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826749 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826752 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826754 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826757 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826760 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826763 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826767 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826770 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826773 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826776 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826779 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826782 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826784 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826787 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:37.829176 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826790 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.826793 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827190 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827195 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827198 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827202 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827210 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827213 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827217 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827219 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827222 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827224 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827227 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827230 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827233 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827236 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827239 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827241 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827244 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827247 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:37.829658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827249 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827252 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827254 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827257 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827259 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827262 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827265 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827267 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827270 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827274 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827277 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827281 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827284 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827287 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827290 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827294 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827296 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827299 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827302 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:37.830148 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827309 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827312 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827315 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827318 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827320 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827323 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827327 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827329 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827332 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827335 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827337 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827340 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827342 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827345 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827347 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827350 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827352 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827355 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827357 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827360 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:37.830630 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827362 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827365 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827367 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827370 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827372 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827375 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827377 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827380 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827382 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827385 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827387 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827390 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827393 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827401 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827404 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827406 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827409 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827412 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827415 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827419 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:37.831096 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827422 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827425 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827428 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827430 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827433 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827436 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827440 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827442 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827445 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827448 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827450 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827453 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827455 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827457 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827460 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827462 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827465 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827468 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827470 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827472 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:37.831586 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827475 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.827478 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827572 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827580 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827587 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827591 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827596 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827599 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827603 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827608 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827612 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827614 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827618 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827622 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827624 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827627 2562 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827630 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827633 2562 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827636 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827639 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827643 2562 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827646 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827649 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827652 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:58:37.832114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827655 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827659 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827662 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827665 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827668 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827671 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827674 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827677 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827680 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827683 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827688 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827691 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827694 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827697 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827700 2562 flags.go:64] FLAG: --enable-server="true" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827704 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827709 2562 flags.go:64] FLAG: --event-burst="100" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827712 2562 flags.go:64] FLAG: --event-qps="50" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827715 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827718 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827721 2562 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827726 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827728 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827731 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827734 2562 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:58:37.832709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827737 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827740 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827743 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827746 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827749 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827752 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827755 2562 flags.go:64] FLAG: --feature-gates="" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827759 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827762 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827765 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827768 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827771 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827774 2562 flags.go:64] FLAG: --help="false" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827777 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-136-218.ec2.internal" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827780 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827783 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827786 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827790 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827793 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827796 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827799 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827802 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827805 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:58:37.833347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827809 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827812 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827815 2562 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827818 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827821 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827824 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827827 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827830 2562 flags.go:64] FLAG: --lock-file="" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827832 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827835 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827838 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827844 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827847 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827850 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827852 2562 flags.go:64] FLAG: --logging-format="text" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827855 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827859 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827861 2562 flags.go:64] FLAG: --manifest-url="" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827864 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827869 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827872 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827877 2562 flags.go:64] FLAG: --max-pods="110" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827880 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827883 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827886 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:58:37.833998 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827891 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827894 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827897 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827901 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827908 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827911 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827915 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827918 2562 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827921 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827927 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827930 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827934 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827937 2562 flags.go:64] FLAG: --port="10250" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827940 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827943 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b4062a5275e00e70" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827946 2562 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827949 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827951 2562 flags.go:64] FLAG: --register-node="true" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827954 2562 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827958 2562 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827961 2562 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827964 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827967 2562 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827970 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827974 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:58:37.834636 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827977 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827980 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827983 2562 flags.go:64] FLAG: --runonce="false" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827985 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827988 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827991 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827994 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.827998 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828002 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828006 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828009 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828013 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828015 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828018 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828021 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828024 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828028 2562 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828031 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828036 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828039 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828042 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828049 2562 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828052 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828055 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828058 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:58:37.835250 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828061 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828064 2562 flags.go:64] FLAG: --v="2" Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828068 2562 flags.go:64] FLAG: --version="false" Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828072 2562 flags.go:64] FLAG: --vmodule="" Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828076 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828079 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828216 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828221 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828224 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828227 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828230 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828233 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828236 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828239 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828242 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828246 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828250 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828253 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828256 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828259 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828262 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:37.835873 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828264 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828267 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828269 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828278 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828281 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828283 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828286 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828288 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828291 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828293 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828296 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828298 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828301 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828304 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828306 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828309 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828312 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828314 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828317 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828319 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:37.836381 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828322 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828324 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828327 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828329 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828331 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828334 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828338 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828342 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828346 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828348 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828351 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828353 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828356 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828358 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828361 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828363 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828372 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828375 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828377 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828380 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:37.836911 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828382 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828385 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828387 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828390 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828392 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828395 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828397 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828400 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828403 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828405 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828408 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828410 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828412 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828415 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828417 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828420 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828422 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828424 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828435 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828440 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:37.837407 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828442 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828445 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828449 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828452 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828455 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828458 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828460 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828464 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828468 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828478 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828482 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828486 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828489 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828491 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828494 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828496 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828499 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828501 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:37.837939 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828521 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828525 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828527 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828530 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828533 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.828535 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.828541 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.836029 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.836046 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.836852 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.836860 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836939 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836945 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836948 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:37.838658 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836953 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836957 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836960 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836962 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836965 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836968 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836970 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836973 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836976 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836979 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836982 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836984 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836987 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836990 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836992 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836995 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.836997 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837000 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837003 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837006 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:37.839095 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837009 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837011 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837014 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837016 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837019 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837021 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837025 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837028 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837031 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837033 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837036 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837038 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837041 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837043 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837046 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837048 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837051 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837053 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837055 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837058 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:37.839688 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837060 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837063 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837066 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837069 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837071 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837074 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837076 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837079 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837081 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837084 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837088 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837092 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837095 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837097 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837106 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837110 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837113 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837116 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837120 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:37.840162 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837124 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837127 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837130 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837133 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837135 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837138 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837140 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837143 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837146 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837148 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837151 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837155 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837158 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837161 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837164 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837167 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837170 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837172 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837175 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:37.840645 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837178 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837180 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837183 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837185 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837188 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837190 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837193 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837195 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837198 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837200 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837203 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837205 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837209 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837212 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837215 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837218 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837220 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:37.841094 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837223 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.837228 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837356 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837361 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837364 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837367 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837370 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837373 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837377 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837380 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837383 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837386 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837389 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837392 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:37.841574 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837394 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837397 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837400 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837403 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837405 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837408 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837411 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837413 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837416 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837419 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837422 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837424 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837427 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837431 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837435 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837439 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837442 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837445 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837448 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:37.841922 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837451 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837454 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837456 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837459 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837461 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837464 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837468 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837471 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837474 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837476 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837478 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837481 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837483 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837486 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837488 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837491 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837493 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837495 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837498 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837500 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:37.842367 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837503 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837526 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837529 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837532 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837534 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837537 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837540 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837542 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837545 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837548 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837551 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837554 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837557 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837559 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837562 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837564 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837567 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837569 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837572 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837574 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:37.842871 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837577 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837579 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837582 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837585 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837587 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837590 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837592 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837595 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837597 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837600 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837602 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837605 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837607 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837610 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837613 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837615 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837618 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837620 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837624 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837626 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:37.843350 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837629 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837631 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837634 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837637 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837639 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837642 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837645 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:37.837647 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.837652 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.838230 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.840567 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.841841 2562 server.go:1019] "Starting client certificate rotation" Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.841937 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:58:37.843853 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.841973 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:58:37.844221 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.844206 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:58:37.845485 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.845471 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:58:37.855490 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.855471 2562 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:58:37.858179 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.858153 2562 log.go:25] "Validated CRI v1 image API" Jul 06 20:58:37.859106 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.859089 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:58:37.861131 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.861108 2562 fs.go:135] Filesystem UUIDs: map[6628fbef-8915-4767-9462-44f7aa54c608:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dcd5a6c9-12c2-4a31-836e-6cf4c9ef7ced:/dev/nvme0n1p4] Jul 06 20:58:37.861203 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.861129 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:58:37.866882 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.866767 2562 manager.go:216] Machine: {Timestamp:2026-07-06 20:58:37.865463584 +0000 UTC m=+0.327565879 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102563 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec248ee5bad4292d4cb030feea317d91 SystemUUID:ec248ee5-bad4-292d-4cb0-30feea317d91 BootID:493fd882-2bec-4335-abeb-e39f092cc3ec Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:04:d3:d8:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:04:d3:d8:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:92:a5:e0:3f:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:58:37.866882 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.866877 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:58:37.867025 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.867013 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:58:37.870084 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.870056 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:58:37.870359 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.870091 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:58:37.871024 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.871005 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:58:37.871095 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.871029 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:58:37.871095 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.871041 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:58:37.871546 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.871501 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:58:37.872302 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.872286 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:58:37.874358 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.874344 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:58:37.877783 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.877770 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:58:37.877905 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.877895 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:58:37.877945 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.877928 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:58:37.877945 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.877939 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:58:37.878016 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.877953 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:58:37.878016 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.877963 2562 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:58:37.878016 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.877973 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:58:37.878386 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.878374 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:58:37.878434 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.878394 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:58:37.880350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.880330 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:58:37.882587 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.882565 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:58:37.882662 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.882595 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:58:37.883755 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883744 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883761 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883767 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883772 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883780 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883786 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883793 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883798 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:58:37.883802 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883805 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:58:37.884004 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883811 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:58:37.884004 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883819 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:58:37.884004 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.883824 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:58:37.884954 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.884941 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:58:37.885004 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.884957 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:58:37.887626 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.887589 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-218.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:58:37.887711 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.887667 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:58:37.888235 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.888222 2562 server.go:1268] "Started kubelet" Jul 06 20:58:37.888353 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.888319 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:58:37.888406 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.888334 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:58:37.888454 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.888411 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:58:37.888746 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.888694 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:58:37.889183 ip-10-0-136-218 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:58:37.890352 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.890332 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:58:37.891342 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.891327 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:58:37.895406 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.893853 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:58:37.895406 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.893666 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-218.ec2.internal.18bfcef2624666a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-218.ec2.internal,UID:ip-10-0-136-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-218.ec2.internal,},FirstTimestamp:2026-07-06 20:58:37.888194214 +0000 UTC m=+0.350296509,LastTimestamp:2026-07-06 20:58:37.888194214 +0000 UTC m=+0.350296509,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-218.ec2.internal,}" Jul 06 20:58:37.896129 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.896114 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltbds" Jul 06 20:58:37.897744 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.897723 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:58:37.897744 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.897734 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:58:37.897890 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.897829 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:37.898470 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898451 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:58:37.898470 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898454 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:58:37.898672 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898482 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:58:37.898672 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898572 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:58:37.898672 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898582 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:58:37.898672 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898596 2562 factory.go:55] Registering systemd factory Jul 06 20:58:37.898672 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898614 2562 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:58:37.898932 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898908 2562 factory.go:153] Registering CRI-O factory Jul 06 20:58:37.899018 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.898935 2562 factory.go:223] Registration of the crio container factory successfully Jul 06 20:58:37.899018 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.899011 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:58:37.899085 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.899050 2562 factory.go:103] Registering Raw factory Jul 06 20:58:37.899085 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.899073 2562 manager.go:1196] Started watching for new ooms in manager Jul 06 20:58:37.899551 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.899540 2562 manager.go:349] Starting recovery of all containers Jul 06 20:58:37.900013 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.899991 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:58:37.901086 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.900899 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:58:37.903957 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.903629 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltbds" Jul 06 20:58:37.910975 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.910955 2562 manager.go:354] Recovery completed Jul 06 20:58:37.917304 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.915332 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:37.917304 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.917200 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:37.917304 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.917226 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:37.917304 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.917237 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:37.917884 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.917863 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:58:37.917884 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.917880 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:58:37.917982 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.917900 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:58:37.917982 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.917872 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:37.918716 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.918697 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:37.918798 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.918727 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:37.918798 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.918741 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:37.919163 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.919143 2562 policy_none.go:49] "None policy: Start" Jul 06 20:58:37.919163 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.919163 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:58:37.919270 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.919176 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:58:37.920431 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.920267 2562 policy_none.go:47] "Start" Jul 06 20:58:37.945114 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.945086 2562 manager.go:337] "Starting Device Plugin manager" Jul 06 20:58:37.945216 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.945135 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:58:37.945216 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.945148 2562 server.go:87] "Starting device plugin registration server" Jul 06 20:58:37.945428 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.945414 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:58:37.945490 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.945428 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:58:37.945651 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.945623 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:58:37.945720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.945699 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:58:37.945720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:37.945708 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:58:37.946373 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.946348 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:58:37.946459 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:37.946405 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.045216 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.045168 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:58:38.045556 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.045541 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:38.046620 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.046602 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:38.046730 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.046635 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:38.046730 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.046650 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:38.046730 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.046685 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.046730 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.046719 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:58:38.046924 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.046757 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:58:38.046924 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.046779 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:58:38.046924 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.046819 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:58:38.049767 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.049748 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:38.058329 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.058309 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.058438 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.058340 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-218.ec2.internal\": node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.102051 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.101965 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.147441 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.147379 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal"] Jul 06 20:58:38.147572 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.147523 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:38.148481 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.148461 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:38.148666 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.148491 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:38.148666 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.148501 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:38.149761 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.149748 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:38.149892 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.149877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.149951 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.149918 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:38.150563 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.150546 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:38.150676 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.150565 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:38.150676 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.150574 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:38.150676 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.150584 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:38.150676 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.150586 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:38.150676 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.150597 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:38.151882 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.151867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.151935 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.151901 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:38.152660 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.152643 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:38.152759 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.152668 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:38.152759 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.152681 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:38.180377 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.180348 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-218.ec2.internal\" not found" node="ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.184793 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.184776 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-218.ec2.internal\" not found" node="ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.199936 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.199916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10703423d1063615aaa8e7e3040d605a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal\" (UID: \"10703423d1063615aaa8e7e3040d605a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.200042 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.199941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10703423d1063615aaa8e7e3040d605a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal\" (UID: \"10703423d1063615aaa8e7e3040d605a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.200042 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.199960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31e1f2339baeabe1d7d614e9619cc50e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-218.ec2.internal\" (UID: \"31e1f2339baeabe1d7d614e9619cc50e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.202850 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.202823 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.300725 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.300688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10703423d1063615aaa8e7e3040d605a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal\" (UID: \"10703423d1063615aaa8e7e3040d605a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.300725 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.300721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10703423d1063615aaa8e7e3040d605a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal\" (UID: \"10703423d1063615aaa8e7e3040d605a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.300914 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.300741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31e1f2339baeabe1d7d614e9619cc50e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-218.ec2.internal\" (UID: \"31e1f2339baeabe1d7d614e9619cc50e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.300914 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.300780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31e1f2339baeabe1d7d614e9619cc50e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-218.ec2.internal\" (UID: \"31e1f2339baeabe1d7d614e9619cc50e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.300914 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.300782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10703423d1063615aaa8e7e3040d605a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal\" (UID: \"10703423d1063615aaa8e7e3040d605a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.300914 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.300819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10703423d1063615aaa8e7e3040d605a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal\" (UID: \"10703423d1063615aaa8e7e3040d605a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.303804 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.303785 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.404705 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.404636 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.483867 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.483832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.489023 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.488999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" Jul 06 20:58:38.505305 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.505284 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.605794 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.605757 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.706370 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.706285 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:38.782194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:38.782166 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:38.806652 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:38.806630 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:40.730498 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.730477 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:58:40.730950 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.730621 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:58:40.730950 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.730660 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:58:40.794194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.794151 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:53:39 +0000 UTC" deadline="2028-04-12 19:13:02.071508926 +0000 UTC" Jul 06 20:58:40.794194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.794184 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15502h14m21.277328984s" Jul 06 20:58:40.796307 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:40.796288 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:40.886181 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:40.886141 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10703423d1063615aaa8e7e3040d605a.slice/crio-cbdccd12c960873971ffe6560b031f6331b79e5b0d98f7d65868ac3038711d75 WatchSource:0}: Error finding container cbdccd12c960873971ffe6560b031f6331b79e5b0d98f7d65868ac3038711d75: Status 404 returned error can't find the container with id cbdccd12c960873971ffe6560b031f6331b79e5b0d98f7d65868ac3038711d75 Jul 06 20:58:40.890953 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.890936 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:58:40.894279 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:40.894253 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e1f2339baeabe1d7d614e9619cc50e.slice/crio-ba86b3150b725bbe99a004323f48043440339cb01333cddad91729325a26c85c WatchSource:0}: Error finding container ba86b3150b725bbe99a004323f48043440339cb01333cddad91729325a26c85c: Status 404 returned error can't find the container with id ba86b3150b725bbe99a004323f48043440339cb01333cddad91729325a26c85c Jul 06 20:58:40.896425 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:40.896407 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:40.938915 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.938867 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" event={"ID":"31e1f2339baeabe1d7d614e9619cc50e","Type":"ContainerStarted","Data":"ba86b3150b725bbe99a004323f48043440339cb01333cddad91729325a26c85c"} Jul 06 20:58:40.939951 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:40.939929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" event={"ID":"10703423d1063615aaa8e7e3040d605a","Type":"ContainerStarted","Data":"cbdccd12c960873971ffe6560b031f6331b79e5b0d98f7d65868ac3038711d75"} Jul 06 20:58:40.997494 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:40.997460 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:41.098004 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.097974 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:41.154849 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.154779 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:41.198253 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.198224 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:41.299096 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.299063 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-218.ec2.internal\" not found" Jul 06 20:58:41.337061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.337032 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:41.387475 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.387434 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" Jul 06 20:58:41.398640 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.398615 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:58:41.399515 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.399487 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" Jul 06 20:58:41.411604 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.411541 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:58:41.597641 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.597609 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:41.768841 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.768757 2562 apiserver.go:52] "Watching apiserver" Jul 06 20:58:41.775813 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.775786 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:58:41.776293 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.776267 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-74xlg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695","openshift-cluster-node-tuning-operator/tuned-bh62d","openshift-dns/node-resolver-j7cdl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal","openshift-multus/multus-wbvmk","openshift-network-operator/iptables-alerter-h9htp","openshift-ovn-kubernetes/ovnkube-node-thkht","kube-system/global-pull-secret-syncer-fbbpk","kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal","openshift-image-registry/node-ca-8zkr8","openshift-multus/multus-additional-cni-plugins-6zmdd","openshift-multus/network-metrics-daemon-blvkk","openshift-network-diagnostics/network-check-target-7pw2n"] Jul 06 20:58:41.777866 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.777843 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.778996 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.778971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.780082 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.780042 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.780526 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.780428 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:58:41.781101 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.780827 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c7xhd\"" Jul 06 20:58:41.781101 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.780896 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:41.781101 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.780938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:41.781440 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.781411 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:58:41.781797 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.781668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:58:41.781904 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.781891 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dcz7n\"" Jul 06 20:58:41.782491 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.782415 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svhj9\"" Jul 06 20:58:41.782591 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.782516 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:58:41.782770 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.782748 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:41.782847 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.782801 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:41.783391 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.783298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:41.783391 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.783378 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:41.785522 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.784999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.787353 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.787334 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.788319 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.788297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:58:41.788419 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.788405 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:58:41.788562 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.788539 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q99fj\"" Jul 06 20:58:41.789112 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.789096 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:58:41.789583 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.789562 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.789684 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.789642 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:58:41.791694 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.791305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:58:41.791694 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.791318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f59z7\"" Jul 06 20:58:41.791694 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.791465 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:58:41.791694 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.791525 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:58:41.791969 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.791736 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:58:41.791969 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.791762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:41.791969 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.791843 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:41.792706 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.792649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:58:41.792706 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.792683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:58:41.792852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.792819 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:58:41.793034 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.792992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:41.793394 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.793285 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gwdv\"" Jul 06 20:58:41.793844 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.793822 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:58:41.794079 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.794062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:58:41.794532 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.794511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.795523 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.795469 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:58:41.795791 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.795724 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:58:41.795886 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.795837 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kptx6\"" Jul 06 20:58:41.796233 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.796106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:41.796233 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.796178 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:41.796233 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.796106 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:58:41.797023 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.796846 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:58:41.797023 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.796977 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:58:41.797575 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.797556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j9ztx\"" Jul 06 20:58:41.797782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.797763 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:41.798370 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-registration-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.798440 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kbxj\" (UniqueName: \"kubernetes.io/projected/811a9c4d-383b-482b-8cbd-168e6b31e0af-kube-api-access-4kbxj\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.798440 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-ovnkube-config\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.798440 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-netns\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.798601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-node-log\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.798601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-modprobe-d\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.798601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysconfig\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.798601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e931621-f88e-4421-8163-eb6218ecb15d-cni-binary-copy\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.798601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-cni-bin\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e931621-f88e-4421-8163-eb6218ecb15d-multus-daemon-config\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-cni-bin\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-ovnkube-script-lib\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-os-release\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-hostroot\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-multus-certs\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-socket-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fptqc\" (UniqueName: \"kubernetes.io/projected/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-kube-api-access-fptqc\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:41.798848 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-tmp\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-socket-dir-parent\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-k8s-cni-cncf-io\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8b6b\" (UniqueName: \"kubernetes.io/projected/2e931621-f88e-4421-8163-eb6218ecb15d-kube-api-access-w8b6b\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-sys-fs\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.798992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-slash\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-iptables-alerter-script\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-cnibin\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076f53e4-f359-407c-acfa-039d2af4e92a-tmp-dir\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhwbk\" (UniqueName: \"kubernetes.io/projected/f08b5917-a149-443b-9107-7304b4917d0e-kube-api-access-hhwbk\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-etc-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysctl-d\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-kubelet\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08b5917-a149-443b-9107-7304b4917d0e-ovn-node-metrics-cert\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-host\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-cni-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.799350 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-conf-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/076f53e4-f359-407c-acfa-039d2af4e92a-hosts-file\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-ovn\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-log-socket\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-kubelet\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-systemd\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-env-overrides\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-kubernetes\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-sys\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngpr6\" (UniqueName: \"kubernetes.io/projected/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-kube-api-access-ngpr6\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-etc-kubernetes\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qc5\" (UniqueName: \"kubernetes.io/projected/076f53e4-f359-407c-acfa-039d2af4e92a-kube-api-access-92qc5\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800134 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-var-lib-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-systemd\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-run\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-tuned\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-system-cni-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-cni-multus\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.799958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-device-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-etc-selinux\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800028 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2ctjn\"" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-lib-modules\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-systemd-units\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-run-netns\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-cni-netd\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-host-slash\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysctl-conf\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-var-lib-kubelet\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800353 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:58:41.800917 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.800786 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:58:41.803845 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.803828 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:58:41.823394 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.823378 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-chjbg" Jul 06 20:58:41.831609 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.831182 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-chjbg" Jul 06 20:58:41.888097 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.888042 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:58:41.900551 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-host-slash\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.900697 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559a6012-02f4-4e54-b987-9e4a9fe14802-host\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:41.900697 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900608 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysctl-conf\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.900697 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-host-slash\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-var-lib-kubelet\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-registration-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kbxj\" (UniqueName: \"kubernetes.io/projected/811a9c4d-383b-482b-8cbd-168e6b31e0af-kube-api-access-4kbxj\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900755 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysctl-conf\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-ovnkube-config\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-var-lib-kubelet\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900800 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-registration-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.900852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkfrn\" (UniqueName: \"kubernetes.io/projected/922e2842-91f2-423e-9b86-ea0939c3f564-kube-api-access-jkfrn\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-netns\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-node-log\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-system-cni-dir\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.900976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-netns\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frlds\" (UniqueName: \"kubernetes.io/projected/1c4bb39b-62ca-4410-a3c7-77f64860720b-kube-api-access-frlds\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-modprobe-d\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901028 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-node-log\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysconfig\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.901188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e931621-f88e-4421-8163-eb6218ecb15d-cni-binary-copy\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-modprobe-d\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysconfig\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-cni-bin\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901350 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-ovnkube-config\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e931621-f88e-4421-8163-eb6218ecb15d-multus-daemon-config\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901406 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-cni-bin\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-cni-bin\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-ovnkube-script-lib\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-os-release\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-os-release\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-hostroot\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-multus-certs\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-socket-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fptqc\" (UniqueName: \"kubernetes.io/projected/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-kube-api-access-fptqc\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:41.901720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-tmp\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-socket-dir-parent\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-k8s-cni-cncf-io\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8b6b\" (UniqueName: \"kubernetes.io/projected/2e931621-f88e-4421-8163-eb6218ecb15d-kube-api-access-w8b6b\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e931621-f88e-4421-8163-eb6218ecb15d-cni-binary-copy\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-k8s-cni-cncf-io\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-cni-bin\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-run-multus-certs\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-hostroot\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-socket-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-os-release\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.901992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-socket-dir-parent\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-sys-fs\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902076 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-slash\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902079 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-iptables-alerter-script\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-cnibin\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-slash\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.902525 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-sys-fs\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076f53e4-f359-407c-acfa-039d2af4e92a-tmp-dir\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902202 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-cnibin\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhwbk\" (UniqueName: \"kubernetes.io/projected/f08b5917-a149-443b-9107-7304b4917d0e-kube-api-access-hhwbk\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-etc-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysctl-d\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-kubelet\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08b5917-a149-443b-9107-7304b4917d0e-ovn-node-metrics-cert\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e099064e-bb9d-455b-86f1-1537d5d74c23-konnectivity-ca\") pod \"konnectivity-agent-74xlg\" (UID: \"e099064e-bb9d-455b-86f1-1537d5d74c23\") " pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5aafc7fe-860b-4994-88e8-e28801d82bbc-dbus\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-host\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-ovnkube-script-lib\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-kubelet\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-cni-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902521 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-etc-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.903206 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076f53e4-f359-407c-acfa-039d2af4e92a-tmp-dir\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e931621-f88e-4421-8163-eb6218ecb15d-multus-daemon-config\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902580 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-host\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5aafc7fe-860b-4994-88e8-e28801d82bbc-kubelet-config\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-sysctl-d\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/559a6012-02f4-4e54-b987-9e4a9fe14802-serviceca\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-conf-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/076f53e4-f359-407c-acfa-039d2af4e92a-hosts-file\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-cni-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-ovn\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-multus-conf-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-log-socket\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-iptables-alerter-script\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/076f53e4-f359-407c-acfa-039d2af4e92a-hosts-file\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-ovn\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-log-socket\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904019 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-kubelet\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-systemd\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-kubelet\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-env-overrides\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-systemd\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.902978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-kubernetes\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-sys\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngpr6\" (UniqueName: \"kubernetes.io/projected/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-kube-api-access-ngpr6\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-kubernetes\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903090 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-sys\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-etc-kubernetes\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903187 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-etc-kubernetes\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.904938 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92qc5\" (UniqueName: \"kubernetes.io/projected/076f53e4-f359-407c-acfa-039d2af4e92a-kube-api-access-92qc5\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-var-lib-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-systemd\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08b5917-a149-443b-9107-7304b4917d0e-env-overrides\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-var-lib-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-run\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903379 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-run\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-run-openvswitch\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-systemd\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-tuned\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-system-cni-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-cni-multus\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-device-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-etc-selinux\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-system-cni-dir\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-device-dir\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-lib-modules\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.905782 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/811a9c4d-383b-482b-8cbd-168e6b31e0af-etc-selinux\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-lib-modules\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903665 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e931621-f88e-4421-8163-eb6218ecb15d-host-var-lib-cni-multus\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903685 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-systemd-units\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-run-netns\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-systemd-units\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-cni-netd\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-run-netns\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08b5917-a149-443b-9107-7304b4917d0e-host-cni-netd\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-cnibin\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e099064e-bb9d-455b-86f1-1537d5d74c23-agent-certs\") pod \"konnectivity-agent-74xlg\" (UID: \"e099064e-bb9d-455b-86f1-1537d5d74c23\") " pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.903846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8957m\" (UniqueName: \"kubernetes.io/projected/559a6012-02f4-4e54-b987-9e4a9fe14802-kube-api-access-8957m\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.905862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-tmp\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.905953 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08b5917-a149-443b-9107-7304b4917d0e-ovn-node-metrics-cert\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.906977 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.906251 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-etc-tuned\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.911617 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.911596 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:41.911617 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.911620 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:41.911815 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.911634 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mlqbn for pod openshift-network-diagnostics/network-check-target-7pw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:41.911815 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:41.911704 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn podName:1e754309-f51a-40f7-b0c7-e58bcca7a820 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:42.411682823 +0000 UTC m=+2.985082087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mlqbn" (UniqueName: "kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn") pod "network-check-target-7pw2n" (UID: "1e754309-f51a-40f7-b0c7-e58bcca7a820") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:41.914033 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.913969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kbxj\" (UniqueName: \"kubernetes.io/projected/811a9c4d-383b-482b-8cbd-168e6b31e0af-kube-api-access-4kbxj\") pod \"aws-ebs-csi-driver-node-7t695\" (UID: \"811a9c4d-383b-482b-8cbd-168e6b31e0af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:41.914033 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.913998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngpr6\" (UniqueName: \"kubernetes.io/projected/8e97d9aa-79fa-4b32-81d9-f3b30fbeb752-kube-api-access-ngpr6\") pod \"tuned-bh62d\" (UID: \"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752\") " pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:41.914626 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.914592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fptqc\" (UniqueName: \"kubernetes.io/projected/9d51a5a1-dbae-4816-816b-30cc83ff1cc2-kube-api-access-fptqc\") pod \"iptables-alerter-h9htp\" (UID: \"9d51a5a1-dbae-4816-816b-30cc83ff1cc2\") " pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:41.915494 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.915477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8b6b\" (UniqueName: \"kubernetes.io/projected/2e931621-f88e-4421-8163-eb6218ecb15d-kube-api-access-w8b6b\") pod \"multus-wbvmk\" (UID: \"2e931621-f88e-4421-8163-eb6218ecb15d\") " pod="openshift-multus/multus-wbvmk" Jul 06 20:58:41.915731 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.915707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhwbk\" (UniqueName: \"kubernetes.io/projected/f08b5917-a149-443b-9107-7304b4917d0e-kube-api-access-hhwbk\") pod \"ovnkube-node-thkht\" (UID: \"f08b5917-a149-443b-9107-7304b4917d0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:41.915961 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:41.915938 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qc5\" (UniqueName: \"kubernetes.io/projected/076f53e4-f359-407c-acfa-039d2af4e92a-kube-api-access-92qc5\") pod \"node-resolver-j7cdl\" (UID: \"076f53e4-f359-407c-acfa-039d2af4e92a\") " pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:42.004346 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004517 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e099064e-bb9d-455b-86f1-1537d5d74c23-konnectivity-ca\") pod \"konnectivity-agent-74xlg\" (UID: \"e099064e-bb9d-455b-86f1-1537d5d74c23\") " pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:42.004517 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5aafc7fe-860b-4994-88e8-e28801d82bbc-dbus\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:42.004517 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004517 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5aafc7fe-860b-4994-88e8-e28801d82bbc-kubelet-config\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:42.004517 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/559a6012-02f4-4e54-b987-9e4a9fe14802-serviceca\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:42.004517 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-cnibin\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5aafc7fe-860b-4994-88e8-e28801d82bbc-dbus\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e099064e-bb9d-455b-86f1-1537d5d74c23-agent-certs\") pod \"konnectivity-agent-74xlg\" (UID: \"e099064e-bb9d-455b-86f1-1537d5d74c23\") " pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8957m\" (UniqueName: \"kubernetes.io/projected/559a6012-02f4-4e54-b987-9e4a9fe14802-kube-api-access-8957m\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559a6012-02f4-4e54-b987-9e4a9fe14802-host\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkfrn\" (UniqueName: \"kubernetes.io/projected/922e2842-91f2-423e-9b86-ea0939c3f564-kube-api-access-jkfrn\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-system-cni-dir\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlds\" (UniqueName: \"kubernetes.io/projected/1c4bb39b-62ca-4410-a3c7-77f64860720b-kube-api-access-frlds\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-os-release\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.004899 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.004887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005004 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e099064e-bb9d-455b-86f1-1537d5d74c23-konnectivity-ca\") pod \"konnectivity-agent-74xlg\" (UID: \"e099064e-bb9d-455b-86f1-1537d5d74c23\") " pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.005017 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/559a6012-02f4-4e54-b987-9e4a9fe14802-serviceca\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.005093 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret podName:5aafc7fe-860b-4994-88e8-e28801d82bbc nodeName:}" failed. No retries permitted until 2026-07-06 20:58:42.505075167 +0000 UTC m=+3.078474450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret") pod "global-pull-secret-syncer-fbbpk" (UID: "5aafc7fe-860b-4994-88e8-e28801d82bbc") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5aafc7fe-860b-4994-88e8-e28801d82bbc-kubelet-config\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-os-release\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-system-cni-dir\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559a6012-02f4-4e54-b987-9e4a9fe14802-host\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.005310 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/922e2842-91f2-423e-9b86-ea0939c3f564-cnibin\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.005506 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.005345 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs podName:1c4bb39b-62ca-4410-a3c7-77f64860720b nodeName:}" failed. No retries permitted until 2026-07-06 20:58:42.50533512 +0000 UTC m=+3.078734382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs") pod "network-metrics-daemon-blvkk" (UID: "1c4bb39b-62ca-4410-a3c7-77f64860720b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:42.006036 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.006036 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.005758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/922e2842-91f2-423e-9b86-ea0939c3f564-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.007143 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.007123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e099064e-bb9d-455b-86f1-1537d5d74c23-agent-certs\") pod \"konnectivity-agent-74xlg\" (UID: \"e099064e-bb9d-455b-86f1-1537d5d74c23\") " pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:42.015683 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.015653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8957m\" (UniqueName: \"kubernetes.io/projected/559a6012-02f4-4e54-b987-9e4a9fe14802-kube-api-access-8957m\") pod \"node-ca-8zkr8\" (UID: \"559a6012-02f4-4e54-b987-9e4a9fe14802\") " pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:42.016288 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.016264 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkfrn\" (UniqueName: \"kubernetes.io/projected/922e2842-91f2-423e-9b86-ea0939c3f564-kube-api-access-jkfrn\") pod \"multus-additional-cni-plugins-6zmdd\" (UID: \"922e2842-91f2-423e-9b86-ea0939c3f564\") " pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.016396 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.016318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlds\" (UniqueName: \"kubernetes.io/projected/1c4bb39b-62ca-4410-a3c7-77f64860720b-kube-api-access-frlds\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:42.093599 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.093514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9htp" Jul 06 20:58:42.102635 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.102610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" Jul 06 20:58:42.113231 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.113193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" Jul 06 20:58:42.118433 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.118404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bh62d" Jul 06 20:58:42.126526 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.126506 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7cdl" Jul 06 20:58:42.134800 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.134778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbvmk" Jul 06 20:58:42.142714 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.142689 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:58:42.149668 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.149651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8zkr8" Jul 06 20:58:42.154286 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.154267 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:58:42.508261 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.508161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:42.508261 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.508251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.508289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508314 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508391 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508415 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508397 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs podName:1c4bb39b-62ca-4410-a3c7-77f64860720b nodeName:}" failed. No retries permitted until 2026-07-06 20:58:43.508376084 +0000 UTC m=+4.081775357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs") pod "network-metrics-daemon-blvkk" (UID: "1c4bb39b-62ca-4410-a3c7-77f64860720b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508433 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508447 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mlqbn for pod openshift-network-diagnostics/network-check-target-7pw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:42.508483 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508450 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret podName:5aafc7fe-860b-4994-88e8-e28801d82bbc nodeName:}" failed. No retries permitted until 2026-07-06 20:58:43.508436918 +0000 UTC m=+4.081836179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret") pod "global-pull-secret-syncer-fbbpk" (UID: "5aafc7fe-860b-4994-88e8-e28801d82bbc") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:42.508829 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:42.508499 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn podName:1e754309-f51a-40f7-b0c7-e58bcca7a820 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:43.508483494 +0000 UTC m=+4.081882757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlqbn" (UniqueName: "kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn") pod "network-check-target-7pw2n" (UID: "1e754309-f51a-40f7-b0c7-e58bcca7a820") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:42.722575 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.722544 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e97d9aa_79fa_4b32_81d9_f3b30fbeb752.slice/crio-059363b9038579c531262487cd6c09b7f4462cea5da95b95c37458b8ee92117c WatchSource:0}: Error finding container 059363b9038579c531262487cd6c09b7f4462cea5da95b95c37458b8ee92117c: Status 404 returned error can't find the container with id 059363b9038579c531262487cd6c09b7f4462cea5da95b95c37458b8ee92117c Jul 06 20:58:42.724500 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.724477 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08b5917_a149_443b_9107_7304b4917d0e.slice/crio-e20f50e6b34637d9b0263f0f730a6e132a6f8d18244acc363e5aa7bc9c47ff7e WatchSource:0}: Error finding container e20f50e6b34637d9b0263f0f730a6e132a6f8d18244acc363e5aa7bc9c47ff7e: Status 404 returned error can't find the container with id e20f50e6b34637d9b0263f0f730a6e132a6f8d18244acc363e5aa7bc9c47ff7e Jul 06 20:58:42.725641 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.725614 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode099064e_bb9d_455b_86f1_1537d5d74c23.slice/crio-8ec90013c3d4c96f1083c95514a108602c388d0a6e2d7202edea8e2068432ed3 WatchSource:0}: Error finding container 8ec90013c3d4c96f1083c95514a108602c388d0a6e2d7202edea8e2068432ed3: Status 404 returned error can't find the container with id 8ec90013c3d4c96f1083c95514a108602c388d0a6e2d7202edea8e2068432ed3 Jul 06 20:58:42.728303 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.728273 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922e2842_91f2_423e_9b86_ea0939c3f564.slice/crio-86e73446d31219bad0660dbf608a800fd4e557ad3e632c3e51116eec5d21a93d WatchSource:0}: Error finding container 86e73446d31219bad0660dbf608a800fd4e557ad3e632c3e51116eec5d21a93d: Status 404 returned error can't find the container with id 86e73446d31219bad0660dbf608a800fd4e557ad3e632c3e51116eec5d21a93d Jul 06 20:58:42.729060 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.729022 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076f53e4_f359_407c_acfa_039d2af4e92a.slice/crio-93ad6a565dab42cf4b12bce6b86e927c8ddf91860b8e93f467cc807cb630c2d4 WatchSource:0}: Error finding container 93ad6a565dab42cf4b12bce6b86e927c8ddf91860b8e93f467cc807cb630c2d4: Status 404 returned error can't find the container with id 93ad6a565dab42cf4b12bce6b86e927c8ddf91860b8e93f467cc807cb630c2d4 Jul 06 20:58:42.729844 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.729818 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d51a5a1_dbae_4816_816b_30cc83ff1cc2.slice/crio-506d7c56e40721f48ba87943c39e20763c2a6ffe972b058f7e41724d2e57972c WatchSource:0}: Error finding container 506d7c56e40721f48ba87943c39e20763c2a6ffe972b058f7e41724d2e57972c: Status 404 returned error can't find the container with id 506d7c56e40721f48ba87943c39e20763c2a6ffe972b058f7e41724d2e57972c Jul 06 20:58:42.730706 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.730611 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559a6012_02f4_4e54_b987_9e4a9fe14802.slice/crio-89f4d522f528dbd2e1beeddfc3766abe441422e0b7fb4f1ec53f7b5e92c09524 WatchSource:0}: Error finding container 89f4d522f528dbd2e1beeddfc3766abe441422e0b7fb4f1ec53f7b5e92c09524: Status 404 returned error can't find the container with id 89f4d522f528dbd2e1beeddfc3766abe441422e0b7fb4f1ec53f7b5e92c09524 Jul 06 20:58:42.731590 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.731368 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811a9c4d_383b_482b_8cbd_168e6b31e0af.slice/crio-9c2062a11403e7788cfec3899d91ec8e26de13b52ce268a2a0852efdbe2b9961 WatchSource:0}: Error finding container 9c2062a11403e7788cfec3899d91ec8e26de13b52ce268a2a0852efdbe2b9961: Status 404 returned error can't find the container with id 9c2062a11403e7788cfec3899d91ec8e26de13b52ce268a2a0852efdbe2b9961 Jul 06 20:58:42.734371 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:58:42.734275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e931621_f88e_4421_8163_eb6218ecb15d.slice/crio-b029a7f967444570341e9455d839a547e8a652832e65bcf07f81a0e57d2a4f4f WatchSource:0}: Error finding container b029a7f967444570341e9455d839a547e8a652832e65bcf07f81a0e57d2a4f4f: Status 404 returned error can't find the container with id b029a7f967444570341e9455d839a547e8a652832e65bcf07f81a0e57d2a4f4f Jul 06 20:58:42.833624 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.833414 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:53:41 +0000 UTC" deadline="2028-03-23 01:43:27.67805617 +0000 UTC" Jul 06 20:58:42.833624 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.833619 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15004h44m44.844443322s" Jul 06 20:58:42.943721 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.943688 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8zkr8" event={"ID":"559a6012-02f4-4e54-b987-9e4a9fe14802","Type":"ContainerStarted","Data":"89f4d522f528dbd2e1beeddfc3766abe441422e0b7fb4f1ec53f7b5e92c09524"} Jul 06 20:58:42.944984 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.944954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"e20f50e6b34637d9b0263f0f730a6e132a6f8d18244acc363e5aa7bc9c47ff7e"} Jul 06 20:58:42.946088 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.946060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bh62d" event={"ID":"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752","Type":"ContainerStarted","Data":"059363b9038579c531262487cd6c09b7f4462cea5da95b95c37458b8ee92117c"} Jul 06 20:58:42.948485 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.948460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" event={"ID":"31e1f2339baeabe1d7d614e9619cc50e","Type":"ContainerStarted","Data":"5b1020d2638d03423d21ec3495a6682395d275e14cae106e21a224e01f564426"} Jul 06 20:58:42.949640 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.949621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbvmk" event={"ID":"2e931621-f88e-4421-8163-eb6218ecb15d","Type":"ContainerStarted","Data":"b029a7f967444570341e9455d839a547e8a652832e65bcf07f81a0e57d2a4f4f"} Jul 06 20:58:42.950623 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.950595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" event={"ID":"811a9c4d-383b-482b-8cbd-168e6b31e0af","Type":"ContainerStarted","Data":"9c2062a11403e7788cfec3899d91ec8e26de13b52ce268a2a0852efdbe2b9961"} Jul 06 20:58:42.951785 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.951761 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9htp" event={"ID":"9d51a5a1-dbae-4816-816b-30cc83ff1cc2","Type":"ContainerStarted","Data":"506d7c56e40721f48ba87943c39e20763c2a6ffe972b058f7e41724d2e57972c"} Jul 06 20:58:42.952721 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.952698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7cdl" event={"ID":"076f53e4-f359-407c-acfa-039d2af4e92a","Type":"ContainerStarted","Data":"93ad6a565dab42cf4b12bce6b86e927c8ddf91860b8e93f467cc807cb630c2d4"} Jul 06 20:58:42.953760 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.953741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerStarted","Data":"86e73446d31219bad0660dbf608a800fd4e557ad3e632c3e51116eec5d21a93d"} Jul 06 20:58:42.955390 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.955371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-74xlg" event={"ID":"e099064e-bb9d-455b-86f1-1537d5d74c23","Type":"ContainerStarted","Data":"8ec90013c3d4c96f1083c95514a108602c388d0a6e2d7202edea8e2068432ed3"} Jul 06 20:58:42.968329 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:42.968280 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-218.ec2.internal" podStartSLOduration=1.96826528 podStartE2EDuration="1.96826528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:42.967998701 +0000 UTC m=+3.541397986" watchObservedRunningTime="2026-07-06 20:58:42.96826528 +0000 UTC m=+3.541664563" Jul 06 20:58:43.056362 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.056275 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:43.519498 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.519413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:43.519652 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.519497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:43.519652 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.519527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:43.519773 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.519668 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:43.519773 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.519685 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:43.519773 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.519697 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mlqbn for pod openshift-network-diagnostics/network-check-target-7pw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:43.519773 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.519754 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn podName:1e754309-f51a-40f7-b0c7-e58bcca7a820 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:45.519735612 +0000 UTC m=+6.093134889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlqbn" (UniqueName: "kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn") pod "network-check-target-7pw2n" (UID: "1e754309-f51a-40f7-b0c7-e58bcca7a820") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:43.520345 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.520139 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:43.520345 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.520189 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs podName:1c4bb39b-62ca-4410-a3c7-77f64860720b nodeName:}" failed. No retries permitted until 2026-07-06 20:58:45.520175243 +0000 UTC m=+6.093574505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs") pod "network-metrics-daemon-blvkk" (UID: "1c4bb39b-62ca-4410-a3c7-77f64860720b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:43.520345 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.520263 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:43.520345 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.520296 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret podName:5aafc7fe-860b-4994-88e8-e28801d82bbc nodeName:}" failed. No retries permitted until 2026-07-06 20:58:45.520285497 +0000 UTC m=+6.093684762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret") pod "global-pull-secret-syncer-fbbpk" (UID: "5aafc7fe-860b-4994-88e8-e28801d82bbc") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:43.834006 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.833889 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:53:41 +0000 UTC" deadline="2028-01-27 17:17:20.285375982 +0000 UTC" Jul 06 20:58:43.834006 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.833959 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13676h18m36.451421823s" Jul 06 20:58:43.938062 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.937330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:43.938062 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.937452 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:43.938062 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.937888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:43.938062 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.938008 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:43.938653 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.938488 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:43.938653 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:43.938593 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:43.977637 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.976461 2562 generic.go:356] "Generic (PLEG): container finished" podID="10703423d1063615aaa8e7e3040d605a" containerID="35517016c9e4bde33ea4b865222f17ce6e6b0428bb1c9fee1320c6b32d142318" exitCode=0 Jul 06 20:58:43.977637 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:43.977388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" event={"ID":"10703423d1063615aaa8e7e3040d605a","Type":"ContainerDied","Data":"35517016c9e4bde33ea4b865222f17ce6e6b0428bb1c9fee1320c6b32d142318"} Jul 06 20:58:45.000900 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.000861 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" event={"ID":"10703423d1063615aaa8e7e3040d605a","Type":"ContainerStarted","Data":"c919756cce33bc04c33a1eda201373c28c73711e1ed9f5fc92ad31cfab769690"} Jul 06 20:58:45.018969 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.018907 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-218.ec2.internal" podStartSLOduration=4.01886527 podStartE2EDuration="4.01886527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:45.018024197 +0000 UTC m=+5.591423484" watchObservedRunningTime="2026-07-06 20:58:45.01886527 +0000 UTC m=+5.592264556" Jul 06 20:58:45.539065 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.539026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:45.539295 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.539099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:45.539295 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.539132 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:45.539430 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539304 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:45.539430 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539323 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:45.539430 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539335 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mlqbn for pod openshift-network-diagnostics/network-check-target-7pw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:45.539430 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539391 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn podName:1e754309-f51a-40f7-b0c7-e58bcca7a820 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:49.539373921 +0000 UTC m=+10.112773186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlqbn" (UniqueName: "kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn") pod "network-check-target-7pw2n" (UID: "1e754309-f51a-40f7-b0c7-e58bcca7a820") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:45.539804 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539782 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:45.539914 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539837 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs podName:1c4bb39b-62ca-4410-a3c7-77f64860720b nodeName:}" failed. No retries permitted until 2026-07-06 20:58:49.539822652 +0000 UTC m=+10.113221920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs") pod "network-metrics-daemon-blvkk" (UID: "1c4bb39b-62ca-4410-a3c7-77f64860720b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:45.539914 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539896 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:45.540034 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.539925 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret podName:5aafc7fe-860b-4994-88e8-e28801d82bbc nodeName:}" failed. No retries permitted until 2026-07-06 20:58:49.539915239 +0000 UTC m=+10.113314505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret") pod "global-pull-secret-syncer-fbbpk" (UID: "5aafc7fe-860b-4994-88e8-e28801d82bbc") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:45.937035 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.936780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:45.937035 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.936825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:45.937035 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.936917 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:45.937035 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:45.936938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:45.937372 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.937039 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:45.937372 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:45.937118 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:47.936519 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:47.936480 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:47.936978 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:47.936527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:47.936978 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:47.936610 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:47.936978 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:47.936484 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:47.937137 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:47.937070 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:47.937188 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:47.937164 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:49.575692 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:49.575652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:49.575735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:49.575800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575847 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575875 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575890 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mlqbn for pod openshift-network-diagnostics/network-check-target-7pw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575896 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575898 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575949 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn podName:1e754309-f51a-40f7-b0c7-e58bcca7a820 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:57.575929762 +0000 UTC m=+18.149329029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlqbn" (UniqueName: "kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn") pod "network-check-target-7pw2n" (UID: "1e754309-f51a-40f7-b0c7-e58bcca7a820") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575975 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret podName:5aafc7fe-860b-4994-88e8-e28801d82bbc nodeName:}" failed. No retries permitted until 2026-07-06 20:58:57.575964695 +0000 UTC m=+18.149363956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret") pod "global-pull-secret-syncer-fbbpk" (UID: "5aafc7fe-860b-4994-88e8-e28801d82bbc") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:49.576149 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.575991 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs podName:1c4bb39b-62ca-4410-a3c7-77f64860720b nodeName:}" failed. No retries permitted until 2026-07-06 20:58:57.575981208 +0000 UTC m=+18.149380473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs") pod "network-metrics-daemon-blvkk" (UID: "1c4bb39b-62ca-4410-a3c7-77f64860720b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:49.937643 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:49.937120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:49.937643 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.937247 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:49.937643 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:49.937323 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:49.937643 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:49.937447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:49.937643 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.937447 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:49.937643 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:49.937571 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:51.936098 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:51.936060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:51.936622 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:51.936082 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:51.936622 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:51.936224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:51.936622 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:51.936202 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:51.936622 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:51.936301 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:51.936622 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:51.936373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:53.936450 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:53.936415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:53.936450 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:53.936450 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:53.936974 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:53.936415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:53.936974 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:53.936562 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:53.936974 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:53.936653 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:53.936974 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:53.936750 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:55.936143 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:55.936106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:55.936624 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:55.936238 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:55.936624 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:55.936243 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:55.936624 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:55.936252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:55.936624 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:55.936347 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:55.936624 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:55.936439 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:57.635921 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:57.635888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:57.635921 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:57.635927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:57.635958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636062 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636067 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636099 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636123 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636130 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs podName:1c4bb39b-62ca-4410-a3c7-77f64860720b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:13.636109679 +0000 UTC m=+34.209508944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs") pod "network-metrics-daemon-blvkk" (UID: "1c4bb39b-62ca-4410-a3c7-77f64860720b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636134 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mlqbn for pod openshift-network-diagnostics/network-check-target-7pw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636146 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret podName:5aafc7fe-860b-4994-88e8-e28801d82bbc nodeName:}" failed. No retries permitted until 2026-07-06 20:59:13.636140105 +0000 UTC m=+34.209539368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret") pod "global-pull-secret-syncer-fbbpk" (UID: "5aafc7fe-860b-4994-88e8-e28801d82bbc") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:57.636426 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.636171 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn podName:1e754309-f51a-40f7-b0c7-e58bcca7a820 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:13.636159967 +0000 UTC m=+34.209559229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlqbn" (UniqueName: "kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn") pod "network-check-target-7pw2n" (UID: "1e754309-f51a-40f7-b0c7-e58bcca7a820") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:57.936083 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:57.936006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:57.936083 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:57.936022 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:57.936083 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:57.936006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:57.936340 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.936152 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:57.936340 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.936222 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:58:57.936340 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:57.936302 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:59.938937 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:59.938891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:58:59.939422 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:59.939050 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:58:59.939557 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:59.939538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:58:59.939680 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:59.939659 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:58:59.939740 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:58:59.939729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:58:59.939855 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:58:59.939839 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:01.936823 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:01.936406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:01.937471 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:01.936414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:01.937471 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:01.936947 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:01.937471 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:01.936432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:01.937471 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:01.937059 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:01.937471 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:01.937155 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:02.036961 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.036884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbvmk" event={"ID":"2e931621-f88e-4421-8163-eb6218ecb15d","Type":"ContainerStarted","Data":"eac446c58fbaf416d3361601e9d2eac9ce0b01654c2bc79730d57b01c2a5efeb"} Jul 06 20:59:02.038394 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.038370 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" event={"ID":"811a9c4d-383b-482b-8cbd-168e6b31e0af","Type":"ContainerStarted","Data":"7ce891f0c6779b71c1853540f15b058f75dd7322572e3ada68a932009f87c386"} Jul 06 20:59:02.039719 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.039699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7cdl" event={"ID":"076f53e4-f359-407c-acfa-039d2af4e92a","Type":"ContainerStarted","Data":"0dedf6e88617cb319ac8fd223fdcb4dce46f1696ffc46e90469111a9b37d34a2"} Jul 06 20:59:02.041248 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.041230 2562 generic.go:356] "Generic (PLEG): container finished" podID="922e2842-91f2-423e-9b86-ea0939c3f564" containerID="a3956d1a476860fe0b57e0c22ed96055c5ab3ca3ebd1808ce4a1c68207f00e07" exitCode=0 Jul 06 20:59:02.041327 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.041295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerDied","Data":"a3956d1a476860fe0b57e0c22ed96055c5ab3ca3ebd1808ce4a1c68207f00e07"} Jul 06 20:59:02.042852 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.042822 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-74xlg" event={"ID":"e099064e-bb9d-455b-86f1-1537d5d74c23","Type":"ContainerStarted","Data":"589d72cf0342cabb4a87f8e745093a9a815cc12fdfd0c9c1038a080938242544"} Jul 06 20:59:02.044502 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.044476 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8zkr8" event={"ID":"559a6012-02f4-4e54-b987-9e4a9fe14802","Type":"ContainerStarted","Data":"975d54e2ef10a1ddbf87fd251b53e74ba6dd6c5d41ace2900a915a72538f8ec3"} Jul 06 20:59:02.047617 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.047597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"3a909e6bfe3218b5a35b43276c4bd2a9525b290c9fb72d617ab71d3282490944"} Jul 06 20:59:02.047718 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.047664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"65705c533eedc2754fc96effc3fd5c4f1082d3a9ed7de04fbd24e8a3150cbb1d"} Jul 06 20:59:02.047718 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.047710 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"8ae8685206a6006e6d5dc531135f008766109bf7aa2d846068026392f8af33ce"} Jul 06 20:59:02.047829 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.047755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"9c0214146b1c5534d29ab0e30bcfdbe3f604b135611a45caa27b5381f1857c13"} Jul 06 20:59:02.047829 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.047800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"7ad2b48d4dd366e5532df7b9a8ad85291ab721055ed8a22b3b802d132220b115"} Jul 06 20:59:02.049012 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.048993 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bh62d" event={"ID":"8e97d9aa-79fa-4b32-81d9-f3b30fbeb752","Type":"ContainerStarted","Data":"fc81cfdf5662fdd7ef59e35714283231d08121ea91fd8ebb75442b37f90f5127"} Jul 06 20:59:02.057707 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.057667 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wbvmk" podStartSLOduration=3.458728327 podStartE2EDuration="22.05765472s" totalImagesPullingTime="18.598926393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:02.057460372 +0000 UTC m=+22.630859655" watchObservedRunningTime="2026-07-06 20:59:02.05765472 +0000 UTC m=+22.631054003" Jul 06 20:59:02.074820 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.074780 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bh62d" podStartSLOduration=4.521924736 podStartE2EDuration="23.074766247s" totalImagesPullingTime="18.552841511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:02.074662796 +0000 UTC m=+22.648062081" watchObservedRunningTime="2026-07-06 20:59:02.074766247 +0000 UTC m=+22.648165530" Jul 06 20:59:02.090927 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.090871 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7cdl" podStartSLOduration=3.547565155 podStartE2EDuration="22.090855802s" totalImagesPullingTime="18.543290647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:02.090801824 +0000 UTC m=+22.664201109" watchObservedRunningTime="2026-07-06 20:59:02.090855802 +0000 UTC m=+22.664255086" Jul 06 20:59:02.133568 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.133519 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8zkr8" podStartSLOduration=3.5917551530000003 podStartE2EDuration="22.133501936s" totalImagesPullingTime="18.541746783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:02.108503903 +0000 UTC m=+22.681903190" watchObservedRunningTime="2026-07-06 20:59:02.133501936 +0000 UTC m=+22.706901219" Jul 06 20:59:02.150945 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.150895 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-74xlg" podStartSLOduration=8.12282379 podStartE2EDuration="22.150873429s" totalImagesPullingTime="14.028049639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:02.15066055 +0000 UTC m=+22.724059834" watchObservedRunningTime="2026-07-06 20:59:02.150873429 +0000 UTC m=+22.724272715" Jul 06 20:59:02.880332 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:02.880307 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:59:03.046269 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.046234 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:59:03.047110 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.047087 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:59:03.059457 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.059419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"bb48a5451a59868ea637b730f88751ea5f2925b693115f619310f374140cef79"} Jul 06 20:59:03.061756 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.061719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" event={"ID":"811a9c4d-383b-482b-8cbd-168e6b31e0af","Type":"ContainerStarted","Data":"13064e639d0f870d2c67cec516ce7efe9cd52edc38f5da91e42aa823f21e121d"} Jul 06 20:59:03.063356 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.063326 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9htp" event={"ID":"9d51a5a1-dbae-4816-816b-30cc83ff1cc2","Type":"ContainerStarted","Data":"0218f2c6ef33d397c21ac35621fc0d0228d43583bc300bdbeb992d9e50b72fb1"} Jul 06 20:59:03.063565 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.063545 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:59:03.064284 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.064266 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-74xlg" Jul 06 20:59:03.098805 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.098759 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h9htp" podStartSLOduration=5.556708286 podStartE2EDuration="24.098744191s" totalImagesPullingTime="18.542035905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:03.098425471 +0000 UTC m=+23.671824754" watchObservedRunningTime="2026-07-06 20:59:03.098744191 +0000 UTC m=+23.672143475" Jul 06 20:59:03.847351 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.847205 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:59:02.88032486Z","UUID":"68ff91bb-915d-429f-bd72-5cff0042fcdd","Handler":null,"Name":"","Endpoint":""} Jul 06 20:59:03.849061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.849035 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:59:03.849202 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.849078 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:59:03.936314 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.936282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:03.936314 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.936300 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:03.936507 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:03.936282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:03.936507 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:03.936404 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:03.936507 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:03.936475 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:03.936706 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:03.936550 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:04.068150 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:04.068118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" event={"ID":"811a9c4d-383b-482b-8cbd-168e6b31e0af","Type":"ContainerStarted","Data":"de44acf842fcdcd8a304cac443535afe0d22e0993a02059385d45be88a3f17b4"} Jul 06 20:59:04.088188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:04.088135 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7t695" podStartSLOduration=4.240083557 podStartE2EDuration="25.088119147s" totalImagesPullingTime="20.84803559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:04.087667274 +0000 UTC m=+24.661066559" watchObservedRunningTime="2026-07-06 20:59:04.088119147 +0000 UTC m=+24.661518519" Jul 06 20:59:05.074563 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:05.074366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"059876a78a8a8d3c0456a7e706bbc6abb02c2548c5f1e3f776bdc3e55b11354c"} Jul 06 20:59:05.936834 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:05.936796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:05.937058 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:05.936794 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:05.937058 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:05.936963 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:05.937058 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:05.936996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:05.937257 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:05.937112 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:05.937257 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:05.937235 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:07.081258 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.081204 2562 generic.go:356] "Generic (PLEG): container finished" podID="922e2842-91f2-423e-9b86-ea0939c3f564" containerID="e3b172088dfc6c763321b06f5cdb8a97f43871d32270c6e63ec19720fe441361" exitCode=0 Jul 06 20:59:07.081925 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.081299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerDied","Data":"e3b172088dfc6c763321b06f5cdb8a97f43871d32270c6e63ec19720fe441361"} Jul 06 20:59:07.085198 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.085171 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" event={"ID":"f08b5917-a149-443b-9107-7304b4917d0e","Type":"ContainerStarted","Data":"addcaa8f183f995516778a882cffea509a5bca500a7a9b791c8329f3396c2f5c"} Jul 06 20:59:07.085489 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.085476 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:59:07.101165 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.101146 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:59:07.154926 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.154876 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" podStartSLOduration=8.536964724 podStartE2EDuration="27.154861044s" totalImagesPullingTime="18.61789632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:07.154505144 +0000 UTC m=+27.727904427" watchObservedRunningTime="2026-07-06 20:59:07.154861044 +0000 UTC m=+27.728260365" Jul 06 20:59:07.936190 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.936158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:07.936445 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.936159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:07.936445 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:07.936159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:07.936445 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:07.936295 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:07.936445 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:07.936387 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:07.936445 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:07.936443 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:08.087103 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.087077 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:59:08.087517 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.087496 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:59:08.102720 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.102699 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:59:08.712838 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.712625 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7pw2n"] Jul 06 20:59:08.712995 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.712878 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:08.712995 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:08.712962 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:08.713141 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.713121 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fbbpk"] Jul 06 20:59:08.713258 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.713239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:08.713380 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:08.713337 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:08.714083 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.714056 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-blvkk"] Jul 06 20:59:08.714166 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:08.714137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:08.714257 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:08.714237 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:09.091655 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:09.091623 2562 generic.go:356] "Generic (PLEG): container finished" podID="922e2842-91f2-423e-9b86-ea0939c3f564" containerID="9c1d5c1ef685e6a6144827635744153b0be8ce1cc28c0a68fac5da318ee067b5" exitCode=0 Jul 06 20:59:09.092117 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:09.091701 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerDied","Data":"9c1d5c1ef685e6a6144827635744153b0be8ce1cc28c0a68fac5da318ee067b5"} Jul 06 20:59:09.092117 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:09.091764 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:59:09.936546 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:09.936515 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:09.936732 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:09.936596 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:10.093811 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:10.093780 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:59:10.935824 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:10.935789 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:10.935970 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:10.935798 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:10.935970 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:10.935919 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:10.936049 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:10.935969 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:11.098096 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:11.098065 2562 generic.go:356] "Generic (PLEG): container finished" podID="922e2842-91f2-423e-9b86-ea0939c3f564" containerID="168c74436ecf937c720e8da2d42a123e51ce9a6ec613b27e83b2d7de24036609" exitCode=0 Jul 06 20:59:11.098660 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:11.098120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerDied","Data":"168c74436ecf937c720e8da2d42a123e51ce9a6ec613b27e83b2d7de24036609"} Jul 06 20:59:11.900032 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:11.899990 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:59:11.900275 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:11.900260 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:59:11.913931 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:11.913881 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" podUID="f08b5917-a149-443b-9107-7304b4917d0e" containerName="ovnkube-controller" probeResult="failure" output="" Jul 06 20:59:11.923689 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:11.923654 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" podUID="f08b5917-a149-443b-9107-7304b4917d0e" containerName="ovnkube-controller" probeResult="failure" output="" Jul 06 20:59:11.935851 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:11.935829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:11.935980 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:11.935950 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:12.811243 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:12.811203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7cdl_076f53e4-f359-407c-acfa-039d2af4e92a/dns-node-resolver/0.log" Jul 06 20:59:12.936289 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:12.936255 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:12.936289 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:12.936290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:12.936534 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:12.936391 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:12.936534 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:12.936523 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:13.375742 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:13.375689 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8zkr8_559a6012-02f4-4e54-b987-9e4a9fe14802/node-ca/0.log" Jul 06 20:59:13.653647 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:13.653565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:13.653647 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:13.653606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:13.653845 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653705 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:59:13.653845 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:13.653730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:13.653845 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653769 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret podName:5aafc7fe-860b-4994-88e8-e28801d82bbc nodeName:}" failed. No retries permitted until 2026-07-06 20:59:45.653752164 +0000 UTC m=+66.227151430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret") pod "global-pull-secret-syncer-fbbpk" (UID: "5aafc7fe-860b-4994-88e8-e28801d82bbc") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:59:13.653845 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653712 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:59:13.653845 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653829 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:59:13.653845 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653832 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:59:13.653845 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653843 2562 projected.go:196] Error preparing data for projected volume kube-api-access-mlqbn for pod openshift-network-diagnostics/network-check-target-7pw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:59:13.654066 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653881 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs podName:1c4bb39b-62ca-4410-a3c7-77f64860720b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:45.653866585 +0000 UTC m=+66.227265846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs") pod "network-metrics-daemon-blvkk" (UID: "1c4bb39b-62ca-4410-a3c7-77f64860720b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:59:13.654066 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.653894 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn podName:1e754309-f51a-40f7-b0c7-e58bcca7a820 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:45.653887645 +0000 UTC m=+66.227286906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlqbn" (UniqueName: "kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn") pod "network-check-target-7pw2n" (UID: "1e754309-f51a-40f7-b0c7-e58bcca7a820") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:59:13.936082 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:13.935994 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:13.936559 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:13.936153 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pw2n" podUID="1e754309-f51a-40f7-b0c7-e58bcca7a820" Jul 06 20:59:14.935816 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:14.935776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:14.935986 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:14.935776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:14.935986 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:14.935911 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blvkk" podUID="1c4bb39b-62ca-4410-a3c7-77f64860720b" Jul 06 20:59:14.936085 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:14.935986 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbbpk" podUID="5aafc7fe-860b-4994-88e8-e28801d82bbc" Jul 06 20:59:15.183449 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:15.183420 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-218.ec2.internal" event="NodeReady" Jul 06 20:59:15.183905 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:15.183556 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:59:15.936473 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:15.936436 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:15.940807 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:15.940784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tvmd\"" Jul 06 20:59:15.941663 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:15.941636 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:59:15.941764 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:15.941645 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:59:16.936040 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:16.935853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:16.936505 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:16.935853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:16.938816 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:16.938800 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:59:16.938915 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:16.938852 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:59:16.939725 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:16.939710 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wh5f\"" Jul 06 20:59:17.118393 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:17.118363 2562 generic.go:356] "Generic (PLEG): container finished" podID="922e2842-91f2-423e-9b86-ea0939c3f564" containerID="87675c412c10aecd817a690e566331de0d6c228c1a583741043b472fe8537f47" exitCode=0 Jul 06 20:59:17.118575 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:17.118405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerDied","Data":"87675c412c10aecd817a690e566331de0d6c228c1a583741043b472fe8537f47"} Jul 06 20:59:18.123616 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:18.123577 2562 generic.go:356] "Generic (PLEG): container finished" podID="922e2842-91f2-423e-9b86-ea0939c3f564" containerID="7832fccef108d47f4787fb564f25f171f7e8ac00babb2a1087c04b3d86fc2d34" exitCode=0 Jul 06 20:59:18.124011 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:18.123629 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerDied","Data":"7832fccef108d47f4787fb564f25f171f7e8ac00babb2a1087c04b3d86fc2d34"} Jul 06 20:59:19.128821 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:19.128789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" event={"ID":"922e2842-91f2-423e-9b86-ea0939c3f564","Type":"ContainerStarted","Data":"8388152455fca5a64fea442895be3ec2352ae40d266b281183eb164521a3aaef"} Jul 06 20:59:19.175738 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:19.175681 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6zmdd" podStartSLOduration=8.653604309 podStartE2EDuration="39.175663554s" totalImagesPullingTime="30.522059245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:19.155830709 +0000 UTC m=+39.729229994" watchObservedRunningTime="2026-07-06 20:59:19.175663554 +0000 UTC m=+39.749062838" Jul 06 20:59:38.887634 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.887601 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7lk57"] Jul 06 20:59:38.890599 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.890576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:38.893737 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.893720 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27mml\"" Jul 06 20:59:38.893849 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.893764 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:59:38.894724 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.894711 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:59:38.911290 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.911265 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nffwv"] Jul 06 20:59:38.912996 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.912978 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8f767dfcb-xlmkk"] Jul 06 20:59:38.913106 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.913090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:38.914905 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.914888 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lk57"] Jul 06 20:59:38.915012 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.914998 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.916021 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.916006 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:59:38.916021 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.916013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:59:38.917119 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.917097 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:59:38.917426 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.917408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jz828\"" Jul 06 20:59:38.919232 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.919191 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dhdp7\"" Jul 06 20:59:38.919470 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.919449 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:59:38.919732 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.919712 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:59:38.920628 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.920607 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:59:38.928329 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.928312 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nffwv"] Jul 06 20:59:38.931391 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.931335 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:59:38.932097 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.932078 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8f767dfcb-xlmkk"] Jul 06 20:59:38.936177 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzvf\" (UniqueName: \"kubernetes.io/projected/6dc52850-9167-4cae-ab8e-f022694fa8a9-kube-api-access-jdzvf\") pod \"ingress-canary-nffwv\" (UID: \"6dc52850-9167-4cae-ab8e-f022694fa8a9\") " pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:38.936288 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94eaa925-c08a-4146-9eb6-56941936da53-config-volume\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:38.936288 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94eaa925-c08a-4146-9eb6-56941936da53-tmp-dir\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:38.936288 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc52850-9167-4cae-ab8e-f022694fa8a9-cert\") pod \"ingress-canary-nffwv\" (UID: \"6dc52850-9167-4cae-ab8e-f022694fa8a9\") " pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:38.936421 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6258cc2-67cc-4b10-8a24-ef6169b70973-trusted-ca\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.936421 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-bound-sa-token\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.936421 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94eaa925-c08a-4146-9eb6-56941936da53-metrics-tls\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:38.936421 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6258cc2-67cc-4b10-8a24-ef6169b70973-ca-trust-extracted\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.936593 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936422 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6258cc2-67cc-4b10-8a24-ef6169b70973-installation-pull-secrets\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.936593 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqqkg\" (UniqueName: \"kubernetes.io/projected/94eaa925-c08a-4146-9eb6-56941936da53-kube-api-access-sqqkg\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:38.936593 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6258cc2-67cc-4b10-8a24-ef6169b70973-registry-certificates\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.936593 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6258cc2-67cc-4b10-8a24-ef6169b70973-image-registry-private-configuration\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.936593 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-registry-tls\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:38.936593 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:38.936547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8gw8\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-kube-api-access-q8gw8\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.036971 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.036939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6258cc2-67cc-4b10-8a24-ef6169b70973-image-registry-private-configuration\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.036971 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.036971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-registry-tls\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.037194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.036987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8gw8\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-kube-api-access-q8gw8\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.037194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzvf\" (UniqueName: \"kubernetes.io/projected/6dc52850-9167-4cae-ab8e-f022694fa8a9-kube-api-access-jdzvf\") pod \"ingress-canary-nffwv\" (UID: \"6dc52850-9167-4cae-ab8e-f022694fa8a9\") " pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:39.037194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94eaa925-c08a-4146-9eb6-56941936da53-config-volume\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.037194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94eaa925-c08a-4146-9eb6-56941936da53-tmp-dir\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.037194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc52850-9167-4cae-ab8e-f022694fa8a9-cert\") pod \"ingress-canary-nffwv\" (UID: \"6dc52850-9167-4cae-ab8e-f022694fa8a9\") " pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:39.037194 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6258cc2-67cc-4b10-8a24-ef6169b70973-trusted-ca\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.037518 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-bound-sa-token\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.037518 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037397 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94eaa925-c08a-4146-9eb6-56941936da53-metrics-tls\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.037518 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6258cc2-67cc-4b10-8a24-ef6169b70973-ca-trust-extracted\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.037518 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6258cc2-67cc-4b10-8a24-ef6169b70973-installation-pull-secrets\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.037518 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqqkg\" (UniqueName: \"kubernetes.io/projected/94eaa925-c08a-4146-9eb6-56941936da53-kube-api-access-sqqkg\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.037518 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6258cc2-67cc-4b10-8a24-ef6169b70973-registry-certificates\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.037812 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94eaa925-c08a-4146-9eb6-56941936da53-config-volume\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.037900 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6258cc2-67cc-4b10-8a24-ef6169b70973-ca-trust-extracted\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.038021 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.037996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94eaa925-c08a-4146-9eb6-56941936da53-tmp-dir\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.038474 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.038298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6258cc2-67cc-4b10-8a24-ef6169b70973-trusted-ca\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.038577 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.038491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6258cc2-67cc-4b10-8a24-ef6169b70973-registry-certificates\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.041347 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.041322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94eaa925-c08a-4146-9eb6-56941936da53-metrics-tls\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.041449 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.041358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6258cc2-67cc-4b10-8a24-ef6169b70973-image-registry-private-configuration\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.041449 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.041392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6258cc2-67cc-4b10-8a24-ef6169b70973-installation-pull-secrets\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.041535 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.041477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc52850-9167-4cae-ab8e-f022694fa8a9-cert\") pod \"ingress-canary-nffwv\" (UID: \"6dc52850-9167-4cae-ab8e-f022694fa8a9\") " pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:39.041728 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.041711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-registry-tls\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.052879 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.052856 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9nb7t"] Jul 06 20:59:39.055494 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.055477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.060753 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.060734 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:59:39.061757 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.061737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:59:39.063602 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.063586 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:59:39.063677 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.063655 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:59:39.063924 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.063911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-85slc\"" Jul 06 20:59:39.088008 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.087985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nb7t"] Jul 06 20:59:39.088439 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.088422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzvf\" (UniqueName: \"kubernetes.io/projected/6dc52850-9167-4cae-ab8e-f022694fa8a9-kube-api-access-jdzvf\") pod \"ingress-canary-nffwv\" (UID: \"6dc52850-9167-4cae-ab8e-f022694fa8a9\") " pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:39.088523 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.088508 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqqkg\" (UniqueName: \"kubernetes.io/projected/94eaa925-c08a-4146-9eb6-56941936da53-kube-api-access-sqqkg\") pod \"dns-default-7lk57\" (UID: \"94eaa925-c08a-4146-9eb6-56941936da53\") " pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.088617 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.088602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-bound-sa-token\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.088904 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.088885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8gw8\" (UniqueName: \"kubernetes.io/projected/f6258cc2-67cc-4b10-8a24-ef6169b70973-kube-api-access-q8gw8\") pod \"image-registry-8f767dfcb-xlmkk\" (UID: \"f6258cc2-67cc-4b10-8a24-ef6169b70973\") " pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.138153 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.138078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1b92af3-a521-4d00-8123-5c5ff650ff4c-crio-socket\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.138153 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.138109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t8b\" (UniqueName: \"kubernetes.io/projected/d1b92af3-a521-4d00-8123-5c5ff650ff4c-kube-api-access-57t8b\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.138153 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.138126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1b92af3-a521-4d00-8123-5c5ff650ff4c-data-volume\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.138153 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.138141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1b92af3-a521-4d00-8123-5c5ff650ff4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.138395 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.138250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1b92af3-a521-4d00-8123-5c5ff650ff4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.199435 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.199401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:39.225326 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.225299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nffwv" Jul 06 20:59:39.230304 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.230280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:39.239375 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.239346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1b92af3-a521-4d00-8123-5c5ff650ff4c-crio-socket\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.239503 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.239390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57t8b\" (UniqueName: \"kubernetes.io/projected/d1b92af3-a521-4d00-8123-5c5ff650ff4c-kube-api-access-57t8b\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.239503 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.239423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1b92af3-a521-4d00-8123-5c5ff650ff4c-data-volume\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.239503 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.239451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1b92af3-a521-4d00-8123-5c5ff650ff4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.239653 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.239526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1b92af3-a521-4d00-8123-5c5ff650ff4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.240056 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.239849 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1b92af3-a521-4d00-8123-5c5ff650ff4c-crio-socket\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.240153 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.240122 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1b92af3-a521-4d00-8123-5c5ff650ff4c-data-volume\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.240497 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.240471 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1b92af3-a521-4d00-8123-5c5ff650ff4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.241947 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.241918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1b92af3-a521-4d00-8123-5c5ff650ff4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.295132 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.294725 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t8b\" (UniqueName: \"kubernetes.io/projected/d1b92af3-a521-4d00-8123-5c5ff650ff4c-kube-api-access-57t8b\") pod \"insights-runtime-extractor-9nb7t\" (UID: \"d1b92af3-a521-4d00-8123-5c5ff650ff4c\") " pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.363538 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.363433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nb7t" Jul 06 20:59:39.413093 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.412909 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lk57"] Jul 06 20:59:39.414452 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:39.413920 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94eaa925_c08a_4146_9eb6_56941936da53.slice/crio-ffd5945a6450ccf8792370f6bcc80449cdb967993499ae12e258054febd9b3e6 WatchSource:0}: Error finding container ffd5945a6450ccf8792370f6bcc80449cdb967993499ae12e258054febd9b3e6: Status 404 returned error can't find the container with id ffd5945a6450ccf8792370f6bcc80449cdb967993499ae12e258054febd9b3e6 Jul 06 20:59:39.448050 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.447985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nffwv"] Jul 06 20:59:39.451778 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:39.451751 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc52850_9167_4cae_ab8e_f022694fa8a9.slice/crio-fcb76884cfdbfa1a93b6b49f819c6bb0c593a8839ebbae299676fd639c6ba758 WatchSource:0}: Error finding container fcb76884cfdbfa1a93b6b49f819c6bb0c593a8839ebbae299676fd639c6ba758: Status 404 returned error can't find the container with id fcb76884cfdbfa1a93b6b49f819c6bb0c593a8839ebbae299676fd639c6ba758 Jul 06 20:59:39.460167 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.460143 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8f767dfcb-xlmkk"] Jul 06 20:59:39.462614 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:39.462588 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6258cc2_67cc_4b10_8a24_ef6169b70973.slice/crio-fc779179e49243f0fd9a94319d8be35374188d15deff1017d16f6e02b6f393ee WatchSource:0}: Error finding container fc779179e49243f0fd9a94319d8be35374188d15deff1017d16f6e02b6f393ee: Status 404 returned error can't find the container with id fc779179e49243f0fd9a94319d8be35374188d15deff1017d16f6e02b6f393ee Jul 06 20:59:39.506322 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.506292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nb7t"] Jul 06 20:59:39.509629 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:39.509603 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b92af3_a521_4d00_8123_5c5ff650ff4c.slice/crio-37b40c5585cb02a786c7d844f1675195a22c59cad93093457819985e7a95569f WatchSource:0}: Error finding container 37b40c5585cb02a786c7d844f1675195a22c59cad93093457819985e7a95569f: Status 404 returned error can't find the container with id 37b40c5585cb02a786c7d844f1675195a22c59cad93093457819985e7a95569f Jul 06 20:59:39.716974 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.716893 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw"] Jul 06 20:59:39.718853 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.718832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:39.730573 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.730552 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 20:59:39.730739 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.730719 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-w99n2\"" Jul 06 20:59:39.742766 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.742742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84d770f3-af3d-4442-99df-f6c2b3759adc-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hsrfw\" (UID: \"84d770f3-af3d-4442-99df-f6c2b3759adc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:39.745197 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.745171 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw"] Jul 06 20:59:39.843299 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.843264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84d770f3-af3d-4442-99df-f6c2b3759adc-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hsrfw\" (UID: \"84d770f3-af3d-4442-99df-f6c2b3759adc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:39.846179 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:39.846152 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 20:59:39.854513 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:39.854487 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 20:59:39.854648 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:39.854562 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d770f3-af3d-4442-99df-f6c2b3759adc-tls-certificates podName:84d770f3-af3d-4442-99df-f6c2b3759adc nodeName:}" failed. No retries permitted until 2026-07-06 20:59:40.354540949 +0000 UTC m=+60.927940227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/84d770f3-af3d-4442-99df-f6c2b3759adc-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-hsrfw" (UID: "84d770f3-af3d-4442-99df-f6c2b3759adc") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 20:59:40.181692 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.181654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" event={"ID":"f6258cc2-67cc-4b10-8a24-ef6169b70973","Type":"ContainerStarted","Data":"1b406ac496603b04df8f595f7bc8fc98c76a33361a228555bd2ebc55c6a78c43"} Jul 06 20:59:40.182172 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.181718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" event={"ID":"f6258cc2-67cc-4b10-8a24-ef6169b70973","Type":"ContainerStarted","Data":"fc779179e49243f0fd9a94319d8be35374188d15deff1017d16f6e02b6f393ee"} Jul 06 20:59:40.182488 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.182468 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 20:59:40.185611 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.185587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nffwv" event={"ID":"6dc52850-9167-4cae-ab8e-f022694fa8a9","Type":"ContainerStarted","Data":"fcb76884cfdbfa1a93b6b49f819c6bb0c593a8839ebbae299676fd639c6ba758"} Jul 06 20:59:40.187603 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.187570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lk57" event={"ID":"94eaa925-c08a-4146-9eb6-56941936da53","Type":"ContainerStarted","Data":"ffd5945a6450ccf8792370f6bcc80449cdb967993499ae12e258054febd9b3e6"} Jul 06 20:59:40.189518 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.189491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nb7t" event={"ID":"d1b92af3-a521-4d00-8123-5c5ff650ff4c","Type":"ContainerStarted","Data":"37b40c5585cb02a786c7d844f1675195a22c59cad93093457819985e7a95569f"} Jul 06 20:59:40.448872 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.447798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84d770f3-af3d-4442-99df-f6c2b3759adc-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hsrfw\" (UID: \"84d770f3-af3d-4442-99df-f6c2b3759adc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:40.457125 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.455162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84d770f3-af3d-4442-99df-f6c2b3759adc-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hsrfw\" (UID: \"84d770f3-af3d-4442-99df-f6c2b3759adc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:40.629990 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.629768 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-w99n2\"" Jul 06 20:59:40.637485 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.637186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:40.812247 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.811598 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" podStartSLOduration=2.811577149 podStartE2EDuration="2.811577149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:40.213135248 +0000 UTC m=+60.786534537" watchObservedRunningTime="2026-07-06 20:59:40.811577149 +0000 UTC m=+61.384976434" Jul 06 20:59:40.813930 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:40.812706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw"] Jul 06 20:59:40.816400 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:40.816368 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d770f3_af3d_4442_99df_f6c2b3759adc.slice/crio-2a0703261b72f7b9190148a31ad76bde8b3ad09d8244d17dc5ce6efbc774462f WatchSource:0}: Error finding container 2a0703261b72f7b9190148a31ad76bde8b3ad09d8244d17dc5ce6efbc774462f: Status 404 returned error can't find the container with id 2a0703261b72f7b9190148a31ad76bde8b3ad09d8244d17dc5ce6efbc774462f Jul 06 20:59:41.194815 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:41.194745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" event={"ID":"84d770f3-af3d-4442-99df-f6c2b3759adc","Type":"ContainerStarted","Data":"2a0703261b72f7b9190148a31ad76bde8b3ad09d8244d17dc5ce6efbc774462f"} Jul 06 20:59:41.926014 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:41.925987 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thkht" Jul 06 20:59:44.413037 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.412945 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cc6957c8c-pl4p9"] Jul 06 20:59:44.415030 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.415009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.422556 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.422526 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 20:59:44.423004 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.422708 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 20:59:44.427586 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.427562 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 20:59:44.427699 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.427677 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 20:59:44.427779 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.427681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 20:59:44.427779 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.427687 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 20:59:44.428404 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.428378 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 20:59:44.428508 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.428421 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fjml9\"" Jul 06 20:59:44.482439 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.482404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-console-config\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.482601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.482453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-service-ca\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.482601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.482494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-oauth-config\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.482601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.482553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-oauth-serving-cert\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.482601 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.482581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzdjn\" (UniqueName: \"kubernetes.io/projected/fe64d326-d6d8-4008-8e9f-73269f197298-kube-api-access-gzdjn\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.482755 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.482656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-serving-cert\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.512099 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.512066 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc6957c8c-pl4p9"] Jul 06 20:59:44.583743 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.583705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-service-ca\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.583743 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.583752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-oauth-config\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.583994 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.583805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-oauth-serving-cert\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.583994 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.583829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzdjn\" (UniqueName: \"kubernetes.io/projected/fe64d326-d6d8-4008-8e9f-73269f197298-kube-api-access-gzdjn\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.583994 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.583857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-serving-cert\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.583994 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.583902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-console-config\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.584745 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.584607 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-service-ca\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.584745 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.584626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-console-config\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.584903 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.584762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-oauth-serving-cert\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.586572 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.586546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-serving-cert\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.586686 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.586629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-oauth-config\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.617119 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.617087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzdjn\" (UniqueName: \"kubernetes.io/projected/fe64d326-d6d8-4008-8e9f-73269f197298-kube-api-access-gzdjn\") pod \"console-cc6957c8c-pl4p9\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.726476 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.726397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:44.937009 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:44.936978 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc6957c8c-pl4p9"] Jul 06 20:59:44.941440 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:44.941413 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe64d326_d6d8_4008_8e9f_73269f197298.slice/crio-5278122b433c07bb7dc6e9bf01df48a14c9be6d962b33aa373af112f6c4b59e4 WatchSource:0}: Error finding container 5278122b433c07bb7dc6e9bf01df48a14c9be6d962b33aa373af112f6c4b59e4: Status 404 returned error can't find the container with id 5278122b433c07bb7dc6e9bf01df48a14c9be6d962b33aa373af112f6c4b59e4 Jul 06 20:59:45.206721 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.206686 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nffwv" event={"ID":"6dc52850-9167-4cae-ab8e-f022694fa8a9","Type":"ContainerStarted","Data":"8cb938413e61fcab3e1dcd6b9becea454b343fad1a7159b595a6df35cb69b3a7"} Jul 06 20:59:45.208358 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.208333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lk57" event={"ID":"94eaa925-c08a-4146-9eb6-56941936da53","Type":"ContainerStarted","Data":"ddea87296ba81f9822e22613d0283510e364cd7238b7ea2973c295e2f1982c27"} Jul 06 20:59:45.208499 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.208378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lk57" event={"ID":"94eaa925-c08a-4146-9eb6-56941936da53","Type":"ContainerStarted","Data":"03ec94efa7853358042fb4da8654d2317bec004a027dabc554c3c5cd5b6f1e72"} Jul 06 20:59:45.208499 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.208456 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:45.209450 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.209429 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc6957c8c-pl4p9" event={"ID":"fe64d326-d6d8-4008-8e9f-73269f197298","Type":"ContainerStarted","Data":"5278122b433c07bb7dc6e9bf01df48a14c9be6d962b33aa373af112f6c4b59e4"} Jul 06 20:59:45.210758 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.210720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nb7t" event={"ID":"d1b92af3-a521-4d00-8123-5c5ff650ff4c","Type":"ContainerStarted","Data":"3458559d323c69fba92c708b3cdd1059213f343b3746575d08e656c768568103"} Jul 06 20:59:45.212036 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.212015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" event={"ID":"84d770f3-af3d-4442-99df-f6c2b3759adc","Type":"ContainerStarted","Data":"7ef526d935372a5e8888ed8d7d3990c2a681700e73ccfd0a04bebf4d8487bbe8"} Jul 06 20:59:45.212249 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.212232 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:45.216962 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.216944 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" Jul 06 20:59:45.236146 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.236096 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nffwv" podStartSLOduration=1.944389121 podStartE2EDuration="7.236079931s" totalImagesPullingTime="5.29169081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:45.235960734 +0000 UTC m=+65.809360022" watchObservedRunningTime="2026-07-06 20:59:45.236079931 +0000 UTC m=+65.809479219" Jul 06 20:59:45.294011 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.293967 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7lk57" podStartSLOduration=1.970322709 podStartE2EDuration="7.293951625s" totalImagesPullingTime="5.323628916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:45.264459584 +0000 UTC m=+65.837858869" watchObservedRunningTime="2026-07-06 20:59:45.293951625 +0000 UTC m=+65.867350909" Jul 06 20:59:45.294337 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.294308 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hsrfw" podStartSLOduration=2.366218328 podStartE2EDuration="6.294294891s" totalImagesPullingTime="3.928076563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:45.293816431 +0000 UTC m=+65.867215713" watchObservedRunningTime="2026-07-06 20:59:45.294294891 +0000 UTC m=+65.867694175" Jul 06 20:59:45.695726 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.695685 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:45.695726 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.695729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:45.696182 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.695763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:45.701622 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.701601 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:59:45.701870 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.701855 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:59:45.705800 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.705775 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:59:45.708126 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.708102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aafc7fe-860b-4994-88e8-e28801d82bbc-original-pull-secret\") pod \"global-pull-secret-syncer-fbbpk\" (UID: \"5aafc7fe-860b-4994-88e8-e28801d82bbc\") " pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:45.708241 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.708179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c4bb39b-62ca-4410-a3c7-77f64860720b-metrics-certs\") pod \"network-metrics-daemon-blvkk\" (UID: \"1c4bb39b-62ca-4410-a3c7-77f64860720b\") " pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:45.708881 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.708863 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:59:45.718668 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.718643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqbn\" (UniqueName: \"kubernetes.io/projected/1e754309-f51a-40f7-b0c7-e58bcca7a820-kube-api-access-mlqbn\") pod \"network-check-target-7pw2n\" (UID: \"1e754309-f51a-40f7-b0c7-e58bcca7a820\") " pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:45.745104 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.745076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbbpk" Jul 06 20:59:45.752834 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.752812 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wh5f\"" Jul 06 20:59:45.760371 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.760348 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blvkk" Jul 06 20:59:45.804169 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.803479 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm"] Jul 06 20:59:45.806238 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.805921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.812061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.811281 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:59:45.812061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.811282 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:59:45.812061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.811463 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 20:59:45.812061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.811690 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 20:59:45.812061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.811764 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:59:45.812061 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.811909 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j5cdw\"" Jul 06 20:59:45.822725 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.822436 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm"] Jul 06 20:59:45.897799 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.897750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnl9k\" (UniqueName: \"kubernetes.io/projected/0225d135-bdb8-4c13-b027-f90b340fb97c-kube-api-access-rnl9k\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.897983 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.897893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0225d135-bdb8-4c13-b027-f90b340fb97c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.897983 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.897940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.897983 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.897970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.912559 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.912459 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fbbpk"] Jul 06 20:59:45.915174 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:45.915143 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aafc7fe_860b_4994_88e8_e28801d82bbc.slice/crio-7f9f3e6787d63b642de1079eaf55e6cd61f4643406058a38fe86f31418ee9a57 WatchSource:0}: Error finding container 7f9f3e6787d63b642de1079eaf55e6cd61f4643406058a38fe86f31418ee9a57: Status 404 returned error can't find the container with id 7f9f3e6787d63b642de1079eaf55e6cd61f4643406058a38fe86f31418ee9a57 Jul 06 20:59:45.933666 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.933639 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-blvkk"] Jul 06 20:59:45.940020 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:45.939993 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4bb39b_62ca_4410_a3c7_77f64860720b.slice/crio-bebaad9b18935e93cfcbed04653ef8c20153af0e8213fb58c22d261cdc570bc6 WatchSource:0}: Error finding container bebaad9b18935e93cfcbed04653ef8c20153af0e8213fb58c22d261cdc570bc6: Status 404 returned error can't find the container with id bebaad9b18935e93cfcbed04653ef8c20153af0e8213fb58c22d261cdc570bc6 Jul 06 20:59:45.958105 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.958043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tvmd\"" Jul 06 20:59:45.967602 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.967576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:45.998962 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.998922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.999155 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.998968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.999155 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.999041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnl9k\" (UniqueName: \"kubernetes.io/projected/0225d135-bdb8-4c13-b027-f90b340fb97c-kube-api-access-rnl9k\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.999155 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.999098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0225d135-bdb8-4c13-b027-f90b340fb97c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:45.999896 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:45.999871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0225d135-bdb8-4c13-b027-f90b340fb97c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:46.000031 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:45.999992 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 20:59:46.000090 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:46.000051 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-tls podName:0225d135-bdb8-4c13-b027-f90b340fb97c nodeName:}" failed. No retries permitted until 2026-07-06 20:59:46.500031316 +0000 UTC m=+67.073430603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-4jjcm" (UID: "0225d135-bdb8-4c13-b027-f90b340fb97c") : secret "prometheus-operator-tls" not found Jul 06 20:59:46.003195 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.003167 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:46.012678 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.012640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnl9k\" (UniqueName: \"kubernetes.io/projected/0225d135-bdb8-4c13-b027-f90b340fb97c-kube-api-access-rnl9k\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:46.125402 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.125329 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7pw2n"] Jul 06 20:59:46.128636 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:46.128604 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e754309_f51a_40f7_b0c7_e58bcca7a820.slice/crio-a5c990ab2691966fd1c0f673b38299cf2eb3df1a7e331c02121b41ea7034526b WatchSource:0}: Error finding container a5c990ab2691966fd1c0f673b38299cf2eb3df1a7e331c02121b41ea7034526b: Status 404 returned error can't find the container with id a5c990ab2691966fd1c0f673b38299cf2eb3df1a7e331c02121b41ea7034526b Jul 06 20:59:46.220775 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.220685 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nb7t" event={"ID":"d1b92af3-a521-4d00-8123-5c5ff650ff4c","Type":"ContainerStarted","Data":"9b0d9619ac1ea12d1589f0d1c241a6bc464f8671ab7aad222354306d7c573905"} Jul 06 20:59:46.222139 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.222079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7pw2n" event={"ID":"1e754309-f51a-40f7-b0c7-e58bcca7a820","Type":"ContainerStarted","Data":"a5c990ab2691966fd1c0f673b38299cf2eb3df1a7e331c02121b41ea7034526b"} Jul 06 20:59:46.223393 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.223365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-blvkk" event={"ID":"1c4bb39b-62ca-4410-a3c7-77f64860720b","Type":"ContainerStarted","Data":"bebaad9b18935e93cfcbed04653ef8c20153af0e8213fb58c22d261cdc570bc6"} Jul 06 20:59:46.224692 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.224642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fbbpk" event={"ID":"5aafc7fe-860b-4994-88e8-e28801d82bbc","Type":"ContainerStarted","Data":"7f9f3e6787d63b642de1079eaf55e6cd61f4643406058a38fe86f31418ee9a57"} Jul 06 20:59:46.504578 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.504003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:46.515548 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.515445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0225d135-bdb8-4c13-b027-f90b340fb97c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4jjcm\" (UID: \"0225d135-bdb8-4c13-b027-f90b340fb97c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:46.724032 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.723770 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" Jul 06 20:59:46.917513 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:46.916638 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm"] Jul 06 20:59:47.335307 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:47.335265 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0225d135_bdb8_4c13_b027_f90b340fb97c.slice/crio-0fddfa358bf6cb17210d792eed5553e2ddfdcb921faa297483d0e840cbcfd1cf WatchSource:0}: Error finding container 0fddfa358bf6cb17210d792eed5553e2ddfdcb921faa297483d0e840cbcfd1cf: Status 404 returned error can't find the container with id 0fddfa358bf6cb17210d792eed5553e2ddfdcb921faa297483d0e840cbcfd1cf Jul 06 20:59:48.237180 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:48.237097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" event={"ID":"0225d135-bdb8-4c13-b027-f90b340fb97c","Type":"ContainerStarted","Data":"0fddfa358bf6cb17210d792eed5553e2ddfdcb921faa297483d0e840cbcfd1cf"} Jul 06 20:59:53.259000 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.258964 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" event={"ID":"0225d135-bdb8-4c13-b027-f90b340fb97c","Type":"ContainerStarted","Data":"7efa8050fc48e429c6fa80c58437d30581a095df249845a94347032b9065e32e"} Jul 06 20:59:53.259504 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.259042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" event={"ID":"0225d135-bdb8-4c13-b027-f90b340fb97c","Type":"ContainerStarted","Data":"87f7d1ebb873ea4b2f6f8d0c9bffe81cc5d7f487a64398cbe4d20dc40e5db14f"} Jul 06 20:59:53.260533 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.260509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc6957c8c-pl4p9" event={"ID":"fe64d326-d6d8-4008-8e9f-73269f197298","Type":"ContainerStarted","Data":"03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5"} Jul 06 20:59:53.262509 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.262486 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nb7t" event={"ID":"d1b92af3-a521-4d00-8123-5c5ff650ff4c","Type":"ContainerStarted","Data":"89b5a88c727d064541f03751a06dbc510e470d667a82aed22f76af6ad459e5de"} Jul 06 20:59:53.263957 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.263937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7pw2n" event={"ID":"1e754309-f51a-40f7-b0c7-e58bcca7a820","Type":"ContainerStarted","Data":"24f1164aa6d8390e330c53f6a7a0be21f41519abdac427fb9d88fd26e63ddab9"} Jul 06 20:59:53.264028 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.263989 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 20:59:53.266260 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.266229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-blvkk" event={"ID":"1c4bb39b-62ca-4410-a3c7-77f64860720b","Type":"ContainerStarted","Data":"5d19abf450f608fc8095775e3dbc43228aa0ea6097063bb7a44d266bacc99409"} Jul 06 20:59:53.266424 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.266295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-blvkk" event={"ID":"1c4bb39b-62ca-4410-a3c7-77f64860720b","Type":"ContainerStarted","Data":"75108fa9f581470d75f3f146d218f5e8e3070bc177d208e7bd37bde201930316"} Jul 06 20:59:53.273774 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.273728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fbbpk" event={"ID":"5aafc7fe-860b-4994-88e8-e28801d82bbc","Type":"ContainerStarted","Data":"62093fcade981692972bcd61aa51da35453ffe0af82a677bd3bbc8790e9318e3"} Jul 06 20:59:53.310764 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.310692 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4jjcm" podStartSLOduration=2.77049036 podStartE2EDuration="8.310672325s" totalImagesPullingTime="5.540181965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:53.310391322 +0000 UTC m=+73.883790633" watchObservedRunningTime="2026-07-06 20:59:53.310672325 +0000 UTC m=+73.884071610" Jul 06 20:59:53.331922 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.331870 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-blvkk" podStartSLOduration=66.743343395 podStartE2EDuration="1m13.33185149s" totalImagesPullingTime="6.588508095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:53.331171813 +0000 UTC m=+73.904571167" watchObservedRunningTime="2026-07-06 20:59:53.33185149 +0000 UTC m=+73.905250775" Jul 06 20:59:53.359076 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.358963 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9nb7t" podStartSLOduration=1.151184681 podStartE2EDuration="14.358948028s" totalImagesPullingTime="13.207763347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:59:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:53.358689877 +0000 UTC m=+73.932089161" watchObservedRunningTime="2026-07-06 20:59:53.358948028 +0000 UTC m=+73.932347307" Jul 06 20:59:53.391395 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.391342 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7pw2n" podStartSLOduration=67.675684244 podStartE2EDuration="1m14.391325866s" totalImagesPullingTime="6.715641622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:53.388474536 +0000 UTC m=+73.961873819" watchObservedRunningTime="2026-07-06 20:59:53.391325866 +0000 UTC m=+73.964725150" Jul 06 20:59:53.421492 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.421437 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cc6957c8c-pl4p9" podStartSLOduration=1.518181739 podStartE2EDuration="9.421421545s" totalImagesPullingTime="7.903239806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:53.420776752 +0000 UTC m=+73.994176038" watchObservedRunningTime="2026-07-06 20:59:53.421421545 +0000 UTC m=+73.994820828" Jul 06 20:59:53.717188 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.717090 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fbbpk" podStartSLOduration=66.757170452 podStartE2EDuration="1m13.717068894s" totalImagesPullingTime="6.959898442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:53.44141198 +0000 UTC m=+74.014811263" watchObservedRunningTime="2026-07-06 20:59:53.717068894 +0000 UTC m=+74.290468156" Jul 06 20:59:53.717428 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.717412 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fbd465f9-c72fc"] Jul 06 20:59:53.720529 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.720514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.730472 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.730452 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 20:59:53.733709 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.733685 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fbd465f9-c72fc"] Jul 06 20:59:53.761763 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.761728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-service-ca\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.761763 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.761762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-oauth-config\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.761948 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.761788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-trusted-ca-bundle\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.761948 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.761818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-console-config\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.761948 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.761870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-oauth-serving-cert\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.761948 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.761899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8ct6\" (UniqueName: \"kubernetes.io/projected/3ca11738-8817-49ef-b617-2262f55a0222-kube-api-access-j8ct6\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.762104 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.761948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-serving-cert\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.862814 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.862780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-console-config\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.862947 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.862818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-oauth-serving-cert\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.862947 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.862835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8ct6\" (UniqueName: \"kubernetes.io/projected/3ca11738-8817-49ef-b617-2262f55a0222-kube-api-access-j8ct6\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.862947 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.862865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-serving-cert\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.862947 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.862897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-service-ca\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.862947 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.862914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-oauth-config\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.863245 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.862949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-trusted-ca-bundle\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.863771 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.863739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-console-config\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.863876 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.863775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-service-ca\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.863943 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.863886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-oauth-serving-cert\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.863943 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.863888 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-trusted-ca-bundle\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.865348 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.865328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-serving-cert\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.865437 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.865363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-oauth-config\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:53.872747 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:53.872719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8ct6\" (UniqueName: \"kubernetes.io/projected/3ca11738-8817-49ef-b617-2262f55a0222-kube-api-access-j8ct6\") pod \"console-54fbd465f9-c72fc\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:54.029102 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.028999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 20:59:54.163873 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.163839 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fbd465f9-c72fc"] Jul 06 20:59:54.167092 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:54.167067 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca11738_8817_49ef_b617_2262f55a0222.slice/crio-198b4c43bdc0c5e16d20d6ac7cd3d75158d8e61eb192286e32b8e46e8a76fa3a WatchSource:0}: Error finding container 198b4c43bdc0c5e16d20d6ac7cd3d75158d8e61eb192286e32b8e46e8a76fa3a: Status 404 returned error can't find the container with id 198b4c43bdc0c5e16d20d6ac7cd3d75158d8e61eb192286e32b8e46e8a76fa3a Jul 06 20:59:54.279423 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.279304 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fbd465f9-c72fc" event={"ID":"3ca11738-8817-49ef-b617-2262f55a0222","Type":"ContainerStarted","Data":"7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3"} Jul 06 20:59:54.279423 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.279371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fbd465f9-c72fc" event={"ID":"3ca11738-8817-49ef-b617-2262f55a0222","Type":"ContainerStarted","Data":"198b4c43bdc0c5e16d20d6ac7cd3d75158d8e61eb192286e32b8e46e8a76fa3a"} Jul 06 20:59:54.312932 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.312878 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54fbd465f9-c72fc" podStartSLOduration=1.312857913 podStartE2EDuration="1.312857913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:54.312582239 +0000 UTC m=+74.885981523" watchObservedRunningTime="2026-07-06 20:59:54.312857913 +0000 UTC m=+74.886257199" Jul 06 20:59:54.727226 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.727163 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:54.727401 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.727253 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:54.731945 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:54.731919 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:55.227811 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:55.227776 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7lk57" Jul 06 20:59:55.287714 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:55.287689 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 20:59:59.417312 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.417274 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz"] Jul 06 20:59:59.424441 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.424414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.426831 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.426812 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 20:59:59.427107 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.427091 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:59:59.427232 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.427202 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lfplb\"" Jul 06 20:59:59.443261 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.443240 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz"] Jul 06 20:59:59.472111 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.472083 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6cz68"] Jul 06 20:59:59.475219 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.475193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.477732 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.477710 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tj46g\"" Jul 06 20:59:59.478159 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.478143 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:59:59.478800 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.478778 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:59:59.478800 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.478791 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:59:59.502948 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.502922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wlb6\" (UniqueName: \"kubernetes.io/projected/d35d9d1f-60c2-47d0-9ea6-f998511d854d-kube-api-access-4wlb6\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.503124 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.502957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d35d9d1f-60c2-47d0-9ea6-f998511d854d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.503124 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.502980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.503124 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.502999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.604277 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d35d9d1f-60c2-47d0-9ea6-f998511d854d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.604277 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-tls\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604528 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.604528 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.604528 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d4f4\" (UniqueName: \"kubernetes.io/projected/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-kube-api-access-6d4f4\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604528 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-sys\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604528 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:59.604436 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 20:59:59.604528 ip-10-0-136-218 kubenswrapper[2562]: E0706 20:59:59.604501 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-tls podName:d35d9d1f-60c2-47d0-9ea6-f998511d854d nodeName:}" failed. No retries permitted until 2026-07-06 21:00:00.104485423 +0000 UTC m=+80.677884685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-2ngjz" (UID: "d35d9d1f-60c2-47d0-9ea6-f998511d854d") : secret "openshift-state-metrics-tls" not found Jul 06 20:59:59.604528 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-metrics-client-ca\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604831 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-root\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604831 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604831 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604831 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wlb6\" (UniqueName: \"kubernetes.io/projected/d35d9d1f-60c2-47d0-9ea6-f998511d854d-kube-api-access-4wlb6\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.604831 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-textfile\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.604831 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-wtmp\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.605057 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.604936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d35d9d1f-60c2-47d0-9ea6-f998511d854d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.606897 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.606879 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.617854 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.617817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wlb6\" (UniqueName: \"kubernetes.io/projected/d35d9d1f-60c2-47d0-9ea6-f998511d854d-kube-api-access-4wlb6\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 20:59:59.705334 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-root\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705334 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705334 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705565 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-root\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705565 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-textfile\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705565 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-wtmp\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705565 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-tls\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705750 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4f4\" (UniqueName: \"kubernetes.io/projected/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-kube-api-access-6d4f4\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705750 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-sys\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705750 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-metrics-client-ca\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705750 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-wtmp\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705750 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-textfile\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705945 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-sys\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.705984 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.705939 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.706182 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.706162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-metrics-client-ca\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.707775 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.707754 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.707857 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.707775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-node-exporter-tls\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.715723 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.715698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d4f4\" (UniqueName: \"kubernetes.io/projected/2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c-kube-api-access-6d4f4\") pod \"node-exporter-6cz68\" (UID: \"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c\") " pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.783599 ip-10-0-136-218 kubenswrapper[2562]: I0706 20:59:59.783569 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cz68" Jul 06 20:59:59.794778 ip-10-0-136-218 kubenswrapper[2562]: W0706 20:59:59.794754 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfdb5ef_7077_4802_9d53_b7dfd8ecc10c.slice/crio-35966e7d0a6b97f008de7f97ea48d28f31519f623dfe961fa8f6e2a678c85e0a WatchSource:0}: Error finding container 35966e7d0a6b97f008de7f97ea48d28f31519f623dfe961fa8f6e2a678c85e0a: Status 404 returned error can't find the container with id 35966e7d0a6b97f008de7f97ea48d28f31519f623dfe961fa8f6e2a678c85e0a Jul 06 21:00:00.109334 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:00.109287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 21:00:00.111710 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:00.111664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d35d9d1f-60c2-47d0-9ea6-f998511d854d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2ngjz\" (UID: \"d35d9d1f-60c2-47d0-9ea6-f998511d854d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 21:00:00.301799 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:00.301762 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cz68" event={"ID":"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c","Type":"ContainerStarted","Data":"35966e7d0a6b97f008de7f97ea48d28f31519f623dfe961fa8f6e2a678c85e0a"} Jul 06 21:00:00.334195 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:00.334163 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" Jul 06 21:00:00.494207 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:00.494181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz"] Jul 06 21:00:00.494918 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:00:00.494890 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35d9d1f_60c2_47d0_9ea6_f998511d854d.slice/crio-13fb702c2644433f3420860d6a43d43e3c0f0514f1b3bef32367f952fd3ee7d3 WatchSource:0}: Error finding container 13fb702c2644433f3420860d6a43d43e3c0f0514f1b3bef32367f952fd3ee7d3: Status 404 returned error can't find the container with id 13fb702c2644433f3420860d6a43d43e3c0f0514f1b3bef32367f952fd3ee7d3 Jul 06 21:00:01.309970 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.309881 2562 generic.go:356] "Generic (PLEG): container finished" podID="2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c" containerID="61e584e6e55184d898895250f2e05695a6e28b413f3a29ca4d25ae49fe56e8c1" exitCode=0 Jul 06 21:00:01.310129 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.309968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cz68" event={"ID":"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c","Type":"ContainerDied","Data":"61e584e6e55184d898895250f2e05695a6e28b413f3a29ca4d25ae49fe56e8c1"} Jul 06 21:00:01.311888 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.311865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" event={"ID":"d35d9d1f-60c2-47d0-9ea6-f998511d854d","Type":"ContainerStarted","Data":"f8a7aae1326c4ab85212776941b749e5ec6e5ed926555ec46b97d224bef883d9"} Jul 06 21:00:01.312017 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.311918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" event={"ID":"d35d9d1f-60c2-47d0-9ea6-f998511d854d","Type":"ContainerStarted","Data":"2c35439de34b6eb86aa6ce465a1dd06bb52afe13995702c5960a745766617ec4"} Jul 06 21:00:01.312017 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.311946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" event={"ID":"d35d9d1f-60c2-47d0-9ea6-f998511d854d","Type":"ContainerStarted","Data":"13fb702c2644433f3420860d6a43d43e3c0f0514f1b3bef32367f952fd3ee7d3"} Jul 06 21:00:01.588554 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.588522 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c67df98db-b9gx9"] Jul 06 21:00:01.592391 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.592352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.597442 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.597419 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 21:00:01.597594 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.597421 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 21:00:01.598490 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.598468 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 21:00:01.598599 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.598508 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 21:00:01.599056 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.599035 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-v4wwt\"" Jul 06 21:00:01.599326 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.599309 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c5eoudrqj51g8\"" Jul 06 21:00:01.599456 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.599434 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 21:00:01.612164 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.612134 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c67df98db-b9gx9"] Jul 06 21:00:01.723622 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723582 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.723803 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723631 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.723803 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-grpc-tls\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.723803 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kng72\" (UniqueName: \"kubernetes.io/projected/0c141178-4b66-44b5-ad91-f0edf7bad2c7-kube-api-access-kng72\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.723803 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.723803 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.724017 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-tls\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.724017 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.723879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c141178-4b66-44b5-ad91-f0edf7bad2c7-metrics-client-ca\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.824619 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.824818 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824633 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.824818 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-grpc-tls\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.824930 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kng72\" (UniqueName: \"kubernetes.io/projected/0c141178-4b66-44b5-ad91-f0edf7bad2c7-kube-api-access-kng72\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.824930 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.824930 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.825066 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-tls\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.825066 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.824997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c141178-4b66-44b5-ad91-f0edf7bad2c7-metrics-client-ca\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.825825 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.825789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c141178-4b66-44b5-ad91-f0edf7bad2c7-metrics-client-ca\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.827841 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.827818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-grpc-tls\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.828258 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.828238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.828391 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.828359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-tls\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.828666 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.828641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.828903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.828870 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.829047 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.829025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c141178-4b66-44b5-ad91-f0edf7bad2c7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.836992 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.836966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kng72\" (UniqueName: \"kubernetes.io/projected/0c141178-4b66-44b5-ad91-f0edf7bad2c7-kube-api-access-kng72\") pod \"thanos-querier-5c67df98db-b9gx9\" (UID: \"0c141178-4b66-44b5-ad91-f0edf7bad2c7\") " pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:01.903730 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:01.903705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:02.058535 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.058510 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c67df98db-b9gx9"] Jul 06 21:00:02.060319 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:00:02.060293 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c141178_4b66_44b5_ad91_f0edf7bad2c7.slice/crio-2ae2a0b7dd198a6f9275a1ac8c4b3ec72451aed640774161f54374e61f3eee22 WatchSource:0}: Error finding container 2ae2a0b7dd198a6f9275a1ac8c4b3ec72451aed640774161f54374e61f3eee22: Status 404 returned error can't find the container with id 2ae2a0b7dd198a6f9275a1ac8c4b3ec72451aed640774161f54374e61f3eee22 Jul 06 21:00:02.201906 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.201769 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8f767dfcb-xlmkk" Jul 06 21:00:02.317908 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.317870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" event={"ID":"d35d9d1f-60c2-47d0-9ea6-f998511d854d","Type":"ContainerStarted","Data":"ae01b2ed9799913efeec76b74c9b8e9ef605cdab0479a1cea0845a996996c724"} Jul 06 21:00:02.319379 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.319347 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" event={"ID":"0c141178-4b66-44b5-ad91-f0edf7bad2c7","Type":"ContainerStarted","Data":"2ae2a0b7dd198a6f9275a1ac8c4b3ec72451aed640774161f54374e61f3eee22"} Jul 06 21:00:02.321529 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.321493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cz68" event={"ID":"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c","Type":"ContainerStarted","Data":"fa5f954b7af28de32b55947c6d47c286bc83f8fc506054d4ef2593fdae2ac890"} Jul 06 21:00:02.321647 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.321538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cz68" event={"ID":"2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c","Type":"ContainerStarted","Data":"ba39deb8b6679d69d17a2ef7d3e5667920b8413633874189d0320d99f6647d98"} Jul 06 21:00:02.354178 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.354128 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2ngjz" podStartSLOduration=2.104880848 podStartE2EDuration="3.354112999s" totalImagesPullingTime="1.249232151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:02.353536784 +0000 UTC m=+82.926936070" watchObservedRunningTime="2026-07-06 21:00:02.354112999 +0000 UTC m=+82.927512283" Jul 06 21:00:02.383403 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:02.383167 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6cz68" podStartSLOduration=2.268280673 podStartE2EDuration="3.383144359s" totalImagesPullingTime="1.05233678s" totalInitContainerRuntime="62.526906ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:02.381859872 +0000 UTC m=+82.955259149" watchObservedRunningTime="2026-07-06 21:00:02.383144359 +0000 UTC m=+82.956543645" Jul 06 21:00:04.029432 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:04.029393 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 21:00:04.029912 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:04.029491 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 21:00:04.034877 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:04.034848 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 21:00:04.335050 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:04.334875 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" event={"ID":"0c141178-4b66-44b5-ad91-f0edf7bad2c7","Type":"ContainerStarted","Data":"204e93e1978e7f23cdc668cd5bab052e011428c4fbdf430f843938eaa66faa32"} Jul 06 21:00:04.335050 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:04.334953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" event={"ID":"0c141178-4b66-44b5-ad91-f0edf7bad2c7","Type":"ContainerStarted","Data":"baa1b64ffe0f191a7f1620ab8d7c803f49dbeb1b2aade24cceb29df6928f0f20"} Jul 06 21:00:04.338546 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:04.338525 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 21:00:04.409401 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:04.409373 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc6957c8c-pl4p9"] Jul 06 21:00:05.340369 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:05.340334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" event={"ID":"0c141178-4b66-44b5-ad91-f0edf7bad2c7","Type":"ContainerStarted","Data":"e167ef9bddb83cd9fba3137708ae7f08bda1541f48fe7eea36bbab50cc262d16"} Jul 06 21:00:05.988303 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:05.986362 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d6758dd5f-qxbq6"] Jul 06 21:00:05.991070 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:05.991048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.007912 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.007884 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6758dd5f-qxbq6"] Jul 06 21:00:06.062719 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.062680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-trusted-ca-bundle\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.062912 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.062795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-service-ca\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.062912 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.062839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-serving-cert\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.063034 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.062956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-oauth-config\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.063034 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.062996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-oauth-serving-cert\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.063137 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.063042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pd4v\" (UniqueName: \"kubernetes.io/projected/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-kube-api-access-4pd4v\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.063137 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.063110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-config\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.163929 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.163897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-serving-cert\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.164111 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.163943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-oauth-config\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.164111 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.163961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-oauth-serving-cert\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.164111 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.163986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pd4v\" (UniqueName: \"kubernetes.io/projected/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-kube-api-access-4pd4v\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.164111 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.164014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-config\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.164111 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.164043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-trusted-ca-bundle\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.164111 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.164068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-service-ca\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.164883 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.164857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-config\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.165009 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.164893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-oauth-serving-cert\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.165009 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.164966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-service-ca\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.165126 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.165030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-trusted-ca-bundle\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.166461 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.166441 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-oauth-config\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.166564 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.166541 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-serving-cert\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.179029 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.179005 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pd4v\" (UniqueName: \"kubernetes.io/projected/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-kube-api-access-4pd4v\") pod \"console-7d6758dd5f-qxbq6\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.300269 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.300171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:06.348709 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.348673 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" event={"ID":"0c141178-4b66-44b5-ad91-f0edf7bad2c7","Type":"ContainerStarted","Data":"419fb100fbcea1022eb98f28b8a3d8d4626b889dc81b4887063090be0ec899f3"} Jul 06 21:00:06.349205 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.348830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:06.349205 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.348929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" event={"ID":"0c141178-4b66-44b5-ad91-f0edf7bad2c7","Type":"ContainerStarted","Data":"1ea11dff67540c79e5f87623cfd7fc98d92a3d6e7dd44f1bddf9cb5ec72f0dd4"} Jul 06 21:00:06.349205 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.348989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" event={"ID":"0c141178-4b66-44b5-ad91-f0edf7bad2c7","Type":"ContainerStarted","Data":"5c76ca6ad75527f13d843b62c22d139ddfc3ae61a166e46389277b8861506f6a"} Jul 06 21:00:06.380851 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.380744 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" podStartSLOduration=2.317745238 podStartE2EDuration="5.380719734s" totalImagesPullingTime="3.062974496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:00:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:06.379920791 +0000 UTC m=+86.953320108" watchObservedRunningTime="2026-07-06 21:00:06.380719734 +0000 UTC m=+86.954119019" Jul 06 21:00:06.458005 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:06.457901 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6758dd5f-qxbq6"] Jul 06 21:00:06.460131 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:00:06.460088 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d75c9bf_afe5_45e8_a99f_a882f27ef26a.slice/crio-893e68dea5c191fa4fa99c3cdf2c29130774983d7e51b0b90e76394399b5a856 WatchSource:0}: Error finding container 893e68dea5c191fa4fa99c3cdf2c29130774983d7e51b0b90e76394399b5a856: Status 404 returned error can't find the container with id 893e68dea5c191fa4fa99c3cdf2c29130774983d7e51b0b90e76394399b5a856 Jul 06 21:00:07.353700 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:07.353666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6758dd5f-qxbq6" event={"ID":"9d75c9bf-afe5-45e8-a99f-a882f27ef26a","Type":"ContainerStarted","Data":"97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f"} Jul 06 21:00:07.354126 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:07.353718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6758dd5f-qxbq6" event={"ID":"9d75c9bf-afe5-45e8-a99f-a882f27ef26a","Type":"ContainerStarted","Data":"893e68dea5c191fa4fa99c3cdf2c29130774983d7e51b0b90e76394399b5a856"} Jul 06 21:00:07.379441 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:07.379386 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d6758dd5f-qxbq6" podStartSLOduration=2.379368678 podStartE2EDuration="2.379368678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:07.377584063 +0000 UTC m=+87.950983347" watchObservedRunningTime="2026-07-06 21:00:07.379368678 +0000 UTC m=+87.952767963" Jul 06 21:00:12.360560 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:12.360535 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c67df98db-b9gx9" Jul 06 21:00:16.301028 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:16.300992 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:16.301514 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:16.301052 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:16.305874 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:16.305855 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:16.389341 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:16.389307 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:00:16.450102 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:16.450074 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fbd465f9-c72fc"] Jul 06 21:00:24.281564 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:24.281530 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7pw2n" Jul 06 21:00:29.430340 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.430278 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-cc6957c8c-pl4p9" podUID="fe64d326-d6d8-4008-8e9f-73269f197298" containerName="console" containerID="cri-o://03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5" gracePeriod=15 Jul 06 21:00:29.666292 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.666271 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 21:00:29.767855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.767769 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-oauth-serving-cert\") pod \"fe64d326-d6d8-4008-8e9f-73269f197298\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " Jul 06 21:00:29.767855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.767810 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzdjn\" (UniqueName: \"kubernetes.io/projected/fe64d326-d6d8-4008-8e9f-73269f197298-kube-api-access-gzdjn\") pod \"fe64d326-d6d8-4008-8e9f-73269f197298\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " Jul 06 21:00:29.767855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.767850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-service-ca\") pod \"fe64d326-d6d8-4008-8e9f-73269f197298\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " Jul 06 21:00:29.768115 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.767891 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-console-config\") pod \"fe64d326-d6d8-4008-8e9f-73269f197298\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " Jul 06 21:00:29.768115 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.767915 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-oauth-config\") pod \"fe64d326-d6d8-4008-8e9f-73269f197298\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " Jul 06 21:00:29.768115 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.767942 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-serving-cert\") pod \"fe64d326-d6d8-4008-8e9f-73269f197298\" (UID: \"fe64d326-d6d8-4008-8e9f-73269f197298\") " Jul 06 21:00:29.768322 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.768290 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe64d326-d6d8-4008-8e9f-73269f197298" (UID: "fe64d326-d6d8-4008-8e9f-73269f197298"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:29.768389 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.768323 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-console-config" (OuterVolumeSpecName: "console-config") pod "fe64d326-d6d8-4008-8e9f-73269f197298" (UID: "fe64d326-d6d8-4008-8e9f-73269f197298"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:29.768389 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.768333 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe64d326-d6d8-4008-8e9f-73269f197298" (UID: "fe64d326-d6d8-4008-8e9f-73269f197298"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:29.770193 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.770165 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe64d326-d6d8-4008-8e9f-73269f197298-kube-api-access-gzdjn" (OuterVolumeSpecName: "kube-api-access-gzdjn") pod "fe64d326-d6d8-4008-8e9f-73269f197298" (UID: "fe64d326-d6d8-4008-8e9f-73269f197298"). InnerVolumeSpecName "kube-api-access-gzdjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:29.770193 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.770171 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe64d326-d6d8-4008-8e9f-73269f197298" (UID: "fe64d326-d6d8-4008-8e9f-73269f197298"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:00:29.770424 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.770238 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe64d326-d6d8-4008-8e9f-73269f197298" (UID: "fe64d326-d6d8-4008-8e9f-73269f197298"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:00:29.869266 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.869239 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-oauth-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:29.869266 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.869263 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzdjn\" (UniqueName: \"kubernetes.io/projected/fe64d326-d6d8-4008-8e9f-73269f197298-kube-api-access-gzdjn\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:29.869266 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.869273 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-service-ca\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:29.869266 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.869282 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe64d326-d6d8-4008-8e9f-73269f197298-console-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:29.869519 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.869290 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-oauth-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:29.869519 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:29.869298 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe64d326-d6d8-4008-8e9f-73269f197298-console-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:30.435344 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.435304 2562 generic.go:356] "Generic (PLEG): container finished" podID="fe64d326-d6d8-4008-8e9f-73269f197298" containerID="03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5" exitCode=0 Jul 06 21:00:30.435719 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.435355 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc6957c8c-pl4p9" Jul 06 21:00:30.435719 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.435367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc6957c8c-pl4p9" event={"ID":"fe64d326-d6d8-4008-8e9f-73269f197298","Type":"ContainerDied","Data":"03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5"} Jul 06 21:00:30.435719 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.435417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc6957c8c-pl4p9" event={"ID":"fe64d326-d6d8-4008-8e9f-73269f197298","Type":"ContainerDied","Data":"5278122b433c07bb7dc6e9bf01df48a14c9be6d962b33aa373af112f6c4b59e4"} Jul 06 21:00:30.435719 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.435444 2562 scope.go:117] "RemoveContainer" containerID="03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5" Jul 06 21:00:30.443267 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.443248 2562 scope.go:117] "RemoveContainer" containerID="03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5" Jul 06 21:00:30.443501 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:00:30.443482 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5\": container with ID starting with 03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5 not found: ID does not exist" containerID="03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5" Jul 06 21:00:30.443562 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.443510 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5"} err="failed to get container status \"03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5\": rpc error: code = NotFound desc = could not find container \"03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5\": container with ID starting with 03731484125a5849350c1bf3116a319fa8493b23cb1562aadaa71518ae79c3c5 not found: ID does not exist" Jul 06 21:00:30.464959 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.464931 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc6957c8c-pl4p9"] Jul 06 21:00:30.468462 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:30.468412 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cc6957c8c-pl4p9"] Jul 06 21:00:31.941338 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:31.941305 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe64d326-d6d8-4008-8e9f-73269f197298" path="/var/lib/kubelet/pods/fe64d326-d6d8-4008-8e9f-73269f197298/volumes" Jul 06 21:00:41.470132 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.470088 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54fbd465f9-c72fc" podUID="3ca11738-8817-49ef-b617-2262f55a0222" containerName="console" containerID="cri-o://7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3" gracePeriod=15 Jul 06 21:00:41.715084 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.715063 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 21:00:41.756073 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756001 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-service-ca\") pod \"3ca11738-8817-49ef-b617-2262f55a0222\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " Jul 06 21:00:41.756073 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756032 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-serving-cert\") pod \"3ca11738-8817-49ef-b617-2262f55a0222\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " Jul 06 21:00:41.756073 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756053 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-oauth-config\") pod \"3ca11738-8817-49ef-b617-2262f55a0222\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " Jul 06 21:00:41.756366 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756101 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-oauth-serving-cert\") pod \"3ca11738-8817-49ef-b617-2262f55a0222\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " Jul 06 21:00:41.756366 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756145 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-console-config\") pod \"3ca11738-8817-49ef-b617-2262f55a0222\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " Jul 06 21:00:41.756366 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756171 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-trusted-ca-bundle\") pod \"3ca11738-8817-49ef-b617-2262f55a0222\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " Jul 06 21:00:41.756366 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756193 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8ct6\" (UniqueName: \"kubernetes.io/projected/3ca11738-8817-49ef-b617-2262f55a0222-kube-api-access-j8ct6\") pod \"3ca11738-8817-49ef-b617-2262f55a0222\" (UID: \"3ca11738-8817-49ef-b617-2262f55a0222\") " Jul 06 21:00:41.756578 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756550 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ca11738-8817-49ef-b617-2262f55a0222" (UID: "3ca11738-8817-49ef-b617-2262f55a0222"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:41.756853 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756764 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-console-config" (OuterVolumeSpecName: "console-config") pod "3ca11738-8817-49ef-b617-2262f55a0222" (UID: "3ca11738-8817-49ef-b617-2262f55a0222"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:41.756853 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756829 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ca11738-8817-49ef-b617-2262f55a0222" (UID: "3ca11738-8817-49ef-b617-2262f55a0222"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:41.757048 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.756850 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ca11738-8817-49ef-b617-2262f55a0222" (UID: "3ca11738-8817-49ef-b617-2262f55a0222"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:41.758287 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.758257 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ca11738-8817-49ef-b617-2262f55a0222" (UID: "3ca11738-8817-49ef-b617-2262f55a0222"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:00:41.758402 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.758307 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ca11738-8817-49ef-b617-2262f55a0222" (UID: "3ca11738-8817-49ef-b617-2262f55a0222"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:00:41.758402 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.758329 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca11738-8817-49ef-b617-2262f55a0222-kube-api-access-j8ct6" (OuterVolumeSpecName: "kube-api-access-j8ct6") pod "3ca11738-8817-49ef-b617-2262f55a0222" (UID: "3ca11738-8817-49ef-b617-2262f55a0222"). InnerVolumeSpecName "kube-api-access-j8ct6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:41.857232 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.857168 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-oauth-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:41.857232 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.857197 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-oauth-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:41.857232 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.857207 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-console-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:41.857232 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.857234 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-trusted-ca-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:41.857232 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.857243 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8ct6\" (UniqueName: \"kubernetes.io/projected/3ca11738-8817-49ef-b617-2262f55a0222-kube-api-access-j8ct6\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:41.857511 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.857251 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca11738-8817-49ef-b617-2262f55a0222-service-ca\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:41.857511 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:41.857261 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca11738-8817-49ef-b617-2262f55a0222-console-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:00:42.483008 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.482975 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ca11738-8817-49ef-b617-2262f55a0222" containerID="7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3" exitCode=0 Jul 06 21:00:42.483569 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.483030 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fbd465f9-c72fc" Jul 06 21:00:42.483569 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.483067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fbd465f9-c72fc" event={"ID":"3ca11738-8817-49ef-b617-2262f55a0222","Type":"ContainerDied","Data":"7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3"} Jul 06 21:00:42.483569 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.483124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fbd465f9-c72fc" event={"ID":"3ca11738-8817-49ef-b617-2262f55a0222","Type":"ContainerDied","Data":"198b4c43bdc0c5e16d20d6ac7cd3d75158d8e61eb192286e32b8e46e8a76fa3a"} Jul 06 21:00:42.483569 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.483153 2562 scope.go:117] "RemoveContainer" containerID="7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3" Jul 06 21:00:42.490921 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.490895 2562 scope.go:117] "RemoveContainer" containerID="7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3" Jul 06 21:00:42.491169 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:00:42.491150 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3\": container with ID starting with 7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3 not found: ID does not exist" containerID="7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3" Jul 06 21:00:42.491253 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.491178 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3"} err="failed to get container status \"7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3\": rpc error: code = NotFound desc = could not find container \"7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3\": container with ID starting with 7b931f2f9890c31f643c4cef35b4409ce57a126e2deb6fbd26043d31bd3099b3 not found: ID does not exist" Jul 06 21:00:42.506189 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.506161 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fbd465f9-c72fc"] Jul 06 21:00:42.516727 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:42.516675 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54fbd465f9-c72fc"] Jul 06 21:00:43.940971 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:00:43.940929 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca11738-8817-49ef-b617-2262f55a0222" path="/var/lib/kubelet/pods/3ca11738-8817-49ef-b617-2262f55a0222/volumes" Jul 06 21:01:49.837007 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.836972 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6bb586c9-6dkk7"] Jul 06 21:01:49.837505 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.837252 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe64d326-d6d8-4008-8e9f-73269f197298" containerName="console" Jul 06 21:01:49.837505 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.837263 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe64d326-d6d8-4008-8e9f-73269f197298" containerName="console" Jul 06 21:01:49.837505 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.837285 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca11738-8817-49ef-b617-2262f55a0222" containerName="console" Jul 06 21:01:49.837505 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.837290 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca11738-8817-49ef-b617-2262f55a0222" containerName="console" Jul 06 21:01:49.837505 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.837331 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe64d326-d6d8-4008-8e9f-73269f197298" containerName="console" Jul 06 21:01:49.837505 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.837341 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca11738-8817-49ef-b617-2262f55a0222" containerName="console" Jul 06 21:01:49.841621 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.841600 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.859240 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.859164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6bb586c9-6dkk7"] Jul 06 21:01:49.872437 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.872410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-serving-cert\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.872437 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.872444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-trusted-ca-bundle\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.872656 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.872474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-oauth-serving-cert\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.872656 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.872539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z7ww\" (UniqueName: \"kubernetes.io/projected/c1c75b7c-116c-4b9c-a035-3359128e3212-kube-api-access-7z7ww\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.872656 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.872594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-service-ca\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.872802 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.872670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-oauth-config\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.872802 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.872699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-console-config\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.973738 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.973696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-serving-cert\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.973949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.973748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-trusted-ca-bundle\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.973949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.973785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-oauth-serving-cert\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.973949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.973815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7ww\" (UniqueName: \"kubernetes.io/projected/c1c75b7c-116c-4b9c-a035-3359128e3212-kube-api-access-7z7ww\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.973949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.973860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-service-ca\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.974142 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.974093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-oauth-config\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.974142 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.974135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-console-config\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.974780 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.974755 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-oauth-serving-cert\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.974884 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.974778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-service-ca\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.974884 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.974843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-console-config\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.975008 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.974992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-trusted-ca-bundle\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.978076 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.976398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-serving-cert\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.978756 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.978732 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-oauth-config\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:49.995116 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:49.995090 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z7ww\" (UniqueName: \"kubernetes.io/projected/c1c75b7c-116c-4b9c-a035-3359128e3212-kube-api-access-7z7ww\") pod \"console-5c6bb586c9-6dkk7\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:50.152254 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:50.152124 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:01:50.298090 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:50.297933 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6bb586c9-6dkk7"] Jul 06 21:01:50.300707 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:01:50.300674 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c75b7c_116c_4b9c_a035_3359128e3212.slice/crio-d2c8e9c2bc8d8f385c61c2d6ac31df432c545d64a9c346a04d3bda1bdfb7d227 WatchSource:0}: Error finding container d2c8e9c2bc8d8f385c61c2d6ac31df432c545d64a9c346a04d3bda1bdfb7d227: Status 404 returned error can't find the container with id d2c8e9c2bc8d8f385c61c2d6ac31df432c545d64a9c346a04d3bda1bdfb7d227 Jul 06 21:01:50.725299 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:50.725262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb586c9-6dkk7" event={"ID":"c1c75b7c-116c-4b9c-a035-3359128e3212","Type":"ContainerStarted","Data":"86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349"} Jul 06 21:01:50.725509 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:50.725315 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb586c9-6dkk7" event={"ID":"c1c75b7c-116c-4b9c-a035-3359128e3212","Type":"ContainerStarted","Data":"d2c8e9c2bc8d8f385c61c2d6ac31df432c545d64a9c346a04d3bda1bdfb7d227"} Jul 06 21:01:50.747289 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:01:50.747227 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6bb586c9-6dkk7" podStartSLOduration=1.7471935219999999 podStartE2EDuration="1.747193522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:01:50.746582633 +0000 UTC m=+191.319981916" watchObservedRunningTime="2026-07-06 21:01:50.747193522 +0000 UTC m=+191.320592805" Jul 06 21:02:00.152915 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.152858 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:02:00.153356 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.152951 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:02:00.157715 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.157691 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:02:00.766896 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.766867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:02:00.827503 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.827476 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6758dd5f-qxbq6"] Jul 06 21:02:00.964187 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.964150 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd4f677d-qfftn"] Jul 06 21:02:00.967473 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.967456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:00.984246 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:00.984203 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd4f677d-qfftn"] Jul 06 21:02:01.054559 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.054455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-serving-cert\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.054559 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.054509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-oauth-serving-cert\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.054559 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.054530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-trusted-ca-bundle\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.054559 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.054548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbfcc\" (UniqueName: \"kubernetes.io/projected/8136fffc-0efa-4bc1-8691-f7af8628400b-kube-api-access-mbfcc\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.054810 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.054648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-service-ca\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.054810 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.054687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-oauth-config\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.054810 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.054710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-console-config\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.155820 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.155776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-serving-cert\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.155820 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.155825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-oauth-serving-cert\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156344 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.155847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-trusted-ca-bundle\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156344 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.155968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbfcc\" (UniqueName: \"kubernetes.io/projected/8136fffc-0efa-4bc1-8691-f7af8628400b-kube-api-access-mbfcc\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156344 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.156085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-service-ca\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156344 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.156119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-oauth-config\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156344 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.156151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-console-config\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156691 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.156667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-oauth-serving-cert\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156865 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.156835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-service-ca\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156994 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.156847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-console-config\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.156994 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.156987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-trusted-ca-bundle\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.158482 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.158458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-oauth-config\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.158615 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.158600 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-serving-cert\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.166628 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.166597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbfcc\" (UniqueName: \"kubernetes.io/projected/8136fffc-0efa-4bc1-8691-f7af8628400b-kube-api-access-mbfcc\") pod \"console-6dd4f677d-qfftn\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.276579 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.276530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:01.408554 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.408522 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd4f677d-qfftn"] Jul 06 21:02:01.410947 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:02:01.410921 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8136fffc_0efa_4bc1_8691_f7af8628400b.slice/crio-4b4d397c0993386acf5c337cf99d64a0cfe47f57dc47434a1ce97388ebbb04d7 WatchSource:0}: Error finding container 4b4d397c0993386acf5c337cf99d64a0cfe47f57dc47434a1ce97388ebbb04d7: Status 404 returned error can't find the container with id 4b4d397c0993386acf5c337cf99d64a0cfe47f57dc47434a1ce97388ebbb04d7 Jul 06 21:02:01.767917 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.767880 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4f677d-qfftn" event={"ID":"8136fffc-0efa-4bc1-8691-f7af8628400b","Type":"ContainerStarted","Data":"7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d"} Jul 06 21:02:01.768097 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.767943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4f677d-qfftn" event={"ID":"8136fffc-0efa-4bc1-8691-f7af8628400b","Type":"ContainerStarted","Data":"4b4d397c0993386acf5c337cf99d64a0cfe47f57dc47434a1ce97388ebbb04d7"} Jul 06 21:02:01.790932 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:01.790882 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dd4f677d-qfftn" podStartSLOduration=1.790866045 podStartE2EDuration="1.790866045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:02:01.788992608 +0000 UTC m=+202.362391892" watchObservedRunningTime="2026-07-06 21:02:01.790866045 +0000 UTC m=+202.364265328" Jul 06 21:02:11.277173 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:11.277112 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:11.277173 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:11.277187 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:11.281919 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:11.281893 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:11.807223 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:11.807186 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:02:11.861720 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:11.861676 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6bb586c9-6dkk7"] Jul 06 21:02:25.848080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:25.848020 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d6758dd5f-qxbq6" podUID="9d75c9bf-afe5-45e8-a99f-a882f27ef26a" containerName="console" containerID="cri-o://97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f" gracePeriod=15 Jul 06 21:02:26.090722 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.090698 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:02:26.164259 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164159 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-serving-cert\") pod \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " Jul 06 21:02:26.164259 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164200 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-oauth-config\") pod \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " Jul 06 21:02:26.164259 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164238 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-oauth-serving-cert\") pod \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " Jul 06 21:02:26.164549 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164420 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-config\") pod \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " Jul 06 21:02:26.164549 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164474 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pd4v\" (UniqueName: \"kubernetes.io/projected/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-kube-api-access-4pd4v\") pod \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " Jul 06 21:02:26.164549 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164520 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-trusted-ca-bundle\") pod \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " Jul 06 21:02:26.164712 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164564 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-service-ca\") pod \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\" (UID: \"9d75c9bf-afe5-45e8-a99f-a882f27ef26a\") " Jul 06 21:02:26.164712 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164639 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9d75c9bf-afe5-45e8-a99f-a882f27ef26a" (UID: "9d75c9bf-afe5-45e8-a99f-a882f27ef26a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:26.164842 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164823 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-oauth-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:26.164903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164860 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-config" (OuterVolumeSpecName: "console-config") pod "9d75c9bf-afe5-45e8-a99f-a882f27ef26a" (UID: "9d75c9bf-afe5-45e8-a99f-a882f27ef26a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:26.165052 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.164969 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9d75c9bf-afe5-45e8-a99f-a882f27ef26a" (UID: "9d75c9bf-afe5-45e8-a99f-a882f27ef26a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:26.165159 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.165135 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-service-ca" (OuterVolumeSpecName: "service-ca") pod "9d75c9bf-afe5-45e8-a99f-a882f27ef26a" (UID: "9d75c9bf-afe5-45e8-a99f-a882f27ef26a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:26.166474 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.166448 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9d75c9bf-afe5-45e8-a99f-a882f27ef26a" (UID: "9d75c9bf-afe5-45e8-a99f-a882f27ef26a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:02:26.166581 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.166481 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9d75c9bf-afe5-45e8-a99f-a882f27ef26a" (UID: "9d75c9bf-afe5-45e8-a99f-a882f27ef26a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:02:26.166624 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.166575 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-kube-api-access-4pd4v" (OuterVolumeSpecName: "kube-api-access-4pd4v") pod "9d75c9bf-afe5-45e8-a99f-a882f27ef26a" (UID: "9d75c9bf-afe5-45e8-a99f-a882f27ef26a"). InnerVolumeSpecName "kube-api-access-4pd4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:02:26.265441 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.265387 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:26.265441 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.265433 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pd4v\" (UniqueName: \"kubernetes.io/projected/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-kube-api-access-4pd4v\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:26.265441 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.265449 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-trusted-ca-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:26.265441 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.265461 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-service-ca\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:26.265724 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.265473 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:26.265724 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.265483 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75c9bf-afe5-45e8-a99f-a882f27ef26a-console-oauth-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:26.862634 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.862593 2562 generic.go:356] "Generic (PLEG): container finished" podID="9d75c9bf-afe5-45e8-a99f-a882f27ef26a" containerID="97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f" exitCode=0 Jul 06 21:02:26.863159 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.862638 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6758dd5f-qxbq6" Jul 06 21:02:26.863159 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.862682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6758dd5f-qxbq6" event={"ID":"9d75c9bf-afe5-45e8-a99f-a882f27ef26a","Type":"ContainerDied","Data":"97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f"} Jul 06 21:02:26.863159 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.862737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6758dd5f-qxbq6" event={"ID":"9d75c9bf-afe5-45e8-a99f-a882f27ef26a","Type":"ContainerDied","Data":"893e68dea5c191fa4fa99c3cdf2c29130774983d7e51b0b90e76394399b5a856"} Jul 06 21:02:26.863159 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.862768 2562 scope.go:117] "RemoveContainer" containerID="97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f" Jul 06 21:02:26.871084 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.871068 2562 scope.go:117] "RemoveContainer" containerID="97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f" Jul 06 21:02:26.871359 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:02:26.871339 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f\": container with ID starting with 97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f not found: ID does not exist" containerID="97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f" Jul 06 21:02:26.871431 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.871371 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f"} err="failed to get container status \"97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f\": rpc error: code = NotFound desc = could not find container \"97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f\": container with ID starting with 97b680a7bd3c4b689389115de00f129a8013f24206000e842b5375cc78ecf22f not found: ID does not exist" Jul 06 21:02:26.887138 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.887118 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6758dd5f-qxbq6"] Jul 06 21:02:26.888897 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:26.888877 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d6758dd5f-qxbq6"] Jul 06 21:02:27.944757 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:27.944720 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d75c9bf-afe5-45e8-a99f-a882f27ef26a" path="/var/lib/kubelet/pods/9d75c9bf-afe5-45e8-a99f-a882f27ef26a/volumes" Jul 06 21:02:36.882344 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:36.882303 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c6bb586c9-6dkk7" podUID="c1c75b7c-116c-4b9c-a035-3359128e3212" containerName="console" containerID="cri-o://86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349" gracePeriod=15 Jul 06 21:02:37.123286 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.123263 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:02:37.252992 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.252889 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-oauth-serving-cert\") pod \"c1c75b7c-116c-4b9c-a035-3359128e3212\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " Jul 06 21:02:37.252992 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.252960 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-trusted-ca-bundle\") pod \"c1c75b7c-116c-4b9c-a035-3359128e3212\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " Jul 06 21:02:37.252992 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.252995 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z7ww\" (UniqueName: \"kubernetes.io/projected/c1c75b7c-116c-4b9c-a035-3359128e3212-kube-api-access-7z7ww\") pod \"c1c75b7c-116c-4b9c-a035-3359128e3212\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " Jul 06 21:02:37.253286 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253014 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-console-config\") pod \"c1c75b7c-116c-4b9c-a035-3359128e3212\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " Jul 06 21:02:37.253286 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253049 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-oauth-config\") pod \"c1c75b7c-116c-4b9c-a035-3359128e3212\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " Jul 06 21:02:37.253286 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253067 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-serving-cert\") pod \"c1c75b7c-116c-4b9c-a035-3359128e3212\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " Jul 06 21:02:37.253286 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253096 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-service-ca\") pod \"c1c75b7c-116c-4b9c-a035-3359128e3212\" (UID: \"c1c75b7c-116c-4b9c-a035-3359128e3212\") " Jul 06 21:02:37.253485 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253453 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c1c75b7c-116c-4b9c-a035-3359128e3212" (UID: "c1c75b7c-116c-4b9c-a035-3359128e3212"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:37.253538 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253486 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c1c75b7c-116c-4b9c-a035-3359128e3212" (UID: "c1c75b7c-116c-4b9c-a035-3359128e3212"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:37.253602 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253575 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-console-config" (OuterVolumeSpecName: "console-config") pod "c1c75b7c-116c-4b9c-a035-3359128e3212" (UID: "c1c75b7c-116c-4b9c-a035-3359128e3212"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:37.253663 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.253621 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-service-ca" (OuterVolumeSpecName: "service-ca") pod "c1c75b7c-116c-4b9c-a035-3359128e3212" (UID: "c1c75b7c-116c-4b9c-a035-3359128e3212"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:02:37.255243 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.255200 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c1c75b7c-116c-4b9c-a035-3359128e3212" (UID: "c1c75b7c-116c-4b9c-a035-3359128e3212"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:02:37.255334 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.255223 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1c75b7c-116c-4b9c-a035-3359128e3212-kube-api-access-7z7ww" (OuterVolumeSpecName: "kube-api-access-7z7ww") pod "c1c75b7c-116c-4b9c-a035-3359128e3212" (UID: "c1c75b7c-116c-4b9c-a035-3359128e3212"). InnerVolumeSpecName "kube-api-access-7z7ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:02:37.255387 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.255367 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c1c75b7c-116c-4b9c-a035-3359128e3212" (UID: "c1c75b7c-116c-4b9c-a035-3359128e3212"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:02:37.354025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.353970 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-oauth-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:37.354025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.354015 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c75b7c-116c-4b9c-a035-3359128e3212-console-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:37.354025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.354026 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-service-ca\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:37.354025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.354036 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-oauth-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:37.354025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.354045 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-trusted-ca-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:37.354358 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.354053 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z7ww\" (UniqueName: \"kubernetes.io/projected/c1c75b7c-116c-4b9c-a035-3359128e3212-kube-api-access-7z7ww\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:37.354358 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.354065 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1c75b7c-116c-4b9c-a035-3359128e3212-console-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:02:37.903113 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.903078 2562 generic.go:356] "Generic (PLEG): container finished" podID="c1c75b7c-116c-4b9c-a035-3359128e3212" containerID="86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349" exitCode=0 Jul 06 21:02:37.903574 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.903121 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb586c9-6dkk7" Jul 06 21:02:37.903574 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.903137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb586c9-6dkk7" event={"ID":"c1c75b7c-116c-4b9c-a035-3359128e3212","Type":"ContainerDied","Data":"86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349"} Jul 06 21:02:37.903574 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.903179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb586c9-6dkk7" event={"ID":"c1c75b7c-116c-4b9c-a035-3359128e3212","Type":"ContainerDied","Data":"d2c8e9c2bc8d8f385c61c2d6ac31df432c545d64a9c346a04d3bda1bdfb7d227"} Jul 06 21:02:37.903574 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.903198 2562 scope.go:117] "RemoveContainer" containerID="86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349" Jul 06 21:02:37.912958 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.912943 2562 scope.go:117] "RemoveContainer" containerID="86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349" Jul 06 21:02:37.913338 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:02:37.913244 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349\": container with ID starting with 86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349 not found: ID does not exist" containerID="86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349" Jul 06 21:02:37.913338 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.913270 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349"} err="failed to get container status \"86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349\": rpc error: code = NotFound desc = could not find container \"86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349\": container with ID starting with 86b6533bf5941abcc8ce351e50311152aa00af78e7605e8565bee5fc7f990349 not found: ID does not exist" Jul 06 21:02:37.930479 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.930454 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6bb586c9-6dkk7"] Jul 06 21:02:37.940827 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:37.940807 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6bb586c9-6dkk7"] Jul 06 21:02:39.941544 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:02:39.941511 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1c75b7c-116c-4b9c-a035-3359128e3212" path="/var/lib/kubelet/pods/c1c75b7c-116c-4b9c-a035-3359128e3212/volumes" Jul 06 21:03:00.033397 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.033358 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q"] Jul 06 21:03:00.034022 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.033674 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d75c9bf-afe5-45e8-a99f-a882f27ef26a" containerName="console" Jul 06 21:03:00.034022 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.033687 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d75c9bf-afe5-45e8-a99f-a882f27ef26a" containerName="console" Jul 06 21:03:00.034022 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.033716 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1c75b7c-116c-4b9c-a035-3359128e3212" containerName="console" Jul 06 21:03:00.034022 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.033723 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1c75b7c-116c-4b9c-a035-3359128e3212" containerName="console" Jul 06 21:03:00.034022 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.033770 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1c75b7c-116c-4b9c-a035-3359128e3212" containerName="console" Jul 06 21:03:00.034022 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.033779 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d75c9bf-afe5-45e8-a99f-a882f27ef26a" containerName="console" Jul 06 21:03:00.038300 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.038280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.041464 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.041440 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 21:03:00.042282 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.042255 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 21:03:00.042282 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.042262 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-57592\"" Jul 06 21:03:00.047298 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.047274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q"] Jul 06 21:03:00.115964 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.115927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.116146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.115979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.116146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.116040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkkt8\" (UniqueName: \"kubernetes.io/projected/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-kube-api-access-tkkt8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.216634 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.216593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.216825 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.216661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.216825 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.216705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkkt8\" (UniqueName: \"kubernetes.io/projected/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-kube-api-access-tkkt8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.217006 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.216984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.217006 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.216998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.227345 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.227317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkkt8\" (UniqueName: \"kubernetes.io/projected/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-kube-api-access-tkkt8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.347991 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.347965 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:00.475325 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.475301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q"] Jul 06 21:03:00.477833 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:03:00.477806 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda339db3f_6362_4f1d_a0b9_4fddd907b9d6.slice/crio-690d285aa6936c8999d0728f115d2f151563985fc237ca3fa4adba59e9963485 WatchSource:0}: Error finding container 690d285aa6936c8999d0728f115d2f151563985fc237ca3fa4adba59e9963485: Status 404 returned error can't find the container with id 690d285aa6936c8999d0728f115d2f151563985fc237ca3fa4adba59e9963485 Jul 06 21:03:00.984207 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:00.984175 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" event={"ID":"a339db3f-6362-4f1d-a0b9-4fddd907b9d6","Type":"ContainerStarted","Data":"690d285aa6936c8999d0728f115d2f151563985fc237ca3fa4adba59e9963485"} Jul 06 21:03:05.007631 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.007551 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h"] Jul 06 21:03:05.009741 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.009724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.014914 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.014885 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 21:03:05.015072 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.014932 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 21:03:05.015152 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.015072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nmzl2\"" Jul 06 21:03:05.015231 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.015194 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 21:03:05.015231 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.015203 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 21:03:05.038119 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.038082 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h"] Jul 06 21:03:05.053751 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.053717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b45c7636-69e0-4aef-ac9f-b4554efec3fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h\" (UID: \"b45c7636-69e0-4aef-ac9f-b4554efec3fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.053933 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.053790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mgzq\" (UniqueName: \"kubernetes.io/projected/b45c7636-69e0-4aef-ac9f-b4554efec3fe-kube-api-access-7mgzq\") pod \"managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h\" (UID: \"b45c7636-69e0-4aef-ac9f-b4554efec3fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.155098 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.155066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b45c7636-69e0-4aef-ac9f-b4554efec3fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h\" (UID: \"b45c7636-69e0-4aef-ac9f-b4554efec3fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.155306 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.155122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mgzq\" (UniqueName: \"kubernetes.io/projected/b45c7636-69e0-4aef-ac9f-b4554efec3fe-kube-api-access-7mgzq\") pod \"managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h\" (UID: \"b45c7636-69e0-4aef-ac9f-b4554efec3fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.157587 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.157559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b45c7636-69e0-4aef-ac9f-b4554efec3fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h\" (UID: \"b45c7636-69e0-4aef-ac9f-b4554efec3fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.167132 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.167105 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mgzq\" (UniqueName: \"kubernetes.io/projected/b45c7636-69e0-4aef-ac9f-b4554efec3fe-kube-api-access-7mgzq\") pod \"managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h\" (UID: \"b45c7636-69e0-4aef-ac9f-b4554efec3fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.266813 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.266732 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4"] Jul 06 21:03:05.269323 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.269301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.272710 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.272691 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 21:03:05.272861 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.272691 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 21:03:05.273689 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.273630 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 21:03:05.273822 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.273740 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 21:03:05.284830 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.284808 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4"] Jul 06 21:03:05.327761 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.327729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" Jul 06 21:03:05.356749 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.356719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzjcl\" (UniqueName: \"kubernetes.io/projected/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-kube-api-access-dzjcl\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.356900 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.356760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.356900 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.356846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.356900 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.356877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-hub\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.357069 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.356925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-ca\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.357069 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.356944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.457638 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.457611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-hub\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.457830 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.457671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-ca\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.457830 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.457698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.457830 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.457731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzjcl\" (UniqueName: \"kubernetes.io/projected/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-kube-api-access-dzjcl\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.457830 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.457773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.457830 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.457821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.459429 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.459157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.459429 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.459342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h"] Jul 06 21:03:05.461530 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.461458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-hub\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.461633 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.461598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.461763 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:03:05.461732 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb45c7636_69e0_4aef_ac9f_b4554efec3fe.slice/crio-9245ea972f0a0f7336e6a57c00886e6ef343cd41b86c75e53e0e19b64de5bc60 WatchSource:0}: Error finding container 9245ea972f0a0f7336e6a57c00886e6ef343cd41b86c75e53e0e19b64de5bc60: Status 404 returned error can't find the container with id 9245ea972f0a0f7336e6a57c00886e6ef343cd41b86c75e53e0e19b64de5bc60 Jul 06 21:03:05.461879 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.461815 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.462483 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.462354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-ca\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.467513 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.467491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzjcl\" (UniqueName: \"kubernetes.io/projected/94d8e4fb-7686-4cc3-93f4-2e6cca762a33-kube-api-access-dzjcl\") pod \"cluster-proxy-proxy-agent-d77d45bcd-7fnw4\" (UID: \"94d8e4fb-7686-4cc3-93f4-2e6cca762a33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.580608 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.580519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" Jul 06 21:03:05.740848 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:05.740813 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4"] Jul 06 21:03:05.744540 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:03:05.744512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94d8e4fb_7686_4cc3_93f4_2e6cca762a33.slice/crio-3bb54ef2bea35ecb0b7c0518c825d871c4ee95b5968fb9c5934001b17d077db5 WatchSource:0}: Error finding container 3bb54ef2bea35ecb0b7c0518c825d871c4ee95b5968fb9c5934001b17d077db5: Status 404 returned error can't find the container with id 3bb54ef2bea35ecb0b7c0518c825d871c4ee95b5968fb9c5934001b17d077db5 Jul 06 21:03:06.004804 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:06.004764 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" event={"ID":"94d8e4fb-7686-4cc3-93f4-2e6cca762a33","Type":"ContainerStarted","Data":"3bb54ef2bea35ecb0b7c0518c825d871c4ee95b5968fb9c5934001b17d077db5"} Jul 06 21:03:06.006044 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:06.006017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" event={"ID":"b45c7636-69e0-4aef-ac9f-b4554efec3fe","Type":"ContainerStarted","Data":"9245ea972f0a0f7336e6a57c00886e6ef343cd41b86c75e53e0e19b64de5bc60"} Jul 06 21:03:08.024871 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:08.024830 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" event={"ID":"a339db3f-6362-4f1d-a0b9-4fddd907b9d6","Type":"ContainerStarted","Data":"d0dde4390fe4ce5db2ba233671ec601b1b5766a2338950ce0fe643d09ab3ac10"} Jul 06 21:03:09.031737 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:09.031700 2562 generic.go:356] "Generic (PLEG): container finished" podID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerID="d0dde4390fe4ce5db2ba233671ec601b1b5766a2338950ce0fe643d09ab3ac10" exitCode=0 Jul 06 21:03:09.032206 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:09.031751 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" event={"ID":"a339db3f-6362-4f1d-a0b9-4fddd907b9d6","Type":"ContainerDied","Data":"d0dde4390fe4ce5db2ba233671ec601b1b5766a2338950ce0fe643d09ab3ac10"} Jul 06 21:03:12.045203 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:12.045156 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" event={"ID":"94d8e4fb-7686-4cc3-93f4-2e6cca762a33","Type":"ContainerStarted","Data":"0445add164f90d1bfaaeb1916179b4192703ea6e1b2ee7494c44cd7f3e7eae80"} Jul 06 21:03:12.045692 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:12.045236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" event={"ID":"94d8e4fb-7686-4cc3-93f4-2e6cca762a33","Type":"ContainerStarted","Data":"9632a1fae1cdcf5843575b29f0eff523f8316228490747cd6a3e5ff39b69d2e4"} Jul 06 21:03:12.045692 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:12.045257 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" event={"ID":"94d8e4fb-7686-4cc3-93f4-2e6cca762a33","Type":"ContainerStarted","Data":"4e29fb0061e2d3b2766d2321c57577204bdf3fd54c819b3625b844c2729d1a1f"} Jul 06 21:03:12.046825 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:12.046794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" event={"ID":"b45c7636-69e0-4aef-ac9f-b4554efec3fe","Type":"ContainerStarted","Data":"189d18a5984f5445ad7a41b27b08502891af29d50369ad5ebdfd97911f182143"} Jul 06 21:03:12.072305 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:12.072243 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d77d45bcd-7fnw4" podStartSLOduration=1.658245975 podStartE2EDuration="7.072202226s" totalImagesPullingTime="5.413956251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:03:12.069911707 +0000 UTC m=+272.643311012" watchObservedRunningTime="2026-07-06 21:03:12.072202226 +0000 UTC m=+272.645601523" Jul 06 21:03:12.091065 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:12.091002 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bcf4dbd76-f6p4h" podStartSLOduration=2.404755533 podStartE2EDuration="8.090981717s" totalImagesPullingTime="5.686226184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:03:12.089485914 +0000 UTC m=+272.662885198" watchObservedRunningTime="2026-07-06 21:03:12.090981717 +0000 UTC m=+272.664381002" Jul 06 21:03:13.052071 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:13.051981 2562 generic.go:356] "Generic (PLEG): container finished" podID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerID="01deada2976dda4ae7c60181398ec12dc825f824c8af8a396ba11355ef2d9db4" exitCode=0 Jul 06 21:03:13.052542 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:13.052064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" event={"ID":"a339db3f-6362-4f1d-a0b9-4fddd907b9d6","Type":"ContainerDied","Data":"01deada2976dda4ae7c60181398ec12dc825f824c8af8a396ba11355ef2d9db4"} Jul 06 21:03:22.095226 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:22.095166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" event={"ID":"a339db3f-6362-4f1d-a0b9-4fddd907b9d6","Type":"ContainerStarted","Data":"dad040262c5bba2d36ea5179437d514f999e414c903d99784942931212e83e11"} Jul 06 21:03:23.101004 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:23.100969 2562 generic.go:356] "Generic (PLEG): container finished" podID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerID="dad040262c5bba2d36ea5179437d514f999e414c903d99784942931212e83e11" exitCode=0 Jul 06 21:03:23.101404 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:23.101017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" event={"ID":"a339db3f-6362-4f1d-a0b9-4fddd907b9d6","Type":"ContainerDied","Data":"dad040262c5bba2d36ea5179437d514f999e414c903d99784942931212e83e11"} Jul 06 21:03:24.241314 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.241285 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:24.326295 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.326258 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-bundle\") pod \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " Jul 06 21:03:24.326295 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.326296 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-util\") pod \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " Jul 06 21:03:24.326526 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.326331 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkkt8\" (UniqueName: \"kubernetes.io/projected/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-kube-api-access-tkkt8\") pod \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\" (UID: \"a339db3f-6362-4f1d-a0b9-4fddd907b9d6\") " Jul 06 21:03:24.327008 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.326983 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-bundle" (OuterVolumeSpecName: "bundle") pod "a339db3f-6362-4f1d-a0b9-4fddd907b9d6" (UID: "a339db3f-6362-4f1d-a0b9-4fddd907b9d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:03:24.328514 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.328494 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-kube-api-access-tkkt8" (OuterVolumeSpecName: "kube-api-access-tkkt8") pod "a339db3f-6362-4f1d-a0b9-4fddd907b9d6" (UID: "a339db3f-6362-4f1d-a0b9-4fddd907b9d6"). InnerVolumeSpecName "kube-api-access-tkkt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:03:24.331702 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.331678 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-util" (OuterVolumeSpecName: "util") pod "a339db3f-6362-4f1d-a0b9-4fddd907b9d6" (UID: "a339db3f-6362-4f1d-a0b9-4fddd907b9d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:03:24.427146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.427061 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:24.427146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.427092 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-util\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:24.427146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:24.427134 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkkt8\" (UniqueName: \"kubernetes.io/projected/a339db3f-6362-4f1d-a0b9-4fddd907b9d6-kube-api-access-tkkt8\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:25.109962 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:25.109924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" event={"ID":"a339db3f-6362-4f1d-a0b9-4fddd907b9d6","Type":"ContainerDied","Data":"690d285aa6936c8999d0728f115d2f151563985fc237ca3fa4adba59e9963485"} Jul 06 21:03:25.110121 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:25.109973 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zqn4q" Jul 06 21:03:25.110121 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:25.109981 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="690d285aa6936c8999d0728f115d2f151563985fc237ca3fa4adba59e9963485" Jul 06 21:03:33.015653 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.015618 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55"] Jul 06 21:03:33.016114 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.015891 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerName="pull" Jul 06 21:03:33.016114 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.015902 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerName="pull" Jul 06 21:03:33.016114 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.015912 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerName="extract" Jul 06 21:03:33.016114 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.015920 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerName="extract" Jul 06 21:03:33.016114 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.015943 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerName="util" Jul 06 21:03:33.016114 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.015949 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerName="util" Jul 06 21:03:33.016114 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.016008 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a339db3f-6362-4f1d-a0b9-4fddd907b9d6" containerName="extract" Jul 06 21:03:33.017982 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.017964 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.020802 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.020783 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 21:03:33.021857 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.021840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-57592\"" Jul 06 21:03:33.022103 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.022084 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 21:03:33.032128 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.032102 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55"] Jul 06 21:03:33.095352 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.095318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l888w\" (UniqueName: \"kubernetes.io/projected/ee37e8c9-8a66-4708-ad41-827eb097cd1a-kube-api-access-l888w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.095352 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.095351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.095617 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.095439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.196023 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.195986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l888w\" (UniqueName: \"kubernetes.io/projected/ee37e8c9-8a66-4708-ad41-827eb097cd1a-kube-api-access-l888w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.196023 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.196023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.196250 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.196060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.196469 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.196453 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.196509 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.196481 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.206494 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.206474 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l888w\" (UniqueName: \"kubernetes.io/projected/ee37e8c9-8a66-4708-ad41-827eb097cd1a-kube-api-access-l888w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.327619 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.327515 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:33.454954 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:33.454927 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55"] Jul 06 21:03:33.457238 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:03:33.457193 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee37e8c9_8a66_4708_ad41_827eb097cd1a.slice/crio-b3661d9036fc7e80d3aa8b257a8743943dbacc0c3c4799fef4d0e22a548092ba WatchSource:0}: Error finding container b3661d9036fc7e80d3aa8b257a8743943dbacc0c3c4799fef4d0e22a548092ba: Status 404 returned error can't find the container with id b3661d9036fc7e80d3aa8b257a8743943dbacc0c3c4799fef4d0e22a548092ba Jul 06 21:03:34.142730 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:34.142698 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerID="c9e73cb9d2a620cf389ee51fce60f986ad062863c23b3ba61f3a6bcb46ebcfcb" exitCode=0 Jul 06 21:03:34.143122 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:34.142788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" event={"ID":"ee37e8c9-8a66-4708-ad41-827eb097cd1a","Type":"ContainerDied","Data":"c9e73cb9d2a620cf389ee51fce60f986ad062863c23b3ba61f3a6bcb46ebcfcb"} Jul 06 21:03:34.143122 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:34.142834 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" event={"ID":"ee37e8c9-8a66-4708-ad41-827eb097cd1a","Type":"ContainerStarted","Data":"b3661d9036fc7e80d3aa8b257a8743943dbacc0c3c4799fef4d0e22a548092ba"} Jul 06 21:03:37.158127 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:37.158096 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerID="d624da7ebd75ba68b51e38f3c794a94705c257038d684fc7436b561ecb686c74" exitCode=0 Jul 06 21:03:37.158529 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:37.158192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" event={"ID":"ee37e8c9-8a66-4708-ad41-827eb097cd1a","Type":"ContainerDied","Data":"d624da7ebd75ba68b51e38f3c794a94705c257038d684fc7436b561ecb686c74"} Jul 06 21:03:38.164324 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:38.164293 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerID="88ef67bd9ed854c4ac6b88d618b437f3cfb4b4b130b6863129f2089ae8cb59e7" exitCode=0 Jul 06 21:03:38.164702 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:38.164358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" event={"ID":"ee37e8c9-8a66-4708-ad41-827eb097cd1a","Type":"ContainerDied","Data":"88ef67bd9ed854c4ac6b88d618b437f3cfb4b4b130b6863129f2089ae8cb59e7"} Jul 06 21:03:39.294693 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.294668 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:39.449905 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.449811 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-util\") pod \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " Jul 06 21:03:39.449905 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.449857 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l888w\" (UniqueName: \"kubernetes.io/projected/ee37e8c9-8a66-4708-ad41-827eb097cd1a-kube-api-access-l888w\") pod \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " Jul 06 21:03:39.450138 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.449914 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-bundle\") pod \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\" (UID: \"ee37e8c9-8a66-4708-ad41-827eb097cd1a\") " Jul 06 21:03:39.450398 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.450349 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-bundle" (OuterVolumeSpecName: "bundle") pod "ee37e8c9-8a66-4708-ad41-827eb097cd1a" (UID: "ee37e8c9-8a66-4708-ad41-827eb097cd1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:03:39.451954 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.451933 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee37e8c9-8a66-4708-ad41-827eb097cd1a-kube-api-access-l888w" (OuterVolumeSpecName: "kube-api-access-l888w") pod "ee37e8c9-8a66-4708-ad41-827eb097cd1a" (UID: "ee37e8c9-8a66-4708-ad41-827eb097cd1a"). InnerVolumeSpecName "kube-api-access-l888w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:03:39.457006 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.456982 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-util" (OuterVolumeSpecName: "util") pod "ee37e8c9-8a66-4708-ad41-827eb097cd1a" (UID: "ee37e8c9-8a66-4708-ad41-827eb097cd1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:03:39.550526 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.550489 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:39.550526 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.550519 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee37e8c9-8a66-4708-ad41-827eb097cd1a-util\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:39.550526 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.550529 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l888w\" (UniqueName: \"kubernetes.io/projected/ee37e8c9-8a66-4708-ad41-827eb097cd1a-kube-api-access-l888w\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:39.812132 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:39.812053 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 21:03:40.173751 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:40.173727 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" Jul 06 21:03:40.173951 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:40.173724 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pk55" event={"ID":"ee37e8c9-8a66-4708-ad41-827eb097cd1a","Type":"ContainerDied","Data":"b3661d9036fc7e80d3aa8b257a8743943dbacc0c3c4799fef4d0e22a548092ba"} Jul 06 21:03:40.173951 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:40.173844 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3661d9036fc7e80d3aa8b257a8743943dbacc0c3c4799fef4d0e22a548092ba" Jul 06 21:03:53.316513 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316479 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645"] Jul 06 21:03:53.316939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316748 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerName="extract" Jul 06 21:03:53.316939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316759 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerName="extract" Jul 06 21:03:53.316939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316775 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerName="pull" Jul 06 21:03:53.316939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316780 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerName="pull" Jul 06 21:03:53.316939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316788 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerName="util" Jul 06 21:03:53.316939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316792 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerName="util" Jul 06 21:03:53.316939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.316841 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee37e8c9-8a66-4708-ad41-827eb097cd1a" containerName="extract" Jul 06 21:03:53.339112 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.339072 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645"] Jul 06 21:03:53.339322 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.339174 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.342477 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.342450 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-57592\"" Jul 06 21:03:53.342591 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.342543 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 21:03:53.343412 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.343391 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 21:03:53.352182 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.352162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.352313 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.352192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mkrq\" (UniqueName: \"kubernetes.io/projected/cc36ccbf-7a27-4649-9126-f405509f334d-kube-api-access-6mkrq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.352378 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.352311 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.453329 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.453289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.453525 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.453336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.453525 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.453371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkrq\" (UniqueName: \"kubernetes.io/projected/cc36ccbf-7a27-4649-9126-f405509f334d-kube-api-access-6mkrq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.453775 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.453748 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.453849 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.453769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.466851 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.466827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mkrq\" (UniqueName: \"kubernetes.io/projected/cc36ccbf-7a27-4649-9126-f405509f334d-kube-api-access-6mkrq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.648322 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.648292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:53.801560 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:53.801524 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645"] Jul 06 21:03:53.803985 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:03:53.803954 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc36ccbf_7a27_4649_9126_f405509f334d.slice/crio-fc89beb63b2d49fb1d95d5526c978989a70c5cbdfce6b34f6b8af915fb6168e9 WatchSource:0}: Error finding container fc89beb63b2d49fb1d95d5526c978989a70c5cbdfce6b34f6b8af915fb6168e9: Status 404 returned error can't find the container with id fc89beb63b2d49fb1d95d5526c978989a70c5cbdfce6b34f6b8af915fb6168e9 Jul 06 21:03:54.227745 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:54.227654 2562 generic.go:356] "Generic (PLEG): container finished" podID="cc36ccbf-7a27-4649-9126-f405509f334d" containerID="1d7667a0cfd0a0a466bece5e9f97c4678988acc76dc5f1f5c737368e3b2064da" exitCode=0 Jul 06 21:03:54.227745 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:54.227694 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" event={"ID":"cc36ccbf-7a27-4649-9126-f405509f334d","Type":"ContainerDied","Data":"1d7667a0cfd0a0a466bece5e9f97c4678988acc76dc5f1f5c737368e3b2064da"} Jul 06 21:03:54.227745 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:54.227735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" event={"ID":"cc36ccbf-7a27-4649-9126-f405509f334d","Type":"ContainerStarted","Data":"fc89beb63b2d49fb1d95d5526c978989a70c5cbdfce6b34f6b8af915fb6168e9"} Jul 06 21:03:54.228253 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:54.228239 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:03:55.233673 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:55.233572 2562 generic.go:356] "Generic (PLEG): container finished" podID="cc36ccbf-7a27-4649-9126-f405509f334d" containerID="07685f14cf4408039c03f5ed3dd929baf9e9e5248962b03d6d91e345456c2fe2" exitCode=0 Jul 06 21:03:55.233673 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:55.233622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" event={"ID":"cc36ccbf-7a27-4649-9126-f405509f334d","Type":"ContainerDied","Data":"07685f14cf4408039c03f5ed3dd929baf9e9e5248962b03d6d91e345456c2fe2"} Jul 06 21:03:56.239863 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:56.239816 2562 generic.go:356] "Generic (PLEG): container finished" podID="cc36ccbf-7a27-4649-9126-f405509f334d" containerID="6493037299c3a1cce84311e20daa22c05ccefbd162b660edfef8f9eed3ea4c62" exitCode=0 Jul 06 21:03:56.240265 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:56.239890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" event={"ID":"cc36ccbf-7a27-4649-9126-f405509f334d","Type":"ContainerDied","Data":"6493037299c3a1cce84311e20daa22c05ccefbd162b660edfef8f9eed3ea4c62"} Jul 06 21:03:57.371673 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.371649 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:57.379010 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.378990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-bundle\") pod \"cc36ccbf-7a27-4649-9126-f405509f334d\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " Jul 06 21:03:57.379089 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.379052 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-util\") pod \"cc36ccbf-7a27-4649-9126-f405509f334d\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " Jul 06 21:03:57.379089 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.379083 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mkrq\" (UniqueName: \"kubernetes.io/projected/cc36ccbf-7a27-4649-9126-f405509f334d-kube-api-access-6mkrq\") pod \"cc36ccbf-7a27-4649-9126-f405509f334d\" (UID: \"cc36ccbf-7a27-4649-9126-f405509f334d\") " Jul 06 21:03:57.379676 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.379650 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-bundle" (OuterVolumeSpecName: "bundle") pod "cc36ccbf-7a27-4649-9126-f405509f334d" (UID: "cc36ccbf-7a27-4649-9126-f405509f334d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:03:57.381113 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.381074 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc36ccbf-7a27-4649-9126-f405509f334d-kube-api-access-6mkrq" (OuterVolumeSpecName: "kube-api-access-6mkrq") pod "cc36ccbf-7a27-4649-9126-f405509f334d" (UID: "cc36ccbf-7a27-4649-9126-f405509f334d"). InnerVolumeSpecName "kube-api-access-6mkrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:03:57.385095 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.385071 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-util" (OuterVolumeSpecName: "util") pod "cc36ccbf-7a27-4649-9126-f405509f334d" (UID: "cc36ccbf-7a27-4649-9126-f405509f334d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:03:57.479723 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.479683 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-util\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:57.479723 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.479715 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mkrq\" (UniqueName: \"kubernetes.io/projected/cc36ccbf-7a27-4649-9126-f405509f334d-kube-api-access-6mkrq\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:57.479723 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:57.479728 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc36ccbf-7a27-4649-9126-f405509f334d-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:03:58.249085 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:58.249006 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" Jul 06 21:03:58.249085 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:58.249015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49645" event={"ID":"cc36ccbf-7a27-4649-9126-f405509f334d","Type":"ContainerDied","Data":"fc89beb63b2d49fb1d95d5526c978989a70c5cbdfce6b34f6b8af915fb6168e9"} Jul 06 21:03:58.249085 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:03:58.249054 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc89beb63b2d49fb1d95d5526c978989a70c5cbdfce6b34f6b8af915fb6168e9" Jul 06 21:04:07.042606 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042574 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69"] Jul 06 21:04:07.043080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042865 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc36ccbf-7a27-4649-9126-f405509f334d" containerName="pull" Jul 06 21:04:07.043080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042876 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc36ccbf-7a27-4649-9126-f405509f334d" containerName="pull" Jul 06 21:04:07.043080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042894 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc36ccbf-7a27-4649-9126-f405509f334d" containerName="util" Jul 06 21:04:07.043080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042898 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc36ccbf-7a27-4649-9126-f405509f334d" containerName="util" Jul 06 21:04:07.043080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042907 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc36ccbf-7a27-4649-9126-f405509f334d" containerName="extract" Jul 06 21:04:07.043080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042913 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc36ccbf-7a27-4649-9126-f405509f334d" containerName="extract" Jul 06 21:04:07.043080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.042960 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc36ccbf-7a27-4649-9126-f405509f334d" containerName="extract" Jul 06 21:04:07.044823 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.044807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.048232 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.048191 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 21:04:07.048362 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.048327 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 21:04:07.048789 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.048765 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 21:04:07.051848 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.051828 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2tlc7\"" Jul 06 21:04:07.052180 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.052162 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 21:04:07.062874 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.062850 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69"] Jul 06 21:04:07.149897 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.149858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a4c7e993-56fb-4ded-8a06-6d689444ddbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.149897 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.149895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4c7e993-56fb-4ded-8a06-6d689444ddbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.150106 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.149914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a4c7e993-56fb-4ded-8a06-6d689444ddbe-manifests\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.150106 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.149998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4c7e993-56fb-4ded-8a06-6d689444ddbe-tmp\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.150106 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.150055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n866t\" (UniqueName: \"kubernetes.io/projected/a4c7e993-56fb-4ded-8a06-6d689444ddbe-kube-api-access-n866t\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.250421 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.250383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4c7e993-56fb-4ded-8a06-6d689444ddbe-tmp\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.250421 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.250425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n866t\" (UniqueName: \"kubernetes.io/projected/a4c7e993-56fb-4ded-8a06-6d689444ddbe-kube-api-access-n866t\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.250665 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.250463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a4c7e993-56fb-4ded-8a06-6d689444ddbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.250665 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.250481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4c7e993-56fb-4ded-8a06-6d689444ddbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.250665 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.250497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a4c7e993-56fb-4ded-8a06-6d689444ddbe-manifests\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.250834 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.250814 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a4c7e993-56fb-4ded-8a06-6d689444ddbe-manifests\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.252799 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.252774 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4c7e993-56fb-4ded-8a06-6d689444ddbe-tmp\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.253027 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.253011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4c7e993-56fb-4ded-8a06-6d689444ddbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.253149 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.253128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a4c7e993-56fb-4ded-8a06-6d689444ddbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.261317 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.261295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n866t\" (UniqueName: \"kubernetes.io/projected/a4c7e993-56fb-4ded-8a06-6d689444ddbe-kube-api-access-n866t\") pod \"opendatahub-operator-controller-manager-5bd9f97986-v6w69\" (UID: \"a4c7e993-56fb-4ded-8a06-6d689444ddbe\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.354623 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.354589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:07.504729 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:07.504698 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69"] Jul 06 21:04:07.505102 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:04:07.505082 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c7e993_56fb_4ded_8a06_6d689444ddbe.slice/crio-e4c3f919b17ff02ebd4990e98046fe34052eac46a713369b9f6b0bbc622d28d0 WatchSource:0}: Error finding container e4c3f919b17ff02ebd4990e98046fe34052eac46a713369b9f6b0bbc622d28d0: Status 404 returned error can't find the container with id e4c3f919b17ff02ebd4990e98046fe34052eac46a713369b9f6b0bbc622d28d0 Jul 06 21:04:08.293760 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:08.293693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" event={"ID":"a4c7e993-56fb-4ded-8a06-6d689444ddbe","Type":"ContainerStarted","Data":"e4c3f919b17ff02ebd4990e98046fe34052eac46a713369b9f6b0bbc622d28d0"} Jul 06 21:04:11.310787 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:11.310751 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" event={"ID":"a4c7e993-56fb-4ded-8a06-6d689444ddbe","Type":"ContainerStarted","Data":"85dff46b295cb3e0a43f89ed7954dd062b9eab143b99e52059c95dfab1663b95"} Jul 06 21:04:12.316143 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:12.316101 2562 generic.go:356] "Generic (PLEG): container finished" podID="a4c7e993-56fb-4ded-8a06-6d689444ddbe" containerID="85dff46b295cb3e0a43f89ed7954dd062b9eab143b99e52059c95dfab1663b95" exitCode=0 Jul 06 21:04:12.316534 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:12.316177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" event={"ID":"a4c7e993-56fb-4ded-8a06-6d689444ddbe","Type":"ContainerDied","Data":"85dff46b295cb3e0a43f89ed7954dd062b9eab143b99e52059c95dfab1663b95"} Jul 06 21:04:13.323973 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:13.323931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" event={"ID":"a4c7e993-56fb-4ded-8a06-6d689444ddbe","Type":"ContainerStarted","Data":"2c465cb133d9c96be6702e17b6efdcfa534a82b99cdb4d6212c5b113dee9a4b0"} Jul 06 21:04:13.324485 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:13.324087 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:13.370467 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:13.370415 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" podStartSLOduration=1.819061857 podStartE2EDuration="6.370399236s" totalImagesPullingTime="3.503851227s" totalInitContainerRuntime="1.047486152s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:13.369581058 +0000 UTC m=+333.942980343" watchObservedRunningTime="2026-07-06 21:04:13.370399236 +0000 UTC m=+333.943798519" Jul 06 21:04:24.331138 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:24.331105 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-v6w69" Jul 06 21:04:27.430082 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.430040 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5p287"] Jul 06 21:04:27.436112 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.436090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:27.438821 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.438798 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 21:04:27.438938 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.438823 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l8cl7\"" Jul 06 21:04:27.445242 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.445204 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5p287"] Jul 06 21:04:27.518575 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.518535 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/236d9286-242c-4ff0-8f93-de73d3233628-cert\") pod \"odh-model-controller-7998c67dc4-5p287\" (UID: \"236d9286-242c-4ff0-8f93-de73d3233628\") " pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:27.518703 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.518620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmlkc\" (UniqueName: \"kubernetes.io/projected/236d9286-242c-4ff0-8f93-de73d3233628-kube-api-access-zmlkc\") pod \"odh-model-controller-7998c67dc4-5p287\" (UID: \"236d9286-242c-4ff0-8f93-de73d3233628\") " pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:27.619328 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.619292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmlkc\" (UniqueName: \"kubernetes.io/projected/236d9286-242c-4ff0-8f93-de73d3233628-kube-api-access-zmlkc\") pod \"odh-model-controller-7998c67dc4-5p287\" (UID: \"236d9286-242c-4ff0-8f93-de73d3233628\") " pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:27.619478 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.619373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/236d9286-242c-4ff0-8f93-de73d3233628-cert\") pod \"odh-model-controller-7998c67dc4-5p287\" (UID: \"236d9286-242c-4ff0-8f93-de73d3233628\") " pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:27.619478 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:04:27.619473 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 21:04:27.619573 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:04:27.619548 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236d9286-242c-4ff0-8f93-de73d3233628-cert podName:236d9286-242c-4ff0-8f93-de73d3233628 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:28.119530501 +0000 UTC m=+348.692929779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/236d9286-242c-4ff0-8f93-de73d3233628-cert") pod "odh-model-controller-7998c67dc4-5p287" (UID: "236d9286-242c-4ff0-8f93-de73d3233628") : secret "odh-model-controller-webhook-cert" not found Jul 06 21:04:27.640867 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:27.640830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmlkc\" (UniqueName: \"kubernetes.io/projected/236d9286-242c-4ff0-8f93-de73d3233628-kube-api-access-zmlkc\") pod \"odh-model-controller-7998c67dc4-5p287\" (UID: \"236d9286-242c-4ff0-8f93-de73d3233628\") " pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:28.067357 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.067322 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lfnx8"] Jul 06 21:04:28.069655 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.069639 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.074444 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.074422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 21:04:28.083285 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.083260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lfnx8"] Jul 06 21:04:28.125498 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.125466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp6vf\" (UniqueName: \"kubernetes.io/projected/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-kube-api-access-qp6vf\") pod \"model-serving-api-54d89bd5fc-lfnx8\" (UID: \"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.125665 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.125523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-tls-certs\") pod \"model-serving-api-54d89bd5fc-lfnx8\" (UID: \"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.125665 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.125588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/236d9286-242c-4ff0-8f93-de73d3233628-cert\") pod \"odh-model-controller-7998c67dc4-5p287\" (UID: \"236d9286-242c-4ff0-8f93-de73d3233628\") " pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:28.128062 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.128031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/236d9286-242c-4ff0-8f93-de73d3233628-cert\") pod \"odh-model-controller-7998c67dc4-5p287\" (UID: \"236d9286-242c-4ff0-8f93-de73d3233628\") " pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:28.226421 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.226380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-tls-certs\") pod \"model-serving-api-54d89bd5fc-lfnx8\" (UID: \"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.226611 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.226469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp6vf\" (UniqueName: \"kubernetes.io/projected/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-kube-api-access-qp6vf\") pod \"model-serving-api-54d89bd5fc-lfnx8\" (UID: \"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.226611 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:04:28.226567 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 21:04:28.226731 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:04:28.226641 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-tls-certs podName:e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:28.726621016 +0000 UTC m=+349.300020283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-tls-certs") pod "model-serving-api-54d89bd5fc-lfnx8" (UID: "e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93") : secret "model-serving-api-tls" not found Jul 06 21:04:28.255097 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.255070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp6vf\" (UniqueName: \"kubernetes.io/projected/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-kube-api-access-qp6vf\") pod \"model-serving-api-54d89bd5fc-lfnx8\" (UID: \"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.346582 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.346549 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:28.503361 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.503333 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5p287"] Jul 06 21:04:28.505937 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:04:28.505907 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236d9286_242c_4ff0_8f93_de73d3233628.slice/crio-e59dc8b7103bc0c54ed2ef4fd8a5defff9198b7c7f760407560ed7e74b06c1f4 WatchSource:0}: Error finding container e59dc8b7103bc0c54ed2ef4fd8a5defff9198b7c7f760407560ed7e74b06c1f4: Status 404 returned error can't find the container with id e59dc8b7103bc0c54ed2ef4fd8a5defff9198b7c7f760407560ed7e74b06c1f4 Jul 06 21:04:28.731894 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.731785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-tls-certs\") pod \"model-serving-api-54d89bd5fc-lfnx8\" (UID: \"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.734650 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.734606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93-tls-certs\") pod \"model-serving-api-54d89bd5fc-lfnx8\" (UID: \"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:28.979660 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:28.979624 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:29.116791 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:29.116754 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lfnx8"] Jul 06 21:04:29.119596 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:04:29.119565 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d6b0f3_859e_4413_88c5_ce2b0e6d5e93.slice/crio-c0b2eba8bea0728a5789265182a3529fdcc69fe81dd2c12a0728db0f9d4c1dce WatchSource:0}: Error finding container c0b2eba8bea0728a5789265182a3529fdcc69fe81dd2c12a0728db0f9d4c1dce: Status 404 returned error can't find the container with id c0b2eba8bea0728a5789265182a3529fdcc69fe81dd2c12a0728db0f9d4c1dce Jul 06 21:04:29.396709 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:29.396657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" event={"ID":"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93","Type":"ContainerStarted","Data":"c0b2eba8bea0728a5789265182a3529fdcc69fe81dd2c12a0728db0f9d4c1dce"} Jul 06 21:04:29.398150 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:29.398109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5p287" event={"ID":"236d9286-242c-4ff0-8f93-de73d3233628","Type":"ContainerStarted","Data":"e59dc8b7103bc0c54ed2ef4fd8a5defff9198b7c7f760407560ed7e74b06c1f4"} Jul 06 21:04:32.416629 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:32.416584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5p287" event={"ID":"236d9286-242c-4ff0-8f93-de73d3233628","Type":"ContainerStarted","Data":"7070118fe9dc208ee5dd0d60cf6b42c7c3c588716c883d3bf11ea7b164ff344e"} Jul 06 21:04:32.417132 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:32.416701 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:32.418535 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:32.418499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" event={"ID":"e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93","Type":"ContainerStarted","Data":"52be4d7d61cc132d7f740dcd23d221dcef12fb6a122e6e3d68837ca3a78652d6"} Jul 06 21:04:32.418654 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:32.418564 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:32.444140 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:32.444093 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5p287" podStartSLOduration=2.054950055 podStartE2EDuration="5.444078438s" totalImagesPullingTime="3.389128383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:32.443062743 +0000 UTC m=+353.016462028" watchObservedRunningTime="2026-07-06 21:04:32.444078438 +0000 UTC m=+353.017477725" Jul 06 21:04:32.463038 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:32.462987 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" podStartSLOduration=1.691699691 podStartE2EDuration="4.462973326s" totalImagesPullingTime="2.771273635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:32.461829041 +0000 UTC m=+353.035228327" watchObservedRunningTime="2026-07-06 21:04:32.462973326 +0000 UTC m=+353.036372609" Jul 06 21:04:37.858943 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.858906 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-686455847d-plmxs"] Jul 06 21:04:37.861862 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.861846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:37.865827 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.865805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 21:04:37.866048 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.866030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zx4hf\"" Jul 06 21:04:37.866878 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.866859 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 21:04:37.866981 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.866963 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 21:04:37.867046 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.867024 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 21:04:37.873620 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:37.873596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686455847d-plmxs"] Jul 06 21:04:38.008032 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.007996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tls-certs\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.008032 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.008039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tmp\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.008279 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.008084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqpsq\" (UniqueName: \"kubernetes.io/projected/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-kube-api-access-vqpsq\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.108730 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.108699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tls-certs\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.108888 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.108744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tmp\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.108888 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.108787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqpsq\" (UniqueName: \"kubernetes.io/projected/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-kube-api-access-vqpsq\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.108888 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:04:38.108836 2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 06 21:04:38.109021 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:04:38.108889 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tls-certs podName:0520ff61-6d0e-43c7-ba0f-ca1e2dec905b nodeName:}" failed. No retries permitted until 2026-07-06 21:04:38.608873791 +0000 UTC m=+359.182273053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tls-certs") pod "kube-auth-proxy-686455847d-plmxs" (UID: "0520ff61-6d0e-43c7-ba0f-ca1e2dec905b") : secret "kube-auth-proxy-tls" not found Jul 06 21:04:38.110853 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.110831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tmp\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.127120 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.127085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqpsq\" (UniqueName: \"kubernetes.io/projected/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-kube-api-access-vqpsq\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.612756 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.612719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tls-certs\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.615251 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.615197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0520ff61-6d0e-43c7-ba0f-ca1e2dec905b-tls-certs\") pod \"kube-auth-proxy-686455847d-plmxs\" (UID: \"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b\") " pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.771893 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.771851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" Jul 06 21:04:38.942711 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:38.942630 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686455847d-plmxs"] Jul 06 21:04:38.945430 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:04:38.945399 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0520ff61_6d0e_43c7_ba0f_ca1e2dec905b.slice/crio-4eb4b57e9eaac9d69887099081c58464e7622819aedb34a2770272e9a6e912e6 WatchSource:0}: Error finding container 4eb4b57e9eaac9d69887099081c58464e7622819aedb34a2770272e9a6e912e6: Status 404 returned error can't find the container with id 4eb4b57e9eaac9d69887099081c58464e7622819aedb34a2770272e9a6e912e6 Jul 06 21:04:39.339376 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.339344 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9chlv"] Jul 06 21:04:39.345055 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.345024 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n"] Jul 06 21:04:39.347618 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.346555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.349238 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.349195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.349897 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.349875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8qcpt\"" Jul 06 21:04:39.350854 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.350834 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 21:04:39.351860 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.351839 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 06 21:04:39.352094 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.352066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ww29z\"" Jul 06 21:04:39.358285 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.358263 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9chlv"] Jul 06 21:04:39.368112 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.368089 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n"] Jul 06 21:04:39.420290 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.420258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7cfc55-faaa-4d9a-86ae-168111eb2d07-cert\") pod \"kserve-controller-manager-d6f4b65b8-9chlv\" (UID: \"7f7cfc55-faaa-4d9a-86ae-168111eb2d07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.420446 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.420296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj7rc\" (UniqueName: \"kubernetes.io/projected/7f7cfc55-faaa-4d9a-86ae-168111eb2d07-kube-api-access-dj7rc\") pod \"kserve-controller-manager-d6f4b65b8-9chlv\" (UID: \"7f7cfc55-faaa-4d9a-86ae-168111eb2d07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.450274 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.450235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" event={"ID":"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b","Type":"ContainerStarted","Data":"4eb4b57e9eaac9d69887099081c58464e7622819aedb34a2770272e9a6e912e6"} Jul 06 21:04:39.521765 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.521726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfl8b\" (UniqueName: \"kubernetes.io/projected/a1cd018f-3967-4b94-9aa0-cbcc9a6f469f-kube-api-access-qfl8b\") pod \"llmisvc-controller-manager-777c6bd7d5-zsq6n\" (UID: \"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.521932 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.521775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1cd018f-3967-4b94-9aa0-cbcc9a6f469f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zsq6n\" (UID: \"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.521932 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.521824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7cfc55-faaa-4d9a-86ae-168111eb2d07-cert\") pod \"kserve-controller-manager-d6f4b65b8-9chlv\" (UID: \"7f7cfc55-faaa-4d9a-86ae-168111eb2d07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.521932 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.521850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj7rc\" (UniqueName: \"kubernetes.io/projected/7f7cfc55-faaa-4d9a-86ae-168111eb2d07-kube-api-access-dj7rc\") pod \"kserve-controller-manager-d6f4b65b8-9chlv\" (UID: \"7f7cfc55-faaa-4d9a-86ae-168111eb2d07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.524290 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.524254 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7cfc55-faaa-4d9a-86ae-168111eb2d07-cert\") pod \"kserve-controller-manager-d6f4b65b8-9chlv\" (UID: \"7f7cfc55-faaa-4d9a-86ae-168111eb2d07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.534105 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.534077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj7rc\" (UniqueName: \"kubernetes.io/projected/7f7cfc55-faaa-4d9a-86ae-168111eb2d07-kube-api-access-dj7rc\") pod \"kserve-controller-manager-d6f4b65b8-9chlv\" (UID: \"7f7cfc55-faaa-4d9a-86ae-168111eb2d07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.622352 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.622264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfl8b\" (UniqueName: \"kubernetes.io/projected/a1cd018f-3967-4b94-9aa0-cbcc9a6f469f-kube-api-access-qfl8b\") pod \"llmisvc-controller-manager-777c6bd7d5-zsq6n\" (UID: \"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.622352 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.622312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1cd018f-3967-4b94-9aa0-cbcc9a6f469f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zsq6n\" (UID: \"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.624679 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.624655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1cd018f-3967-4b94-9aa0-cbcc9a6f469f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zsq6n\" (UID: \"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.634795 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.634764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfl8b\" (UniqueName: \"kubernetes.io/projected/a1cd018f-3967-4b94-9aa0-cbcc9a6f469f-kube-api-access-qfl8b\") pod \"llmisvc-controller-manager-777c6bd7d5-zsq6n\" (UID: \"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.660808 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.660774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:39.667053 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.667026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:39.834032 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:04:39.834003 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7cfc55_faaa_4d9a_86ae_168111eb2d07.slice/crio-f93634a9524748aa222f837ecce23df09d37ada4fa831bc4bbcd7cbf1dc9c137 WatchSource:0}: Error finding container f93634a9524748aa222f837ecce23df09d37ada4fa831bc4bbcd7cbf1dc9c137: Status 404 returned error can't find the container with id f93634a9524748aa222f837ecce23df09d37ada4fa831bc4bbcd7cbf1dc9c137 Jul 06 21:04:39.834658 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.834631 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9chlv"] Jul 06 21:04:39.847685 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:39.847656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n"] Jul 06 21:04:39.848044 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:04:39.848016 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda1cd018f_3967_4b94_9aa0_cbcc9a6f469f.slice/crio-79b00548fd93e21fe94228bb37bac0e6283997e1bf10858eccc91f839b5e2d9e WatchSource:0}: Error finding container 79b00548fd93e21fe94228bb37bac0e6283997e1bf10858eccc91f839b5e2d9e: Status 404 returned error can't find the container with id 79b00548fd93e21fe94228bb37bac0e6283997e1bf10858eccc91f839b5e2d9e Jul 06 21:04:40.279432 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.279388 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv"] Jul 06 21:04:40.284146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.284129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.288710 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.288685 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 21:04:40.289459 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.289442 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 21:04:40.289757 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.289714 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j8xt6\"" Jul 06 21:04:40.289856 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.289771 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 21:04:40.290577 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.290555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 21:04:40.310229 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.310184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv"] Jul 06 21:04:40.429082 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.429047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.429289 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.429098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.429289 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.429180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77e49599-f743-4de7-b2cb-af0dc9c60fc9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.429289 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.429260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.429540 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.429301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.429540 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.429401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wmhj\" (UniqueName: \"kubernetes.io/projected/77e49599-f743-4de7-b2cb-af0dc9c60fc9-kube-api-access-4wmhj\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.429540 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.429465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.456461 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.456420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" event={"ID":"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f","Type":"ContainerStarted","Data":"79b00548fd93e21fe94228bb37bac0e6283997e1bf10858eccc91f839b5e2d9e"} Jul 06 21:04:40.457752 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.457727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" event={"ID":"7f7cfc55-faaa-4d9a-86ae-168111eb2d07","Type":"ContainerStarted","Data":"f93634a9524748aa222f837ecce23df09d37ada4fa831bc4bbcd7cbf1dc9c137"} Jul 06 21:04:40.529889 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.529814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wmhj\" (UniqueName: \"kubernetes.io/projected/77e49599-f743-4de7-b2cb-af0dc9c60fc9-kube-api-access-4wmhj\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.530061 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.529863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.530061 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.529972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.530061 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.530003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.530061 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.530040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77e49599-f743-4de7-b2cb-af0dc9c60fc9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.530308 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.530090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.530308 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.530137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.530924 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.530883 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.532389 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.532351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.532471 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.532428 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.532471 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.532434 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.533141 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.533121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77e49599-f743-4de7-b2cb-af0dc9c60fc9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.547955 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.547921 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77e49599-f743-4de7-b2cb-af0dc9c60fc9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.548477 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.548454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wmhj\" (UniqueName: \"kubernetes.io/projected/77e49599-f743-4de7-b2cb-af0dc9c60fc9-kube-api-access-4wmhj\") pod \"istiod-openshift-gateway-94bb8fbfd-j7jgv\" (UID: \"77e49599-f743-4de7-b2cb-af0dc9c60fc9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.593418 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.593381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:40.876198 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:40.876170 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv"] Jul 06 21:04:40.971701 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:04:40.971662 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e49599_f743_4de7_b2cb_af0dc9c60fc9.slice/crio-f962d3bb356b36af42b879cc4497f7bf279b338d775005e90caba195c304c391 WatchSource:0}: Error finding container f962d3bb356b36af42b879cc4497f7bf279b338d775005e90caba195c304c391: Status 404 returned error can't find the container with id f962d3bb356b36af42b879cc4497f7bf279b338d775005e90caba195c304c391 Jul 06 21:04:41.466173 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:41.466132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" event={"ID":"77e49599-f743-4de7-b2cb-af0dc9c60fc9","Type":"ContainerStarted","Data":"f962d3bb356b36af42b879cc4497f7bf279b338d775005e90caba195c304c391"} Jul 06 21:04:42.296469 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:42.296442 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 21:04:42.475077 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:42.475035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" event={"ID":"0520ff61-6d0e-43c7-ba0f-ca1e2dec905b","Type":"ContainerStarted","Data":"97d19d597c572d25a78dcec641a1820094b49fd30ae8e66e08d6084e3053544f"} Jul 06 21:04:42.500953 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:42.500810 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-686455847d-plmxs" podStartSLOduration=2.156685373 podStartE2EDuration="5.500788383s" totalImagesPullingTime="3.34410301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:42.499540454 +0000 UTC m=+363.072939739" watchObservedRunningTime="2026-07-06 21:04:42.500788383 +0000 UTC m=+363.074187667" Jul 06 21:04:43.425259 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:43.425232 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5p287" Jul 06 21:04:43.428615 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:43.428586 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lfnx8" Jul 06 21:04:44.839927 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:44.839894 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 21:04:44.840227 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:44.839956 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 21:04:45.493113 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.493069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" event={"ID":"a1cd018f-3967-4b94-9aa0-cbcc9a6f469f","Type":"ContainerStarted","Data":"59e05045b160f63b1f1d42459ffc7d94328806e6f11b37291ac12211c4e34658"} Jul 06 21:04:45.493308 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.493170 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:04:45.494970 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.494941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" event={"ID":"77e49599-f743-4de7-b2cb-af0dc9c60fc9","Type":"ContainerStarted","Data":"a8c13e4583d3a730a04e08c6a8809f6a465e23719fff48dfe54dac52f2082b20"} Jul 06 21:04:45.495171 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.495150 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:04:45.496868 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.496836 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" event={"ID":"7f7cfc55-faaa-4d9a-86ae-168111eb2d07","Type":"ContainerStarted","Data":"61a67b3920d7238de32ec593d094b6b5713720b683e58b44920a8b0a699580c8"} Jul 06 21:04:45.497249 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.497190 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:04:45.497587 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.497564 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-j7jgv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 21:04:45.497687 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.497609 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" podUID="77e49599-f743-4de7-b2cb-af0dc9c60fc9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:04:45.529677 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.529620 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" podStartSLOduration=1.545367913 podStartE2EDuration="6.529605866s" totalImagesPullingTime="4.984237953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:45.528258468 +0000 UTC m=+366.101657753" watchObservedRunningTime="2026-07-06 21:04:45.529605866 +0000 UTC m=+366.103005128" Jul 06 21:04:45.568824 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.568769 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" podStartSLOduration=1.56868556 podStartE2EDuration="6.568752601s" totalImagesPullingTime="5.000067041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:45.562651305 +0000 UTC m=+366.136050589" watchObservedRunningTime="2026-07-06 21:04:45.568752601 +0000 UTC m=+366.142151885" Jul 06 21:04:45.621413 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:45.621344 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" podStartSLOduration=1.756164507 podStartE2EDuration="5.621321409s" totalImagesPullingTime="3.865156902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:45.616974764 +0000 UTC m=+366.190374039" watchObservedRunningTime="2026-07-06 21:04:45.621321409 +0000 UTC m=+366.194720694" Jul 06 21:04:46.502361 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:04:46.502332 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7jgv" Jul 06 21:05:16.504148 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:16.504109 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zsq6n" Jul 06 21:05:17.511851 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:17.511820 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9chlv" Jul 06 21:05:41.655433 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.655398 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb"] Jul 06 21:05:41.657848 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.657832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.660897 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.660878 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 21:05:41.661154 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.661137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f6h6j\"" Jul 06 21:05:41.662157 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.662141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 21:05:41.671733 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.671707 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb"] Jul 06 21:05:41.719560 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.719525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htjfr\" (UniqueName: \"kubernetes.io/projected/1e6796a0-7b4c-434b-a036-a2343549099b-kube-api-access-htjfr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.719722 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.719585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.719722 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.719606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.820914 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.820878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjfr\" (UniqueName: \"kubernetes.io/projected/1e6796a0-7b4c-434b-a036-a2343549099b-kube-api-access-htjfr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.821089 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.820955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.821089 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.820982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.821349 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.821331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.821397 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.821381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.836365 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.836340 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjfr\" (UniqueName: \"kubernetes.io/projected/1e6796a0-7b4c-434b-a036-a2343549099b-kube-api-access-htjfr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:41.966322 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:41.966227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:42.105038 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.104939 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb"] Jul 06 21:05:42.107655 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:05:42.107623 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6796a0_7b4c_434b_a036_a2343549099b.slice/crio-f4df328ba29b92302692f9960a24f9b043a887ed0163afae1110ca297f459b68 WatchSource:0}: Error finding container f4df328ba29b92302692f9960a24f9b043a887ed0163afae1110ca297f459b68: Status 404 returned error can't find the container with id f4df328ba29b92302692f9960a24f9b043a887ed0163afae1110ca297f459b68 Jul 06 21:05:42.285119 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.285088 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2"] Jul 06 21:05:42.287409 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.287394 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.302572 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.302542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2"] Jul 06 21:05:42.425902 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.425864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fmzk\" (UniqueName: \"kubernetes.io/projected/e14372c6-3738-4f11-a54a-4a7d0649a973-kube-api-access-8fmzk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.425902 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.425902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.426150 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.425931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.527425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.527337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fmzk\" (UniqueName: \"kubernetes.io/projected/e14372c6-3738-4f11-a54a-4a7d0649a973-kube-api-access-8fmzk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.527425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.527375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.527425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.527412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.527826 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.527801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.527864 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.527809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.538939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.538905 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fmzk\" (UniqueName: \"kubernetes.io/projected/e14372c6-3738-4f11-a54a-4a7d0649a973-kube-api-access-8fmzk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.596489 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.596451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:42.735321 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.735293 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2"] Jul 06 21:05:42.737553 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:05:42.737526 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14372c6_3738_4f11_a54a_4a7d0649a973.slice/crio-8247b9a2f041764019740cde09d0350ab45f2a28d3765a2da82aec5e3d9390b0 WatchSource:0}: Error finding container 8247b9a2f041764019740cde09d0350ab45f2a28d3765a2da82aec5e3d9390b0: Status 404 returned error can't find the container with id 8247b9a2f041764019740cde09d0350ab45f2a28d3765a2da82aec5e3d9390b0 Jul 06 21:05:42.756262 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.756237 2562 generic.go:356] "Generic (PLEG): container finished" podID="1e6796a0-7b4c-434b-a036-a2343549099b" containerID="3ad691cb04a104caa37cf37d813b1a429697eaf9c47dcd8b276e00456f6e599e" exitCode=0 Jul 06 21:05:42.756366 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.756327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" event={"ID":"1e6796a0-7b4c-434b-a036-a2343549099b","Type":"ContainerDied","Data":"3ad691cb04a104caa37cf37d813b1a429697eaf9c47dcd8b276e00456f6e599e"} Jul 06 21:05:42.756425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.756389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" event={"ID":"1e6796a0-7b4c-434b-a036-a2343549099b","Type":"ContainerStarted","Data":"f4df328ba29b92302692f9960a24f9b043a887ed0163afae1110ca297f459b68"} Jul 06 21:05:42.757758 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.757737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" event={"ID":"e14372c6-3738-4f11-a54a-4a7d0649a973","Type":"ContainerStarted","Data":"8247b9a2f041764019740cde09d0350ab45f2a28d3765a2da82aec5e3d9390b0"} Jul 06 21:05:42.875323 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.875294 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg"] Jul 06 21:05:42.877685 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.877661 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:42.891741 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:42.891708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg"] Jul 06 21:05:43.032936 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.032899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.033083 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.032963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7h8\" (UniqueName: \"kubernetes.io/projected/b4a401be-be68-4e63-80ae-3a1b613402df-kube-api-access-dq7h8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.033083 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.033009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.134399 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.134367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.134542 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.134425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7h8\" (UniqueName: \"kubernetes.io/projected/b4a401be-be68-4e63-80ae-3a1b613402df-kube-api-access-dq7h8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.134542 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.134470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.134844 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.134828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.134877 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.134826 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.145280 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.145252 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7h8\" (UniqueName: \"kubernetes.io/projected/b4a401be-be68-4e63-80ae-3a1b613402df-kube-api-access-dq7h8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.223265 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.223231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:43.358129 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.358103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg"] Jul 06 21:05:43.360629 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:05:43.360606 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a401be_be68_4e63_80ae_3a1b613402df.slice/crio-c06f73f52d12e6f13d67497fb6fce4d50d6a1814b76afc0be8b960b8de5ff81c WatchSource:0}: Error finding container c06f73f52d12e6f13d67497fb6fce4d50d6a1814b76afc0be8b960b8de5ff81c: Status 404 returned error can't find the container with id c06f73f52d12e6f13d67497fb6fce4d50d6a1814b76afc0be8b960b8de5ff81c Jul 06 21:05:43.466140 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.466113 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s"] Jul 06 21:05:43.468637 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.468619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.480950 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.480919 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s"] Jul 06 21:05:43.539039 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.538863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.539039 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.538895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7swn\" (UniqueName: \"kubernetes.io/projected/785eda7a-eab7-4285-953b-3c070c1d35e8-kube-api-access-t7swn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.539039 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.538987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.639866 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.639807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.639975 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.639886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.639975 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.639918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7swn\" (UniqueName: \"kubernetes.io/projected/785eda7a-eab7-4285-953b-3c070c1d35e8-kube-api-access-t7swn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.640245 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.640206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.640341 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.640244 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.650131 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.650111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7swn\" (UniqueName: \"kubernetes.io/projected/785eda7a-eab7-4285-953b-3c070c1d35e8-kube-api-access-t7swn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.764018 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.763986 2562 generic.go:356] "Generic (PLEG): container finished" podID="b4a401be-be68-4e63-80ae-3a1b613402df" containerID="bde3f790f21d695cf7e847b7356f9e701d1847cc6de4b54edc73ab25e095de5c" exitCode=0 Jul 06 21:05:43.764443 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.764076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" event={"ID":"b4a401be-be68-4e63-80ae-3a1b613402df","Type":"ContainerDied","Data":"bde3f790f21d695cf7e847b7356f9e701d1847cc6de4b54edc73ab25e095de5c"} Jul 06 21:05:43.764443 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.764138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" event={"ID":"b4a401be-be68-4e63-80ae-3a1b613402df","Type":"ContainerStarted","Data":"c06f73f52d12e6f13d67497fb6fce4d50d6a1814b76afc0be8b960b8de5ff81c"} Jul 06 21:05:43.765920 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.765896 2562 generic.go:356] "Generic (PLEG): container finished" podID="1e6796a0-7b4c-434b-a036-a2343549099b" containerID="cf2f347263f2a22cdbc37444bbf1cdd19b421e424acad75f28398c7ef577fedb" exitCode=0 Jul 06 21:05:43.766035 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.765986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" event={"ID":"1e6796a0-7b4c-434b-a036-a2343549099b","Type":"ContainerDied","Data":"cf2f347263f2a22cdbc37444bbf1cdd19b421e424acad75f28398c7ef577fedb"} Jul 06 21:05:43.767575 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.767556 2562 generic.go:356] "Generic (PLEG): container finished" podID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerID="917f819bfbecfc949c581fea05da8495eb05033aff9203da6552a3ec8621b444" exitCode=0 Jul 06 21:05:43.767623 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.767608 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" event={"ID":"e14372c6-3738-4f11-a54a-4a7d0649a973","Type":"ContainerDied","Data":"917f819bfbecfc949c581fea05da8495eb05033aff9203da6552a3ec8621b444"} Jul 06 21:05:43.817428 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.817411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:43.981748 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:43.981653 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s"] Jul 06 21:05:43.984027 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:05:43.983996 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785eda7a_eab7_4285_953b_3c070c1d35e8.slice/crio-83d97993587d9d7caa01d4106dfd3c931f60b49dcb85925491f4c4aed852c355 WatchSource:0}: Error finding container 83d97993587d9d7caa01d4106dfd3c931f60b49dcb85925491f4c4aed852c355: Status 404 returned error can't find the container with id 83d97993587d9d7caa01d4106dfd3c931f60b49dcb85925491f4c4aed852c355 Jul 06 21:05:44.773882 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.773848 2562 generic.go:356] "Generic (PLEG): container finished" podID="b4a401be-be68-4e63-80ae-3a1b613402df" containerID="0a6eabca4b884df9e73be504a4d76fc3fb099f2a109ccc80c12df21c3bf61327" exitCode=0 Jul 06 21:05:44.774312 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.773934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" event={"ID":"b4a401be-be68-4e63-80ae-3a1b613402df","Type":"ContainerDied","Data":"0a6eabca4b884df9e73be504a4d76fc3fb099f2a109ccc80c12df21c3bf61327"} Jul 06 21:05:44.776261 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.776240 2562 generic.go:356] "Generic (PLEG): container finished" podID="1e6796a0-7b4c-434b-a036-a2343549099b" containerID="d039d5d1be1e80cf3554044cc4fa89af18307c07eaf46041d38dcb930019efe0" exitCode=0 Jul 06 21:05:44.776362 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.776331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" event={"ID":"1e6796a0-7b4c-434b-a036-a2343549099b","Type":"ContainerDied","Data":"d039d5d1be1e80cf3554044cc4fa89af18307c07eaf46041d38dcb930019efe0"} Jul 06 21:05:44.777856 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.777839 2562 generic.go:356] "Generic (PLEG): container finished" podID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerID="27594e8de798e109e1092b1e35551d14df101f9a29e7fb898da2ff68dad176d0" exitCode=0 Jul 06 21:05:44.777936 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.777919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" event={"ID":"785eda7a-eab7-4285-953b-3c070c1d35e8","Type":"ContainerDied","Data":"27594e8de798e109e1092b1e35551d14df101f9a29e7fb898da2ff68dad176d0"} Jul 06 21:05:44.778050 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.777957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" event={"ID":"785eda7a-eab7-4285-953b-3c070c1d35e8","Type":"ContainerStarted","Data":"83d97993587d9d7caa01d4106dfd3c931f60b49dcb85925491f4c4aed852c355"} Jul 06 21:05:44.779874 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.779854 2562 generic.go:356] "Generic (PLEG): container finished" podID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerID="0d77e5b84436d0db0e498ce77f8f3188a53116ad7c909682f053825ee5545ce9" exitCode=0 Jul 06 21:05:44.779990 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:44.779911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" event={"ID":"e14372c6-3738-4f11-a54a-4a7d0649a973","Type":"ContainerDied","Data":"0d77e5b84436d0db0e498ce77f8f3188a53116ad7c909682f053825ee5545ce9"} Jul 06 21:05:45.787247 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:45.787136 2562 generic.go:356] "Generic (PLEG): container finished" podID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerID="5cd99db0f7ca497edbc1792940985505f55777e505bba5e67f4cdb2bee88a867" exitCode=0 Jul 06 21:05:45.787653 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:45.787236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" event={"ID":"e14372c6-3738-4f11-a54a-4a7d0649a973","Type":"ContainerDied","Data":"5cd99db0f7ca497edbc1792940985505f55777e505bba5e67f4cdb2bee88a867"} Jul 06 21:05:45.789338 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:45.789312 2562 generic.go:356] "Generic (PLEG): container finished" podID="b4a401be-be68-4e63-80ae-3a1b613402df" containerID="7e35b9a79bb5fe16d84dd93336d4aee303f0c1f91e7556c2a1cd49a2129c6fa3" exitCode=0 Jul 06 21:05:45.789472 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:45.789396 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" event={"ID":"b4a401be-be68-4e63-80ae-3a1b613402df","Type":"ContainerDied","Data":"7e35b9a79bb5fe16d84dd93336d4aee303f0c1f91e7556c2a1cd49a2129c6fa3"} Jul 06 21:05:45.791162 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:45.791140 2562 generic.go:356] "Generic (PLEG): container finished" podID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerID="2ba3e2a4352b3fb0cf1ebb06b2fbc0ed0239da0a66a2e8a26a657e32e7cc9a9f" exitCode=0 Jul 06 21:05:45.791282 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:45.791231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" event={"ID":"785eda7a-eab7-4285-953b-3c070c1d35e8","Type":"ContainerDied","Data":"2ba3e2a4352b3fb0cf1ebb06b2fbc0ed0239da0a66a2e8a26a657e32e7cc9a9f"} Jul 06 21:05:45.923053 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:45.923029 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:46.060317 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.060198 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htjfr\" (UniqueName: \"kubernetes.io/projected/1e6796a0-7b4c-434b-a036-a2343549099b-kube-api-access-htjfr\") pod \"1e6796a0-7b4c-434b-a036-a2343549099b\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " Jul 06 21:05:46.060447 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.060381 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-util\") pod \"1e6796a0-7b4c-434b-a036-a2343549099b\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " Jul 06 21:05:46.060447 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.060400 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-bundle\") pod \"1e6796a0-7b4c-434b-a036-a2343549099b\" (UID: \"1e6796a0-7b4c-434b-a036-a2343549099b\") " Jul 06 21:05:46.060928 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.060903 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-bundle" (OuterVolumeSpecName: "bundle") pod "1e6796a0-7b4c-434b-a036-a2343549099b" (UID: "1e6796a0-7b4c-434b-a036-a2343549099b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:46.062547 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.062516 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e6796a0-7b4c-434b-a036-a2343549099b-kube-api-access-htjfr" (OuterVolumeSpecName: "kube-api-access-htjfr") pod "1e6796a0-7b4c-434b-a036-a2343549099b" (UID: "1e6796a0-7b4c-434b-a036-a2343549099b"). InnerVolumeSpecName "kube-api-access-htjfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:05:46.067408 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.067385 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-util" (OuterVolumeSpecName: "util") pod "1e6796a0-7b4c-434b-a036-a2343549099b" (UID: "1e6796a0-7b4c-434b-a036-a2343549099b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:46.161424 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.161374 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htjfr\" (UniqueName: \"kubernetes.io/projected/1e6796a0-7b4c-434b-a036-a2343549099b-kube-api-access-htjfr\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:46.161424 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.161416 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-util\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:46.161424 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.161426 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6796a0-7b4c-434b-a036-a2343549099b-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:46.800250 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.800204 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" Jul 06 21:05:46.800756 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.800193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb" event={"ID":"1e6796a0-7b4c-434b-a036-a2343549099b","Type":"ContainerDied","Data":"f4df328ba29b92302692f9960a24f9b043a887ed0163afae1110ca297f459b68"} Jul 06 21:05:46.800756 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.800380 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4df328ba29b92302692f9960a24f9b043a887ed0163afae1110ca297f459b68" Jul 06 21:05:46.802500 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.802472 2562 generic.go:356] "Generic (PLEG): container finished" podID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerID="f8772655c8ac9cd62ce68331fe7fd945be846355e6a1b872270703429d9ee0f8" exitCode=0 Jul 06 21:05:46.802642 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.802540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" event={"ID":"785eda7a-eab7-4285-953b-3c070c1d35e8","Type":"ContainerDied","Data":"f8772655c8ac9cd62ce68331fe7fd945be846355e6a1b872270703429d9ee0f8"} Jul 06 21:05:46.932391 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.932368 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:46.962884 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:46.962864 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:47.069842 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.069761 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-bundle\") pod \"b4a401be-be68-4e63-80ae-3a1b613402df\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " Jul 06 21:05:47.069842 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.069802 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-bundle\") pod \"e14372c6-3738-4f11-a54a-4a7d0649a973\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " Jul 06 21:05:47.069842 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.069822 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-util\") pod \"b4a401be-be68-4e63-80ae-3a1b613402df\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " Jul 06 21:05:47.070120 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.069856 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fmzk\" (UniqueName: \"kubernetes.io/projected/e14372c6-3738-4f11-a54a-4a7d0649a973-kube-api-access-8fmzk\") pod \"e14372c6-3738-4f11-a54a-4a7d0649a973\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " Jul 06 21:05:47.070120 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.069918 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-util\") pod \"e14372c6-3738-4f11-a54a-4a7d0649a973\" (UID: \"e14372c6-3738-4f11-a54a-4a7d0649a973\") " Jul 06 21:05:47.070120 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.069935 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq7h8\" (UniqueName: \"kubernetes.io/projected/b4a401be-be68-4e63-80ae-3a1b613402df-kube-api-access-dq7h8\") pod \"b4a401be-be68-4e63-80ae-3a1b613402df\" (UID: \"b4a401be-be68-4e63-80ae-3a1b613402df\") " Jul 06 21:05:47.070404 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.070377 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-bundle" (OuterVolumeSpecName: "bundle") pod "b4a401be-be68-4e63-80ae-3a1b613402df" (UID: "b4a401be-be68-4e63-80ae-3a1b613402df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:47.070508 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.070433 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-bundle" (OuterVolumeSpecName: "bundle") pod "e14372c6-3738-4f11-a54a-4a7d0649a973" (UID: "e14372c6-3738-4f11-a54a-4a7d0649a973"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:47.072363 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.072328 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a401be-be68-4e63-80ae-3a1b613402df-kube-api-access-dq7h8" (OuterVolumeSpecName: "kube-api-access-dq7h8") pod "b4a401be-be68-4e63-80ae-3a1b613402df" (UID: "b4a401be-be68-4e63-80ae-3a1b613402df"). InnerVolumeSpecName "kube-api-access-dq7h8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:05:47.072585 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.072561 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14372c6-3738-4f11-a54a-4a7d0649a973-kube-api-access-8fmzk" (OuterVolumeSpecName: "kube-api-access-8fmzk") pod "e14372c6-3738-4f11-a54a-4a7d0649a973" (UID: "e14372c6-3738-4f11-a54a-4a7d0649a973"). InnerVolumeSpecName "kube-api-access-8fmzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:05:47.075643 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.075622 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-util" (OuterVolumeSpecName: "util") pod "b4a401be-be68-4e63-80ae-3a1b613402df" (UID: "b4a401be-be68-4e63-80ae-3a1b613402df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:47.076119 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.076101 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-util" (OuterVolumeSpecName: "util") pod "e14372c6-3738-4f11-a54a-4a7d0649a973" (UID: "e14372c6-3738-4f11-a54a-4a7d0649a973"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:47.171004 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.170965 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-util\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:47.171004 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.170996 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq7h8\" (UniqueName: \"kubernetes.io/projected/b4a401be-be68-4e63-80ae-3a1b613402df-kube-api-access-dq7h8\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:47.171004 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.171007 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:47.171274 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.171016 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14372c6-3738-4f11-a54a-4a7d0649a973-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:47.171274 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.171025 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a401be-be68-4e63-80ae-3a1b613402df-util\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:47.171274 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.171033 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fmzk\" (UniqueName: \"kubernetes.io/projected/e14372c6-3738-4f11-a54a-4a7d0649a973-kube-api-access-8fmzk\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:47.809821 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.809785 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" Jul 06 21:05:47.809821 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.809794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2" event={"ID":"e14372c6-3738-4f11-a54a-4a7d0649a973","Type":"ContainerDied","Data":"8247b9a2f041764019740cde09d0350ab45f2a28d3765a2da82aec5e3d9390b0"} Jul 06 21:05:47.810381 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.809878 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8247b9a2f041764019740cde09d0350ab45f2a28d3765a2da82aec5e3d9390b0" Jul 06 21:05:47.811903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.811874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" event={"ID":"b4a401be-be68-4e63-80ae-3a1b613402df","Type":"ContainerDied","Data":"c06f73f52d12e6f13d67497fb6fce4d50d6a1814b76afc0be8b960b8de5ff81c"} Jul 06 21:05:47.812040 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.811925 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c06f73f52d12e6f13d67497fb6fce4d50d6a1814b76afc0be8b960b8de5ff81c" Jul 06 21:05:47.812040 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.811888 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg" Jul 06 21:05:47.950483 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:47.950461 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:48.078826 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.078732 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7swn\" (UniqueName: \"kubernetes.io/projected/785eda7a-eab7-4285-953b-3c070c1d35e8-kube-api-access-t7swn\") pod \"785eda7a-eab7-4285-953b-3c070c1d35e8\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " Jul 06 21:05:48.078826 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.078781 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-util\") pod \"785eda7a-eab7-4285-953b-3c070c1d35e8\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " Jul 06 21:05:48.079014 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.078863 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-bundle\") pod \"785eda7a-eab7-4285-953b-3c070c1d35e8\" (UID: \"785eda7a-eab7-4285-953b-3c070c1d35e8\") " Jul 06 21:05:48.079633 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.079602 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-bundle" (OuterVolumeSpecName: "bundle") pod "785eda7a-eab7-4285-953b-3c070c1d35e8" (UID: "785eda7a-eab7-4285-953b-3c070c1d35e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:48.081024 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.081003 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785eda7a-eab7-4285-953b-3c070c1d35e8-kube-api-access-t7swn" (OuterVolumeSpecName: "kube-api-access-t7swn") pod "785eda7a-eab7-4285-953b-3c070c1d35e8" (UID: "785eda7a-eab7-4285-953b-3c070c1d35e8"). InnerVolumeSpecName "kube-api-access-t7swn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:05:48.084191 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.084173 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-util" (OuterVolumeSpecName: "util") pod "785eda7a-eab7-4285-953b-3c070c1d35e8" (UID: "785eda7a-eab7-4285-953b-3c070c1d35e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:05:48.180308 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.180272 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:48.180308 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.180302 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7swn\" (UniqueName: \"kubernetes.io/projected/785eda7a-eab7-4285-953b-3c070c1d35e8-kube-api-access-t7swn\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:48.180308 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.180312 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/785eda7a-eab7-4285-953b-3c070c1d35e8-util\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:05:48.818338 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.818311 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" Jul 06 21:05:48.818815 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.818309 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s" event={"ID":"785eda7a-eab7-4285-953b-3c070c1d35e8","Type":"ContainerDied","Data":"83d97993587d9d7caa01d4106dfd3c931f60b49dcb85925491f4c4aed852c355"} Jul 06 21:05:48.818815 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:05:48.818430 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83d97993587d9d7caa01d4106dfd3c931f60b49dcb85925491f4c4aed852c355" Jul 06 21:06:02.355368 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355287 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784"] Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355656 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a401be-be68-4e63-80ae-3a1b613402df" containerName="extract" Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355669 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a401be-be68-4e63-80ae-3a1b613402df" containerName="extract" Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355678 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerName="extract" Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355683 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerName="extract" Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355693 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6796a0-7b4c-434b-a036-a2343549099b" containerName="extract" Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355698 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6796a0-7b4c-434b-a036-a2343549099b" containerName="extract" Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355708 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6796a0-7b4c-434b-a036-a2343549099b" containerName="pull" Jul 06 21:06:02.355714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355713 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6796a0-7b4c-434b-a036-a2343549099b" containerName="pull" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355721 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerName="extract" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355726 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerName="extract" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355733 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerName="pull" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355739 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerName="pull" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355744 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerName="pull" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355749 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerName="pull" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355755 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6796a0-7b4c-434b-a036-a2343549099b" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355759 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6796a0-7b4c-434b-a036-a2343549099b" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355768 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355774 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355780 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a401be-be68-4e63-80ae-3a1b613402df" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355785 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a401be-be68-4e63-80ae-3a1b613402df" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355791 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355797 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerName="util" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355802 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a401be-be68-4e63-80ae-3a1b613402df" containerName="pull" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355806 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a401be-be68-4e63-80ae-3a1b613402df" containerName="pull" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355853 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a401be-be68-4e63-80ae-3a1b613402df" containerName="extract" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355861 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14372c6-3738-4f11-a54a-4a7d0649a973" containerName="extract" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355867 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="785eda7a-eab7-4285-953b-3c070c1d35e8" containerName="extract" Jul 06 21:06:02.355949 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.355874 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e6796a0-7b4c-434b-a036-a2343549099b" containerName="extract" Jul 06 21:06:02.357973 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.357956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" Jul 06 21:06:02.364159 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.364139 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zwcg7\"" Jul 06 21:06:02.364279 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.364160 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 21:06:02.364734 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.364697 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 21:06:02.368074 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.368046 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 21:06:02.375176 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.375156 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784"] Jul 06 21:06:02.401703 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.401669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbz96\" (UniqueName: \"kubernetes.io/projected/b2963739-1d08-42e8-9c35-c6575d867920-kube-api-access-cbz96\") pod \"dns-operator-controller-manager-864dd78c4c-m8784\" (UID: \"b2963739-1d08-42e8-9c35-c6575d867920\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" Jul 06 21:06:02.502824 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.502788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz96\" (UniqueName: \"kubernetes.io/projected/b2963739-1d08-42e8-9c35-c6575d867920-kube-api-access-cbz96\") pod \"dns-operator-controller-manager-864dd78c4c-m8784\" (UID: \"b2963739-1d08-42e8-9c35-c6575d867920\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" Jul 06 21:06:02.554261 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.554226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbz96\" (UniqueName: \"kubernetes.io/projected/b2963739-1d08-42e8-9c35-c6575d867920-kube-api-access-cbz96\") pod \"dns-operator-controller-manager-864dd78c4c-m8784\" (UID: \"b2963739-1d08-42e8-9c35-c6575d867920\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" Jul 06 21:06:02.668449 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.668363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" Jul 06 21:06:02.819310 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.819285 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784"] Jul 06 21:06:02.821002 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:06:02.820974 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2963739_1d08_42e8_9c35_c6575d867920.slice/crio-5576bee439c61230c0361b0c2e99066259b84c8c94973950255d6b0bb3c06686 WatchSource:0}: Error finding container 5576bee439c61230c0361b0c2e99066259b84c8c94973950255d6b0bb3c06686: Status 404 returned error can't find the container with id 5576bee439c61230c0361b0c2e99066259b84c8c94973950255d6b0bb3c06686 Jul 06 21:06:02.891376 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:02.891342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" event={"ID":"b2963739-1d08-42e8-9c35-c6575d867920","Type":"ContainerStarted","Data":"5576bee439c61230c0361b0c2e99066259b84c8c94973950255d6b0bb3c06686"} Jul 06 21:06:05.908041 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:05.908005 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" event={"ID":"b2963739-1d08-42e8-9c35-c6575d867920","Type":"ContainerStarted","Data":"21919cc030e5e6cf715fffe776d3c9e50e1b7c365d42e6f818fad6f53c380343"} Jul 06 21:06:05.908510 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:05.908141 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" Jul 06 21:06:05.935001 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:05.934952 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" podStartSLOduration=1.8642211419999999 podStartE2EDuration="3.934939517s" totalImagesPullingTime="2.070718375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:05.933728796 +0000 UTC m=+446.507128059" watchObservedRunningTime="2026-07-06 21:06:05.934939517 +0000 UTC m=+446.508338800" Jul 06 21:06:09.411313 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.411279 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk"] Jul 06 21:06:09.414606 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.414591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:09.420510 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.420489 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nc4qn\"" Jul 06 21:06:09.435105 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.435074 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk"] Jul 06 21:06:09.456400 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.456366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbj2\" (UniqueName: \"kubernetes.io/projected/b70cfdc7-d24f-49d8-9075-b8ddedeb2332-kube-api-access-mtbj2\") pod \"limitador-operator-controller-manager-859d7b78bd-46mpk\" (UID: \"b70cfdc7-d24f-49d8-9075-b8ddedeb2332\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:09.556916 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.556878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbj2\" (UniqueName: \"kubernetes.io/projected/b70cfdc7-d24f-49d8-9075-b8ddedeb2332-kube-api-access-mtbj2\") pod \"limitador-operator-controller-manager-859d7b78bd-46mpk\" (UID: \"b70cfdc7-d24f-49d8-9075-b8ddedeb2332\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:09.571237 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.571199 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbj2\" (UniqueName: \"kubernetes.io/projected/b70cfdc7-d24f-49d8-9075-b8ddedeb2332-kube-api-access-mtbj2\") pod \"limitador-operator-controller-manager-859d7b78bd-46mpk\" (UID: \"b70cfdc7-d24f-49d8-9075-b8ddedeb2332\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:09.725314 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.725206 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:09.865511 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.865482 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk"] Jul 06 21:06:09.867342 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:06:09.867313 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70cfdc7_d24f_49d8_9075_b8ddedeb2332.slice/crio-659d44356c34e94f280d8fb41ad0cfd3ca261b78ec05f94919dfcbe88aa99c7d WatchSource:0}: Error finding container 659d44356c34e94f280d8fb41ad0cfd3ca261b78ec05f94919dfcbe88aa99c7d: Status 404 returned error can't find the container with id 659d44356c34e94f280d8fb41ad0cfd3ca261b78ec05f94919dfcbe88aa99c7d Jul 06 21:06:09.928874 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:09.928837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" event={"ID":"b70cfdc7-d24f-49d8-9075-b8ddedeb2332","Type":"ContainerStarted","Data":"659d44356c34e94f280d8fb41ad0cfd3ca261b78ec05f94919dfcbe88aa99c7d"} Jul 06 21:06:11.942270 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:11.942226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" event={"ID":"b70cfdc7-d24f-49d8-9075-b8ddedeb2332","Type":"ContainerStarted","Data":"c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91"} Jul 06 21:06:11.942656 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:11.942294 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:11.991480 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:11.991425 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" podStartSLOduration=1.092350174 podStartE2EDuration="2.991408457s" totalImagesPullingTime="1.899058283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:11.9893317 +0000 UTC m=+452.562730988" watchObservedRunningTime="2026-07-06 21:06:11.991408457 +0000 UTC m=+452.564807740" Jul 06 21:06:16.915915 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:16.915886 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8784" Jul 06 21:06:22.949817 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:22.949787 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:29.229059 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.229020 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk"] Jul 06 21:06:29.229511 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.229307 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" containerName="manager" containerID="cri-o://c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91" gracePeriod=2 Jul 06 21:06:29.236793 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.236757 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk"] Jul 06 21:06:29.260203 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.260173 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27"] Jul 06 21:06:29.260581 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.260567 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" containerName="manager" Jul 06 21:06:29.260627 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.260582 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" containerName="manager" Jul 06 21:06:29.260661 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.260639 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" containerName="manager" Jul 06 21:06:29.262900 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.262879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" Jul 06 21:06:29.269679 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:06:29.269651 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-46mpk\" is forbidden: User \"system:node:ip-10-0-136-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-218.ec2.internal' and this object" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:29.287462 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.287432 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27"] Jul 06 21:06:29.335966 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.335924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kwjw\" (UniqueName: \"kubernetes.io/projected/655b7a90-afc1-492c-9768-ad4802684bb5-kube-api-access-4kwjw\") pod \"limitador-operator-controller-manager-859d7b78bd-w2n27\" (UID: \"655b7a90-afc1-492c-9768-ad4802684bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" Jul 06 21:06:29.436865 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.436829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kwjw\" (UniqueName: \"kubernetes.io/projected/655b7a90-afc1-492c-9768-ad4802684bb5-kube-api-access-4kwjw\") pod \"limitador-operator-controller-manager-859d7b78bd-w2n27\" (UID: \"655b7a90-afc1-492c-9768-ad4802684bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" Jul 06 21:06:29.446931 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.446899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kwjw\" (UniqueName: \"kubernetes.io/projected/655b7a90-afc1-492c-9768-ad4802684bb5-kube-api-access-4kwjw\") pod \"limitador-operator-controller-manager-859d7b78bd-w2n27\" (UID: \"655b7a90-afc1-492c-9768-ad4802684bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" Jul 06 21:06:29.467662 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.467639 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:29.470410 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:06:29.470381 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-46mpk\" is forbidden: User \"system:node:ip-10-0-136-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-218.ec2.internal' and this object" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:29.537899 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.537807 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtbj2\" (UniqueName: \"kubernetes.io/projected/b70cfdc7-d24f-49d8-9075-b8ddedeb2332-kube-api-access-mtbj2\") pod \"b70cfdc7-d24f-49d8-9075-b8ddedeb2332\" (UID: \"b70cfdc7-d24f-49d8-9075-b8ddedeb2332\") " Jul 06 21:06:29.539843 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.539817 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b70cfdc7-d24f-49d8-9075-b8ddedeb2332-kube-api-access-mtbj2" (OuterVolumeSpecName: "kube-api-access-mtbj2") pod "b70cfdc7-d24f-49d8-9075-b8ddedeb2332" (UID: "b70cfdc7-d24f-49d8-9075-b8ddedeb2332"). InnerVolumeSpecName "kube-api-access-mtbj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:06:29.600856 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.600827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" Jul 06 21:06:29.638931 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.638905 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtbj2\" (UniqueName: \"kubernetes.io/projected/b70cfdc7-d24f-49d8-9075-b8ddedeb2332-kube-api-access-mtbj2\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:06:29.739730 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.739701 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27"] Jul 06 21:06:29.741370 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:06:29.741344 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655b7a90_afc1_492c_9768_ad4802684bb5.slice/crio-26ed87331b8d009afb8441fb865575ec58a105fd91fa2ea0e23c9ebdd49ebf79 WatchSource:0}: Error finding container 26ed87331b8d009afb8441fb865575ec58a105fd91fa2ea0e23c9ebdd49ebf79: Status 404 returned error can't find the container with id 26ed87331b8d009afb8441fb865575ec58a105fd91fa2ea0e23c9ebdd49ebf79 Jul 06 21:06:29.940739 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:06:29.940704 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-46mpk\" is forbidden: User \"system:node:ip-10-0-136-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-218.ec2.internal' and this object" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:29.941898 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:29.941871 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" path="/var/lib/kubelet/pods/b70cfdc7-d24f-49d8-9075-b8ddedeb2332/volumes" Jul 06 21:06:30.030985 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.030955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" event={"ID":"655b7a90-afc1-492c-9768-ad4802684bb5","Type":"ContainerStarted","Data":"fcac990c871038b79782103756365125cfd78828f4e98edbb821bfb6cd1c943c"} Jul 06 21:06:30.031179 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.031008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" event={"ID":"655b7a90-afc1-492c-9768-ad4802684bb5","Type":"ContainerStarted","Data":"26ed87331b8d009afb8441fb865575ec58a105fd91fa2ea0e23c9ebdd49ebf79"} Jul 06 21:06:30.031179 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.031054 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" Jul 06 21:06:30.032315 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.032292 2562 generic.go:356] "Generic (PLEG): container finished" podID="b70cfdc7-d24f-49d8-9075-b8ddedeb2332" containerID="c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91" exitCode=0 Jul 06 21:06:30.032440 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.032339 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-46mpk" Jul 06 21:06:30.032440 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.032387 2562 scope.go:117] "RemoveContainer" containerID="c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91" Jul 06 21:06:30.041001 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.040984 2562 scope.go:117] "RemoveContainer" containerID="c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91" Jul 06 21:06:30.041291 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:06:30.041272 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91\": container with ID starting with c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91 not found: ID does not exist" containerID="c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91" Jul 06 21:06:30.041336 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.041299 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91"} err="failed to get container status \"c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91\": rpc error: code = NotFound desc = could not find container \"c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91\": container with ID starting with c94448161936b592b3af02c4b18505fb6d63f63be14aeca836aa7a5428446f91 not found: ID does not exist" Jul 06 21:06:30.050621 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:30.050582 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" podStartSLOduration=1.050569321 podStartE2EDuration="1.050569321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:30.04942097 +0000 UTC m=+470.622820255" watchObservedRunningTime="2026-07-06 21:06:30.050569321 +0000 UTC m=+470.623968605" Jul 06 21:06:41.040957 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.040927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2n27" Jul 06 21:06:41.734369 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.734333 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt"] Jul 06 21:06:41.739005 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.738980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:41.742872 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.742850 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kvxqb\"" Jul 06 21:06:41.759199 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.759175 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt"] Jul 06 21:06:41.848025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.847992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcdms\" (UniqueName: \"kubernetes.io/projected/668c6255-6a1b-4a66-8849-8f12b423ab12-kube-api-access-gcdms\") pod \"kuadrant-operator-controller-manager-86878c769f-hnfxt\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:41.848025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.848039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/668c6255-6a1b-4a66-8849-8f12b423ab12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hnfxt\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:41.949251 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.949205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcdms\" (UniqueName: \"kubernetes.io/projected/668c6255-6a1b-4a66-8849-8f12b423ab12-kube-api-access-gcdms\") pod \"kuadrant-operator-controller-manager-86878c769f-hnfxt\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:41.949411 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.949277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/668c6255-6a1b-4a66-8849-8f12b423ab12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hnfxt\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:41.949604 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.949587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/668c6255-6a1b-4a66-8849-8f12b423ab12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hnfxt\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:41.960802 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:41.960767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcdms\" (UniqueName: \"kubernetes.io/projected/668c6255-6a1b-4a66-8849-8f12b423ab12-kube-api-access-gcdms\") pod \"kuadrant-operator-controller-manager-86878c769f-hnfxt\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:42.048871 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:42.048780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:42.192434 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:42.192411 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt"] Jul 06 21:06:42.194364 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:06:42.194337 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668c6255_6a1b_4a66_8849_8f12b423ab12.slice/crio-f4c4beb101ca044cb9a0f0277093616f01f6e039fee6892087cae9334c1174cb WatchSource:0}: Error finding container f4c4beb101ca044cb9a0f0277093616f01f6e039fee6892087cae9334c1174cb: Status 404 returned error can't find the container with id f4c4beb101ca044cb9a0f0277093616f01f6e039fee6892087cae9334c1174cb Jul 06 21:06:43.106596 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:43.106562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" event={"ID":"668c6255-6a1b-4a66-8849-8f12b423ab12","Type":"ContainerStarted","Data":"f4c4beb101ca044cb9a0f0277093616f01f6e039fee6892087cae9334c1174cb"} Jul 06 21:06:48.136424 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:48.136389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" event={"ID":"668c6255-6a1b-4a66-8849-8f12b423ab12","Type":"ContainerStarted","Data":"22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3"} Jul 06 21:06:48.136918 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:48.136527 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:06:48.160870 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:48.160813 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" podStartSLOduration=1.6715867549999999 podStartE2EDuration="7.160796599s" totalImagesPullingTime="5.489209844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:48.158275996 +0000 UTC m=+488.731675279" watchObservedRunningTime="2026-07-06 21:06:48.160796599 +0000 UTC m=+488.734195880" Jul 06 21:06:50.955314 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:50.955276 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665cd7658b-4sbcp"] Jul 06 21:06:50.958702 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:50.958677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:50.969347 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:50.969320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665cd7658b-4sbcp"] Jul 06 21:06:51.133698 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.133647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-config\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.133698 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.133698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-oauth-serving-cert\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.133990 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.133765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-serving-cert\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.133990 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.133855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-trusted-ca-bundle\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.133990 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.133915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-oauth-config\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.133990 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.133982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-service-ca\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.134136 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.134008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjv64\" (UniqueName: \"kubernetes.io/projected/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-kube-api-access-pjv64\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235101 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-oauth-config\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235101 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-service-ca\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235101 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjv64\" (UniqueName: \"kubernetes.io/projected/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-kube-api-access-pjv64\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-config\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-oauth-serving-cert\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-serving-cert\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-trusted-ca-bundle\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.235885 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.235857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-service-ca\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.236068 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.236049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-config\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.236141 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.236090 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-oauth-serving-cert\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.236504 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.236478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-trusted-ca-bundle\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.237775 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.237755 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-oauth-config\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.237861 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.237825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-console-serving-cert\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.247176 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.247152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjv64\" (UniqueName: \"kubernetes.io/projected/4f1ded78-51f6-4d0f-bfe8-4c23aedb3316-kube-api-access-pjv64\") pod \"console-665cd7658b-4sbcp\" (UID: \"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316\") " pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.268054 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.268018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:06:51.415612 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:51.415582 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665cd7658b-4sbcp"] Jul 06 21:06:51.416251 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:06:51.416227 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1ded78_51f6_4d0f_bfe8_4c23aedb3316.slice/crio-25a2d7605752ca3b9340ec00540876fa6fce6857c6215c43b9a2e4e7a32ae3f1 WatchSource:0}: Error finding container 25a2d7605752ca3b9340ec00540876fa6fce6857c6215c43b9a2e4e7a32ae3f1: Status 404 returned error can't find the container with id 25a2d7605752ca3b9340ec00540876fa6fce6857c6215c43b9a2e4e7a32ae3f1 Jul 06 21:06:52.159731 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:52.159697 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665cd7658b-4sbcp" event={"ID":"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316","Type":"ContainerStarted","Data":"70b02cf8cdf8acdcd824e5772086e08c89444a4adba40b775a7650175fbd5843"} Jul 06 21:06:52.160246 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:52.159754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665cd7658b-4sbcp" event={"ID":"4f1ded78-51f6-4d0f-bfe8-4c23aedb3316","Type":"ContainerStarted","Data":"25a2d7605752ca3b9340ec00540876fa6fce6857c6215c43b9a2e4e7a32ae3f1"} Jul 06 21:06:52.183077 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:52.183024 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665cd7658b-4sbcp" podStartSLOduration=2.183003986 podStartE2EDuration="2.183003986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:52.182800569 +0000 UTC m=+492.756199856" watchObservedRunningTime="2026-07-06 21:06:52.183003986 +0000 UTC m=+492.756403272" Jul 06 21:06:59.143714 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:06:59.143682 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:07:01.268183 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:01.268143 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:07:01.268607 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:01.268244 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:07:01.273055 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:01.273034 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:07:02.218408 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:02.218381 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665cd7658b-4sbcp" Jul 06 21:07:02.269202 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:02.269169 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd4f677d-qfftn"] Jul 06 21:07:27.289042 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.288990 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dd4f677d-qfftn" podUID="8136fffc-0efa-4bc1-8691-f7af8628400b" containerName="console" containerID="cri-o://7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d" gracePeriod=15 Jul 06 21:07:27.531895 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.531870 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:07:27.653725 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.653695 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbfcc\" (UniqueName: \"kubernetes.io/projected/8136fffc-0efa-4bc1-8691-f7af8628400b-kube-api-access-mbfcc\") pod \"8136fffc-0efa-4bc1-8691-f7af8628400b\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " Jul 06 21:07:27.653903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.653750 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-service-ca\") pod \"8136fffc-0efa-4bc1-8691-f7af8628400b\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " Jul 06 21:07:27.653903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.653795 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-oauth-serving-cert\") pod \"8136fffc-0efa-4bc1-8691-f7af8628400b\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " Jul 06 21:07:27.653903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.653821 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-console-config\") pod \"8136fffc-0efa-4bc1-8691-f7af8628400b\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " Jul 06 21:07:27.653903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.653884 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-oauth-config\") pod \"8136fffc-0efa-4bc1-8691-f7af8628400b\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " Jul 06 21:07:27.654100 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.653921 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-serving-cert\") pod \"8136fffc-0efa-4bc1-8691-f7af8628400b\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " Jul 06 21:07:27.654100 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.653951 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-trusted-ca-bundle\") pod \"8136fffc-0efa-4bc1-8691-f7af8628400b\" (UID: \"8136fffc-0efa-4bc1-8691-f7af8628400b\") " Jul 06 21:07:27.654325 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.654295 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-service-ca" (OuterVolumeSpecName: "service-ca") pod "8136fffc-0efa-4bc1-8691-f7af8628400b" (UID: "8136fffc-0efa-4bc1-8691-f7af8628400b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:07:27.654454 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.654315 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8136fffc-0efa-4bc1-8691-f7af8628400b" (UID: "8136fffc-0efa-4bc1-8691-f7af8628400b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:07:27.654454 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.654342 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-console-config" (OuterVolumeSpecName: "console-config") pod "8136fffc-0efa-4bc1-8691-f7af8628400b" (UID: "8136fffc-0efa-4bc1-8691-f7af8628400b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:07:27.654634 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.654613 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8136fffc-0efa-4bc1-8691-f7af8628400b" (UID: "8136fffc-0efa-4bc1-8691-f7af8628400b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:07:27.655948 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.655920 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8136fffc-0efa-4bc1-8691-f7af8628400b-kube-api-access-mbfcc" (OuterVolumeSpecName: "kube-api-access-mbfcc") pod "8136fffc-0efa-4bc1-8691-f7af8628400b" (UID: "8136fffc-0efa-4bc1-8691-f7af8628400b"). InnerVolumeSpecName "kube-api-access-mbfcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:07:27.656050 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.656027 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8136fffc-0efa-4bc1-8691-f7af8628400b" (UID: "8136fffc-0efa-4bc1-8691-f7af8628400b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:07:27.656093 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.656051 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8136fffc-0efa-4bc1-8691-f7af8628400b" (UID: "8136fffc-0efa-4bc1-8691-f7af8628400b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:07:27.755537 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.755504 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-oauth-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:07:27.755537 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.755532 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8136fffc-0efa-4bc1-8691-f7af8628400b-console-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:07:27.755537 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.755541 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-trusted-ca-bundle\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:07:27.755762 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.755549 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbfcc\" (UniqueName: \"kubernetes.io/projected/8136fffc-0efa-4bc1-8691-f7af8628400b-kube-api-access-mbfcc\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:07:27.755762 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.755559 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-service-ca\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:07:27.755762 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.755568 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-oauth-serving-cert\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:07:27.755762 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:27.755576 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8136fffc-0efa-4bc1-8691-f7af8628400b-console-config\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:07:28.353276 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.353247 2562 generic.go:356] "Generic (PLEG): container finished" podID="8136fffc-0efa-4bc1-8691-f7af8628400b" containerID="7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d" exitCode=0 Jul 06 21:07:28.353708 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.353292 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd4f677d-qfftn" Jul 06 21:07:28.353708 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.353301 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4f677d-qfftn" event={"ID":"8136fffc-0efa-4bc1-8691-f7af8628400b","Type":"ContainerDied","Data":"7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d"} Jul 06 21:07:28.353708 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.353356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd4f677d-qfftn" event={"ID":"8136fffc-0efa-4bc1-8691-f7af8628400b","Type":"ContainerDied","Data":"4b4d397c0993386acf5c337cf99d64a0cfe47f57dc47434a1ce97388ebbb04d7"} Jul 06 21:07:28.353708 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.353384 2562 scope.go:117] "RemoveContainer" containerID="7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d" Jul 06 21:07:28.362163 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.362144 2562 scope.go:117] "RemoveContainer" containerID="7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d" Jul 06 21:07:28.362432 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:07:28.362407 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d\": container with ID starting with 7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d not found: ID does not exist" containerID="7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d" Jul 06 21:07:28.362521 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.362434 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d"} err="failed to get container status \"7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d\": rpc error: code = NotFound desc = could not find container \"7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d\": container with ID starting with 7770c4bbbce18e7af331cba6008744fa9ee92dc3240a9d6dbe6884cace27118d not found: ID does not exist" Jul 06 21:07:28.374046 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.374021 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd4f677d-qfftn"] Jul 06 21:07:28.381579 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:28.381559 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dd4f677d-qfftn"] Jul 06 21:07:29.941555 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:07:29.941525 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8136fffc-0efa-4bc1-8691-f7af8628400b" path="/var/lib/kubelet/pods/8136fffc-0efa-4bc1-8691-f7af8628400b/volumes" Jul 06 21:08:50.249118 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.249084 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9"] Jul 06 21:08:50.251582 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.249625 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8136fffc-0efa-4bc1-8691-f7af8628400b" containerName="console" Jul 06 21:08:50.251582 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.249646 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8136fffc-0efa-4bc1-8691-f7af8628400b" containerName="console" Jul 06 21:08:50.251582 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.249729 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8136fffc-0efa-4bc1-8691-f7af8628400b" containerName="console" Jul 06 21:08:50.252618 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.252602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.256550 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.256528 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 21:08:50.256695 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.256567 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6lnnj\"" Jul 06 21:08:50.256695 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.256586 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 21:08:50.256695 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.256591 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 21:08:50.263148 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.263056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.263461 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.263432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.263571 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.263485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.263571 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.263522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.263682 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.263578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hvtc\" (UniqueName: \"kubernetes.io/projected/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-kube-api-access-9hvtc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.263682 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.263669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.266277 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.266253 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9"] Jul 06 21:08:50.364894 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.364857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.364894 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.364897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.365106 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.364916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.365106 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.365042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hvtc\" (UniqueName: \"kubernetes.io/projected/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-kube-api-access-9hvtc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.365192 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.365122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.365192 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.365167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.365335 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.365284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.365430 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.365405 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.365490 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.365436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.367397 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.367369 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.367632 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.367611 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.374688 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.374665 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hvtc\" (UniqueName: \"kubernetes.io/projected/accfc042-cfc6-43dc-90d4-f8ca0fed2a7b-kube-api-access-9hvtc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9\" (UID: \"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.564639 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.564551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:08:50.710242 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.710189 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9"] Jul 06 21:08:50.711389 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:08:50.711355 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaccfc042_cfc6_43dc_90d4_f8ca0fed2a7b.slice/crio-fb5395d9c2482f75490bc673457022627e6af1164a6593b88862006434af88cf WatchSource:0}: Error finding container fb5395d9c2482f75490bc673457022627e6af1164a6593b88862006434af88cf: Status 404 returned error can't find the container with id fb5395d9c2482f75490bc673457022627e6af1164a6593b88862006434af88cf Jul 06 21:08:50.762942 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:50.762905 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" event={"ID":"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b","Type":"ContainerStarted","Data":"fb5395d9c2482f75490bc673457022627e6af1164a6593b88862006434af88cf"} Jul 06 21:08:52.774998 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:52.774959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" event={"ID":"accfc042-cfc6-43dc-90d4-f8ca0fed2a7b","Type":"ContainerStarted","Data":"ee4fffda15beac46144706a2637b5e58ae8f95b32017cc976b780fd8582666e7"} Jul 06 21:08:52.799194 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:08:52.799142 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" podStartSLOduration=1.772122957 podStartE2EDuration="2.799121429s" totalImagesPullingTime="1.026998472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:08:52.79711898 +0000 UTC m=+613.370518279" watchObservedRunningTime="2026-07-06 21:08:52.799121429 +0000 UTC m=+613.372520713" Jul 06 21:09:00.565179 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:00.565139 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:09:00.565596 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:00.565238 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:09:00.577966 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:00.577938 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:09:00.831845 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:00.831761 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9" Jul 06 21:09:28.246314 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.246261 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25"] Jul 06 21:09:28.252924 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.252906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.255903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.255883 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 21:09:28.261433 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.261408 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25"] Jul 06 21:09:28.417398 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.417363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9962659f-2839-4500-9ece-189b62a03ccf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.417398 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.417398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.417619 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.417421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjv49\" (UniqueName: \"kubernetes.io/projected/9962659f-2839-4500-9ece-189b62a03ccf-kube-api-access-vjv49\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.417619 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.417501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.417619 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.417534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.417619 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.417560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.518933 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.518843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9962659f-2839-4500-9ece-189b62a03ccf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.518933 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.518882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.518933 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.518903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv49\" (UniqueName: \"kubernetes.io/projected/9962659f-2839-4500-9ece-189b62a03ccf-kube-api-access-vjv49\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.518933 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.518937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.519299 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.518954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.519299 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.518974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.519400 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.519310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.519400 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.519389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.519480 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.519436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.521327 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.521297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9962659f-2839-4500-9ece-189b62a03ccf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.521498 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.521482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9962659f-2839-4500-9ece-189b62a03ccf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.529143 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.529114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjv49\" (UniqueName: \"kubernetes.io/projected/9962659f-2839-4500-9ece-189b62a03ccf-kube-api-access-vjv49\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25\" (UID: \"9962659f-2839-4500-9ece-189b62a03ccf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.563903 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.563861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:28.703901 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.703870 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25"] Jul 06 21:09:28.706094 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:09:28.706069 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9962659f_2839_4500_9ece_189b62a03ccf.slice/crio-a718726dd47b6e95f052c71722a9679d760f7a227bac57a080a7bcd79cfe413b WatchSource:0}: Error finding container a718726dd47b6e95f052c71722a9679d760f7a227bac57a080a7bcd79cfe413b: Status 404 returned error can't find the container with id a718726dd47b6e95f052c71722a9679d760f7a227bac57a080a7bcd79cfe413b Jul 06 21:09:28.708047 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.708020 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:09:28.972381 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:28.972356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" event={"ID":"9962659f-2839-4500-9ece-189b62a03ccf","Type":"ContainerStarted","Data":"a718726dd47b6e95f052c71722a9679d760f7a227bac57a080a7bcd79cfe413b"} Jul 06 21:09:29.979181 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:29.979149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" event={"ID":"9962659f-2839-4500-9ece-189b62a03ccf","Type":"ContainerStarted","Data":"d7abcfa067ad2f60ae8e79080c1ed843f2d0bc47492d2e586df7bec9f2758987"} Jul 06 21:09:30.002963 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:30.002901 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" podStartSLOduration=1.754400274 podStartE2EDuration="2.002885102s" totalImagesPullingTime="248.484828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:30.00131842 +0000 UTC m=+650.574717706" watchObservedRunningTime="2026-07-06 21:09:30.002885102 +0000 UTC m=+650.576284385" Jul 06 21:09:38.564533 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:38.564480 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:38.565026 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:38.564565 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:38.577034 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:38.577006 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:09:39.037854 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:09:39.037825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25" Jul 06 21:17:21.531728 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:21.531691 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt"] Jul 06 21:17:21.532299 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:21.531893 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" podUID="668c6255-6a1b-4a66-8849-8f12b423ab12" containerName="manager" containerID="cri-o://22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3" gracePeriod=10 Jul 06 21:17:23.686874 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:23.686844 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:17:23.698611 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:23.698591 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcdms\" (UniqueName: \"kubernetes.io/projected/668c6255-6a1b-4a66-8849-8f12b423ab12-kube-api-access-gcdms\") pod \"668c6255-6a1b-4a66-8849-8f12b423ab12\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " Jul 06 21:17:23.698727 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:23.698666 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/668c6255-6a1b-4a66-8849-8f12b423ab12-extensions-socket-volume\") pod \"668c6255-6a1b-4a66-8849-8f12b423ab12\" (UID: \"668c6255-6a1b-4a66-8849-8f12b423ab12\") " Jul 06 21:17:23.699019 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:23.698994 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/668c6255-6a1b-4a66-8849-8f12b423ab12-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "668c6255-6a1b-4a66-8849-8f12b423ab12" (UID: "668c6255-6a1b-4a66-8849-8f12b423ab12"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:17:23.700655 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:23.700627 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/668c6255-6a1b-4a66-8849-8f12b423ab12-kube-api-access-gcdms" (OuterVolumeSpecName: "kube-api-access-gcdms") pod "668c6255-6a1b-4a66-8849-8f12b423ab12" (UID: "668c6255-6a1b-4a66-8849-8f12b423ab12"). InnerVolumeSpecName "kube-api-access-gcdms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:17:23.800119 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:23.800031 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcdms\" (UniqueName: \"kubernetes.io/projected/668c6255-6a1b-4a66-8849-8f12b423ab12-kube-api-access-gcdms\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:17:23.800119 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:23.800065 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/668c6255-6a1b-4a66-8849-8f12b423ab12-extensions-socket-volume\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:17:24.437387 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.437353 2562 generic.go:356] "Generic (PLEG): container finished" podID="668c6255-6a1b-4a66-8849-8f12b423ab12" containerID="22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3" exitCode=0 Jul 06 21:17:24.437554 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.437397 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" Jul 06 21:17:24.437554 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.437439 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" event={"ID":"668c6255-6a1b-4a66-8849-8f12b423ab12","Type":"ContainerDied","Data":"22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3"} Jul 06 21:17:24.437554 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.437489 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt" event={"ID":"668c6255-6a1b-4a66-8849-8f12b423ab12","Type":"ContainerDied","Data":"f4c4beb101ca044cb9a0f0277093616f01f6e039fee6892087cae9334c1174cb"} Jul 06 21:17:24.437554 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.437510 2562 scope.go:117] "RemoveContainer" containerID="22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3" Jul 06 21:17:24.446979 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.446962 2562 scope.go:117] "RemoveContainer" containerID="22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3" Jul 06 21:17:24.447254 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:17:24.447236 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3\": container with ID starting with 22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3 not found: ID does not exist" containerID="22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3" Jul 06 21:17:24.447325 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.447264 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3"} err="failed to get container status \"22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3\": rpc error: code = NotFound desc = could not find container \"22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3\": container with ID starting with 22178320f42410025b1f6dc09e69e9c8c0134d87be321c153292c4a1fe6f36a3 not found: ID does not exist" Jul 06 21:17:24.458533 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.458514 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt"] Jul 06 21:17:24.462267 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:24.462245 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hnfxt"] Jul 06 21:17:25.942088 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:17:25.942058 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="668c6255-6a1b-4a66-8849-8f12b423ab12" path="/var/lib/kubelet/pods/668c6255-6a1b-4a66-8849-8f12b423ab12/volumes" Jul 06 21:18:22.795864 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.795825 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx"] Jul 06 21:18:22.796340 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.796205 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="668c6255-6a1b-4a66-8849-8f12b423ab12" containerName="manager" Jul 06 21:18:22.796340 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.796230 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="668c6255-6a1b-4a66-8849-8f12b423ab12" containerName="manager" Jul 06 21:18:22.796340 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.796305 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="668c6255-6a1b-4a66-8849-8f12b423ab12" containerName="manager" Jul 06 21:18:22.799381 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.799366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:22.802376 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.802355 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kvxqb\"" Jul 06 21:18:22.811761 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.811739 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx"] Jul 06 21:18:22.917572 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.917533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0d0e391-5e48-4199-a818-2c5f72d515f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qvftx\" (UID: \"b0d0e391-5e48-4199-a818-2c5f72d515f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:22.917770 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:22.917607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wxgk\" (UniqueName: \"kubernetes.io/projected/b0d0e391-5e48-4199-a818-2c5f72d515f8-kube-api-access-7wxgk\") pod \"kuadrant-operator-controller-manager-86878c769f-qvftx\" (UID: \"b0d0e391-5e48-4199-a818-2c5f72d515f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:23.018119 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.018080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0d0e391-5e48-4199-a818-2c5f72d515f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qvftx\" (UID: \"b0d0e391-5e48-4199-a818-2c5f72d515f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:23.018355 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.018270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wxgk\" (UniqueName: \"kubernetes.io/projected/b0d0e391-5e48-4199-a818-2c5f72d515f8-kube-api-access-7wxgk\") pod \"kuadrant-operator-controller-manager-86878c769f-qvftx\" (UID: \"b0d0e391-5e48-4199-a818-2c5f72d515f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:23.018480 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.018459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0d0e391-5e48-4199-a818-2c5f72d515f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qvftx\" (UID: \"b0d0e391-5e48-4199-a818-2c5f72d515f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:23.030108 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.030078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wxgk\" (UniqueName: \"kubernetes.io/projected/b0d0e391-5e48-4199-a818-2c5f72d515f8-kube-api-access-7wxgk\") pod \"kuadrant-operator-controller-manager-86878c769f-qvftx\" (UID: \"b0d0e391-5e48-4199-a818-2c5f72d515f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:23.109939 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.109905 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:23.272500 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.272472 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx"] Jul 06 21:18:23.276756 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:18:23.276732 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d0e391_5e48_4199_a818_2c5f72d515f8.slice/crio-9e43a0a6c19e3cfa06c908234cf9dcbfe7d4670e5721081fa347564fa2479c8a WatchSource:0}: Error finding container 9e43a0a6c19e3cfa06c908234cf9dcbfe7d4670e5721081fa347564fa2479c8a: Status 404 returned error can't find the container with id 9e43a0a6c19e3cfa06c908234cf9dcbfe7d4670e5721081fa347564fa2479c8a Jul 06 21:18:23.739925 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.739890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" event={"ID":"b0d0e391-5e48-4199-a818-2c5f72d515f8","Type":"ContainerStarted","Data":"1dbe58fc1fadc9b3a4887adef8efbc610b914756e40e7a3532a9636c3c8b1db6"} Jul 06 21:18:23.740094 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.739942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" event={"ID":"b0d0e391-5e48-4199-a818-2c5f72d515f8","Type":"ContainerStarted","Data":"9e43a0a6c19e3cfa06c908234cf9dcbfe7d4670e5721081fa347564fa2479c8a"} Jul 06 21:18:23.740094 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.740011 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:18:23.774917 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:23.774863 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" podStartSLOduration=1.77484223 podStartE2EDuration="1.77484223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:18:23.77476347 +0000 UTC m=+1184.348162754" watchObservedRunningTime="2026-07-06 21:18:23.77484223 +0000 UTC m=+1184.348241511" Jul 06 21:18:34.747528 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:18:34.747494 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvftx" Jul 06 21:33:01.818921 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.818885 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx"] Jul 06 21:33:01.822487 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.822470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:01.825019 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.824996 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-f834a6-serving-cert\"" Jul 06 21:33:01.825276 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.825260 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nqlrr\"" Jul 06 21:33:01.835076 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.835039 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx"] Jul 06 21:33:01.965467 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.965428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ncv\" (UniqueName: \"kubernetes.io/projected/0001c4f1-8d16-47a0-946c-01d032a87ba2-kube-api-access-r9ncv\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:01.965644 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.965472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0001c4f1-8d16-47a0-946c-01d032a87ba2-openshift-service-ca\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:01.965644 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:01.965545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0001c4f1-8d16-47a0-946c-01d032a87ba2-maas-api-tls\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.066289 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.066241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ncv\" (UniqueName: \"kubernetes.io/projected/0001c4f1-8d16-47a0-946c-01d032a87ba2-kube-api-access-r9ncv\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.066289 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.066292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0001c4f1-8d16-47a0-946c-01d032a87ba2-openshift-service-ca\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.066562 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.066330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0001c4f1-8d16-47a0-946c-01d032a87ba2-maas-api-tls\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.067103 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.067077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0001c4f1-8d16-47a0-946c-01d032a87ba2-openshift-service-ca\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.068786 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.068760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0001c4f1-8d16-47a0-946c-01d032a87ba2-maas-api-tls\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.079547 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.079475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ncv\" (UniqueName: \"kubernetes.io/projected/0001c4f1-8d16-47a0-946c-01d032a87ba2-kube-api-access-r9ncv\") pod \"maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.133857 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.133829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:02.275268 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.275244 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx"] Jul 06 21:33:02.282161 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:02.282137 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:33:03.271134 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:03.270958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" event={"ID":"0001c4f1-8d16-47a0-946c-01d032a87ba2","Type":"ContainerStarted","Data":"1cf61c70a8b7ddd489a13bcde0433d02819d3dc368f9258020cd19d38c8a79ca"} Jul 06 21:33:04.278672 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:04.278585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" event={"ID":"0001c4f1-8d16-47a0-946c-01d032a87ba2","Type":"ContainerStarted","Data":"e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e"} Jul 06 21:33:04.279025 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:04.278694 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:04.299496 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:04.299441 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" podStartSLOduration=1.685397199 podStartE2EDuration="3.299422776s" totalImagesPullingTime="1.614025577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:33:04.297575822 +0000 UTC m=+2064.870975105" watchObservedRunningTime="2026-07-06 21:33:04.299422776 +0000 UTC m=+2064.872822059" Jul 06 21:33:10.289522 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:10.289492 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:22.490613 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.490574 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx"] Jul 06 21:33:22.491100 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.490853 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" podUID="0001c4f1-8d16-47a0-946c-01d032a87ba2" containerName="maas-api" containerID="cri-o://e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e" gracePeriod=30 Jul 06 21:33:22.748109 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.748045 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:22.831654 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.831619 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0001c4f1-8d16-47a0-946c-01d032a87ba2-openshift-service-ca\") pod \"0001c4f1-8d16-47a0-946c-01d032a87ba2\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " Jul 06 21:33:22.831822 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.831737 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9ncv\" (UniqueName: \"kubernetes.io/projected/0001c4f1-8d16-47a0-946c-01d032a87ba2-kube-api-access-r9ncv\") pod \"0001c4f1-8d16-47a0-946c-01d032a87ba2\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " Jul 06 21:33:22.831822 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.831792 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0001c4f1-8d16-47a0-946c-01d032a87ba2-maas-api-tls\") pod \"0001c4f1-8d16-47a0-946c-01d032a87ba2\" (UID: \"0001c4f1-8d16-47a0-946c-01d032a87ba2\") " Jul 06 21:33:22.832047 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.832029 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0001c4f1-8d16-47a0-946c-01d032a87ba2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0001c4f1-8d16-47a0-946c-01d032a87ba2" (UID: "0001c4f1-8d16-47a0-946c-01d032a87ba2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:33:22.833926 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.833899 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0001c4f1-8d16-47a0-946c-01d032a87ba2-kube-api-access-r9ncv" (OuterVolumeSpecName: "kube-api-access-r9ncv") pod "0001c4f1-8d16-47a0-946c-01d032a87ba2" (UID: "0001c4f1-8d16-47a0-946c-01d032a87ba2"). InnerVolumeSpecName "kube-api-access-r9ncv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:33:22.834038 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.833920 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0001c4f1-8d16-47a0-946c-01d032a87ba2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0001c4f1-8d16-47a0-946c-01d032a87ba2" (UID: "0001c4f1-8d16-47a0-946c-01d032a87ba2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:33:22.932781 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.932745 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0001c4f1-8d16-47a0-946c-01d032a87ba2-openshift-service-ca\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:33:22.932781 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.932775 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9ncv\" (UniqueName: \"kubernetes.io/projected/0001c4f1-8d16-47a0-946c-01d032a87ba2-kube-api-access-r9ncv\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:33:22.932781 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:22.932787 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0001c4f1-8d16-47a0-946c-01d032a87ba2-maas-api-tls\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:33:23.379453 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.379409 2562 generic.go:356] "Generic (PLEG): container finished" podID="0001c4f1-8d16-47a0-946c-01d032a87ba2" containerID="e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e" exitCode=0 Jul 06 21:33:23.379657 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.379469 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" Jul 06 21:33:23.379657 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.379488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" event={"ID":"0001c4f1-8d16-47a0-946c-01d032a87ba2","Type":"ContainerDied","Data":"e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e"} Jul 06 21:33:23.379657 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.379562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx" event={"ID":"0001c4f1-8d16-47a0-946c-01d032a87ba2","Type":"ContainerDied","Data":"1cf61c70a8b7ddd489a13bcde0433d02819d3dc368f9258020cd19d38c8a79ca"} Jul 06 21:33:23.379657 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.379593 2562 scope.go:117] "RemoveContainer" containerID="e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e" Jul 06 21:33:23.390858 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.390842 2562 scope.go:117] "RemoveContainer" containerID="e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e" Jul 06 21:33:23.391128 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:33:23.391109 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e\": container with ID starting with e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e not found: ID does not exist" containerID="e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e" Jul 06 21:33:23.391172 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.391136 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e"} err="failed to get container status \"e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e\": rpc error: code = NotFound desc = could not find container \"e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e\": container with ID starting with e4de8d1a46d55e89e2291ef248ec7084858ebee870c30ac3db7d77a8f968767e not found: ID does not exist" Jul 06 21:33:23.406702 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.406678 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx"] Jul 06 21:33:23.411056 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.411034 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f834a6-5fc9bdbf6f-f5cvx"] Jul 06 21:33:23.942412 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:23.942377 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0001c4f1-8d16-47a0-946c-01d032a87ba2" path="/var/lib/kubelet/pods/0001c4f1-8d16-47a0-946c-01d032a87ba2/volumes" Jul 06 21:33:33.081686 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.081651 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt"] Jul 06 21:33:33.082291 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.082266 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0001c4f1-8d16-47a0-946c-01d032a87ba2" containerName="maas-api" Jul 06 21:33:33.082291 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.082284 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0001c4f1-8d16-47a0-946c-01d032a87ba2" containerName="maas-api" Jul 06 21:33:33.082410 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.082373 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0001c4f1-8d16-47a0-946c-01d032a87ba2" containerName="maas-api" Jul 06 21:33:33.089902 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.089877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.093570 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.093546 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-900ebe-serving-cert\"" Jul 06 21:33:33.093702 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.093613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nqlrr\"" Jul 06 21:33:33.095146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.095120 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt"] Jul 06 21:33:33.224002 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.223962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.224237 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.224106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c58efa-9e11-4aba-b448-4410ff854711-openshift-service-ca\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.224237 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.224198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6pr\" (UniqueName: \"kubernetes.io/projected/63c58efa-9e11-4aba-b448-4410ff854711-kube-api-access-6v6pr\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.325699 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.325652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.325883 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.325744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c58efa-9e11-4aba-b448-4410ff854711-openshift-service-ca\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.325883 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.325799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6pr\" (UniqueName: \"kubernetes.io/projected/63c58efa-9e11-4aba-b448-4410ff854711-kube-api-access-6v6pr\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.325883 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:33:33.325832 2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-900ebe-serving-cert: secret "maas-api-e2e-shared-a-900ebe-serving-cert" not found Jul 06 21:33:33.325991 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:33:33.325922 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls podName:63c58efa-9e11-4aba-b448-4410ff854711 nodeName:}" failed. No retries permitted until 2026-07-06 21:33:33.82589999 +0000 UTC m=+2094.399299327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls") pod "maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" (UID: "63c58efa-9e11-4aba-b448-4410ff854711") : secret "maas-api-e2e-shared-a-900ebe-serving-cert" not found Jul 06 21:33:33.326461 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.326441 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c58efa-9e11-4aba-b448-4410ff854711-openshift-service-ca\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.335666 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.335606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6pr\" (UniqueName: \"kubernetes.io/projected/63c58efa-9e11-4aba-b448-4410ff854711-kube-api-access-6v6pr\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.831630 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.831595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:33.834071 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:33.834052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls\") pod \"maas-api-e2e-shared-a-900ebe-544866f796-xhlqt\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:34.002972 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:34.002934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:34.144489 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:34.144457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt"] Jul 06 21:33:34.145850 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:33:34.145804 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c58efa_9e11_4aba_b448_4410ff854711.slice/crio-e56f53b20a65cd6cfbeb25f00305eef17d7d6e436fd2ae5d66c55b99e054cc64 WatchSource:0}: Error finding container e56f53b20a65cd6cfbeb25f00305eef17d7d6e436fd2ae5d66c55b99e054cc64: Status 404 returned error can't find the container with id e56f53b20a65cd6cfbeb25f00305eef17d7d6e436fd2ae5d66c55b99e054cc64 Jul 06 21:33:34.447604 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:34.447512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" event={"ID":"63c58efa-9e11-4aba-b448-4410ff854711","Type":"ContainerStarted","Data":"e56f53b20a65cd6cfbeb25f00305eef17d7d6e436fd2ae5d66c55b99e054cc64"} Jul 06 21:33:35.456968 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:35.456924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" event={"ID":"63c58efa-9e11-4aba-b448-4410ff854711","Type":"ContainerStarted","Data":"388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a"} Jul 06 21:33:35.457636 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:35.457082 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:33:35.476865 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:35.476817 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" podStartSLOduration=2.1351920189999998 podStartE2EDuration="2.476801792s" totalImagesPullingTime="341.609773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:33:35.475387287 +0000 UTC m=+2096.048786584" watchObservedRunningTime="2026-07-06 21:33:35.476801792 +0000 UTC m=+2096.050201075" Jul 06 21:33:41.467292 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:33:41.467263 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:36:31.742727 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.742685 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k"] Jul 06 21:36:31.746037 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.746017 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.749506 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.749470 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"kube-root-ca.crt\"" Jul 06 21:36:31.749506 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.749490 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"sub-test-model-900ebe-kserve-self-signed-certs\"" Jul 06 21:36:31.749693 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.749518 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"default-dockercfg-b545d\"" Jul 06 21:36:31.749693 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.749527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"openshift-service-ca.crt\"" Jul 06 21:36:31.757851 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.757819 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k"] Jul 06 21:36:31.894138 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.894080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0712468-699d-4ebe-ba68-0e550fb40927-tls-certs\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.894138 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.894126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7d2f\" (UniqueName: \"kubernetes.io/projected/c0712468-699d-4ebe-ba68-0e550fb40927-kube-api-access-t7d2f\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.894452 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.894190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-model-cache\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.894452 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.894347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-home\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.894452 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.894403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-tmp-dir\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.894560 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.894483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-dshm\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995115 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-home\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995115 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-tmp-dir\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995115 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-dshm\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995456 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0712468-699d-4ebe-ba68-0e550fb40927-tls-certs\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995456 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7d2f\" (UniqueName: \"kubernetes.io/projected/c0712468-699d-4ebe-ba68-0e550fb40927-kube-api-access-t7d2f\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995456 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-model-cache\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995613 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-home\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995613 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-tmp-dir\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.995613 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.995605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-model-cache\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.997581 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.997551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-dshm\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:31.997845 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:31.997817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0712468-699d-4ebe-ba68-0e550fb40927-tls-certs\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:32.004388 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:32.004354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7d2f\" (UniqueName: \"kubernetes.io/projected/c0712468-699d-4ebe-ba68-0e550fb40927-kube-api-access-t7d2f\") pod \"sub-test-model-900ebe-kserve-7b5f7c6765-vq68k\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:32.057272 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:32.057207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:32.193600 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:32.193573 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k"] Jul 06 21:36:32.195363 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:36:32.195335 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0712468_699d_4ebe_ba68_0e550fb40927.slice/crio-3cf871be281009932091ac05459396c4b43af6daabc3caf35af7d466c7c32f51 WatchSource:0}: Error finding container 3cf871be281009932091ac05459396c4b43af6daabc3caf35af7d466c7c32f51: Status 404 returned error can't find the container with id 3cf871be281009932091ac05459396c4b43af6daabc3caf35af7d466c7c32f51 Jul 06 21:36:32.390678 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:32.390643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" event={"ID":"c0712468-699d-4ebe-ba68-0e550fb40927","Type":"ContainerStarted","Data":"8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77"} Jul 06 21:36:32.390848 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:32.390698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" event={"ID":"c0712468-699d-4ebe-ba68-0e550fb40927","Type":"ContainerStarted","Data":"3cf871be281009932091ac05459396c4b43af6daabc3caf35af7d466c7c32f51"} Jul 06 21:36:32.409557 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:32.409503 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" podStartSLOduration=1.409483461 podStartE2EDuration="1.409483461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:36:32.407121604 +0000 UTC m=+2272.980520888" watchObservedRunningTime="2026-07-06 21:36:32.409483461 +0000 UTC m=+2272.982882767" Jul 06 21:36:42.058342 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:42.058297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:42.058751 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:42.058362 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:42.070932 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:42.070904 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:36:42.452997 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:36:42.452961 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:37:42.474205 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:42.474109 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k"] Jul 06 21:37:57.496502 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.496434 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" podUID="c0712468-699d-4ebe-ba68-0e550fb40927" containerName="main" containerID="cri-o://8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77" gracePeriod=45 Jul 06 21:37:57.747433 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.747371 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:37:57.843649 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.843616 2562 generic.go:356] "Generic (PLEG): container finished" podID="c0712468-699d-4ebe-ba68-0e550fb40927" containerID="8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77" exitCode=0 Jul 06 21:37:57.843816 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.843662 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" Jul 06 21:37:57.843816 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.843685 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" event={"ID":"c0712468-699d-4ebe-ba68-0e550fb40927","Type":"ContainerDied","Data":"8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77"} Jul 06 21:37:57.843816 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.843715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k" event={"ID":"c0712468-699d-4ebe-ba68-0e550fb40927","Type":"ContainerDied","Data":"3cf871be281009932091ac05459396c4b43af6daabc3caf35af7d466c7c32f51"} Jul 06 21:37:57.843816 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.843735 2562 scope.go:117] "RemoveContainer" containerID="8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77" Jul 06 21:37:57.854976 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.854957 2562 scope.go:117] "RemoveContainer" containerID="8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77" Jul 06 21:37:57.855266 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:37:57.855244 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77\": container with ID starting with 8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77 not found: ID does not exist" containerID="8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77" Jul 06 21:37:57.855309 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.855281 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77"} err="failed to get container status \"8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77\": rpc error: code = NotFound desc = could not find container \"8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77\": container with ID starting with 8c5dc752add2505ad83f2afb3350a42e74f92ab176db1780781c801d43ecfc77 not found: ID does not exist" Jul 06 21:37:57.875578 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875554 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-model-cache\") pod \"c0712468-699d-4ebe-ba68-0e550fb40927\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " Jul 06 21:37:57.875705 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875607 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-tmp-dir\") pod \"c0712468-699d-4ebe-ba68-0e550fb40927\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " Jul 06 21:37:57.875705 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875646 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-dshm\") pod \"c0712468-699d-4ebe-ba68-0e550fb40927\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " Jul 06 21:37:57.875705 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875691 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0712468-699d-4ebe-ba68-0e550fb40927-tls-certs\") pod \"c0712468-699d-4ebe-ba68-0e550fb40927\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " Jul 06 21:37:57.875864 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875722 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7d2f\" (UniqueName: \"kubernetes.io/projected/c0712468-699d-4ebe-ba68-0e550fb40927-kube-api-access-t7d2f\") pod \"c0712468-699d-4ebe-ba68-0e550fb40927\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " Jul 06 21:37:57.875864 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875743 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-home\") pod \"c0712468-699d-4ebe-ba68-0e550fb40927\" (UID: \"c0712468-699d-4ebe-ba68-0e550fb40927\") " Jul 06 21:37:57.875864 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875817 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-model-cache" (OuterVolumeSpecName: "model-cache") pod "c0712468-699d-4ebe-ba68-0e550fb40927" (UID: "c0712468-699d-4ebe-ba68-0e550fb40927"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:57.876019 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.875930 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c0712468-699d-4ebe-ba68-0e550fb40927" (UID: "c0712468-699d-4ebe-ba68-0e550fb40927"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:57.876080 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.876060 2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-model-cache\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:37:57.876117 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.876087 2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-tmp-dir\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:37:57.876117 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.876066 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-home" (OuterVolumeSpecName: "home") pod "c0712468-699d-4ebe-ba68-0e550fb40927" (UID: "c0712468-699d-4ebe-ba68-0e550fb40927"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:57.877895 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.877872 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0712468-699d-4ebe-ba68-0e550fb40927-kube-api-access-t7d2f" (OuterVolumeSpecName: "kube-api-access-t7d2f") pod "c0712468-699d-4ebe-ba68-0e550fb40927" (UID: "c0712468-699d-4ebe-ba68-0e550fb40927"). InnerVolumeSpecName "kube-api-access-t7d2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:37:57.877895 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.877875 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-dshm" (OuterVolumeSpecName: "dshm") pod "c0712468-699d-4ebe-ba68-0e550fb40927" (UID: "c0712468-699d-4ebe-ba68-0e550fb40927"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:57.878019 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.877970 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0712468-699d-4ebe-ba68-0e550fb40927-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c0712468-699d-4ebe-ba68-0e550fb40927" (UID: "c0712468-699d-4ebe-ba68-0e550fb40927"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:37:57.977008 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.976979 2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-dshm\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:37:57.977008 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.977002 2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0712468-699d-4ebe-ba68-0e550fb40927-tls-certs\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:37:57.977200 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.977034 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7d2f\" (UniqueName: \"kubernetes.io/projected/c0712468-699d-4ebe-ba68-0e550fb40927-kube-api-access-t7d2f\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:37:57.977200 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:57.977044 2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0712468-699d-4ebe-ba68-0e550fb40927-home\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:37:58.165997 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:58.165960 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k"] Jul 06 21:37:58.174327 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:58.174302 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/sub-test-model-900ebe-kserve-7b5f7c6765-vq68k"] Jul 06 21:37:59.942993 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:37:59.942958 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0712468-699d-4ebe-ba68-0e550fb40927" path="/var/lib/kubelet/pods/c0712468-699d-4ebe-ba68-0e550fb40927/volumes" Jul 06 21:39:03.885631 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:03.885535 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt"] Jul 06 21:39:03.886123 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:03.885802 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" podUID="63c58efa-9e11-4aba-b448-4410ff854711" containerName="maas-api" containerID="cri-o://388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a" gracePeriod=30 Jul 06 21:39:04.144809 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.144742 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:39:04.187032 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.186997 2562 generic.go:356] "Generic (PLEG): container finished" podID="63c58efa-9e11-4aba-b448-4410ff854711" containerID="388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a" exitCode=0 Jul 06 21:39:04.187032 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.187047 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" Jul 06 21:39:04.187322 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.187088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" event={"ID":"63c58efa-9e11-4aba-b448-4410ff854711","Type":"ContainerDied","Data":"388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a"} Jul 06 21:39:04.187322 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.187164 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt" event={"ID":"63c58efa-9e11-4aba-b448-4410ff854711","Type":"ContainerDied","Data":"e56f53b20a65cd6cfbeb25f00305eef17d7d6e436fd2ae5d66c55b99e054cc64"} Jul 06 21:39:04.187322 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.187201 2562 scope.go:117] "RemoveContainer" containerID="388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a" Jul 06 21:39:04.196665 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.196650 2562 scope.go:117] "RemoveContainer" containerID="388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a" Jul 06 21:39:04.196920 ip-10-0-136-218 kubenswrapper[2562]: E0706 21:39:04.196902 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a\": container with ID starting with 388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a not found: ID does not exist" containerID="388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a" Jul 06 21:39:04.196967 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.196928 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a"} err="failed to get container status \"388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a\": rpc error: code = NotFound desc = could not find container \"388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a\": container with ID starting with 388eff6a1420d2bc4a859f80eb7d8cf14929953ac581c201c1a9b9e1f03d2c6a not found: ID does not exist" Jul 06 21:39:04.266507 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.266469 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls\") pod \"63c58efa-9e11-4aba-b448-4410ff854711\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " Jul 06 21:39:04.266667 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.266554 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c58efa-9e11-4aba-b448-4410ff854711-openshift-service-ca\") pod \"63c58efa-9e11-4aba-b448-4410ff854711\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " Jul 06 21:39:04.266667 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.266656 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v6pr\" (UniqueName: \"kubernetes.io/projected/63c58efa-9e11-4aba-b448-4410ff854711-kube-api-access-6v6pr\") pod \"63c58efa-9e11-4aba-b448-4410ff854711\" (UID: \"63c58efa-9e11-4aba-b448-4410ff854711\") " Jul 06 21:39:04.266871 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.266853 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63c58efa-9e11-4aba-b448-4410ff854711-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63c58efa-9e11-4aba-b448-4410ff854711" (UID: "63c58efa-9e11-4aba-b448-4410ff854711"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:39:04.266942 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.266919 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c58efa-9e11-4aba-b448-4410ff854711-openshift-service-ca\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:39:04.268632 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.268612 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63c58efa-9e11-4aba-b448-4410ff854711" (UID: "63c58efa-9e11-4aba-b448-4410ff854711"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:39:04.268708 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.268640 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c58efa-9e11-4aba-b448-4410ff854711-kube-api-access-6v6pr" (OuterVolumeSpecName: "kube-api-access-6v6pr") pod "63c58efa-9e11-4aba-b448-4410ff854711" (UID: "63c58efa-9e11-4aba-b448-4410ff854711"). InnerVolumeSpecName "kube-api-access-6v6pr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:39:04.367821 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.367782 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v6pr\" (UniqueName: \"kubernetes.io/projected/63c58efa-9e11-4aba-b448-4410ff854711-kube-api-access-6v6pr\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:39:04.367821 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.367816 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c58efa-9e11-4aba-b448-4410ff854711-maas-api-tls\") on node \"ip-10-0-136-218.ec2.internal\" DevicePath \"\"" Jul 06 21:39:04.519296 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.519253 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt"] Jul 06 21:39:04.521770 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:04.521744 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-900ebe-544866f796-xhlqt"] Jul 06 21:39:05.942289 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:05.942252 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63c58efa-9e11-4aba-b448-4410ff854711" path="/var/lib/kubelet/pods/63c58efa-9e11-4aba-b448-4410ff854711/volumes" Jul 06 21:39:57.950027 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:57.949995 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9chlv_7f7cfc55-faaa-4d9a-86ae-168111eb2d07/manager/0.log" Jul 06 21:39:58.073587 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:58.073553 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zsq6n_a1cd018f-3967-4b94-9aa0-cbcc9a6f469f/manager/0.log" Jul 06 21:39:58.717273 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:58.717242 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lfnx8_e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93/server/0.log" Jul 06 21:39:58.843012 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:58.842980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5p287_236d9286-242c-4ff0-8f93-de73d3233628/manager/0.log" Jul 06 21:39:59.223161 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:59.223132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-v6w69_a4c7e993-56fb-4ded-8a06-6d689444ddbe/copy-manifests/0.log" Jul 06 21:39:59.239019 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:39:59.238981 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-v6w69_a4c7e993-56fb-4ded-8a06-6d689444ddbe/manager/0.log" Jul 06 21:40:00.161234 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.161181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb_1e6796a0-7b4c-434b-a036-a2343549099b/util/0.log" Jul 06 21:40:00.169070 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.169048 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb_1e6796a0-7b4c-434b-a036-a2343549099b/pull/0.log" Jul 06 21:40:00.177126 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.177079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb_1e6796a0-7b4c-434b-a036-a2343549099b/extract/0.log" Jul 06 21:40:00.290437 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.290408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg_b4a401be-be68-4e63-80ae-3a1b613402df/util/0.log" Jul 06 21:40:00.298228 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.298188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg_b4a401be-be68-4e63-80ae-3a1b613402df/pull/0.log" Jul 06 21:40:00.306425 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.306396 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg_b4a401be-be68-4e63-80ae-3a1b613402df/extract/0.log" Jul 06 21:40:00.438158 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.438047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s_785eda7a-eab7-4285-953b-3c070c1d35e8/extract/0.log" Jul 06 21:40:00.447324 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.447298 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s_785eda7a-eab7-4285-953b-3c070c1d35e8/util/0.log" Jul 06 21:40:00.455245 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.455198 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s_785eda7a-eab7-4285-953b-3c070c1d35e8/pull/0.log" Jul 06 21:40:00.569681 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.569656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2_e14372c6-3738-4f11-a54a-4a7d0649a973/util/0.log" Jul 06 21:40:00.577572 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.577547 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2_e14372c6-3738-4f11-a54a-4a7d0649a973/pull/0.log" Jul 06 21:40:00.584947 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.584930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2_e14372c6-3738-4f11-a54a-4a7d0649a973/extract/0.log" Jul 06 21:40:00.962172 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:00.962141 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m8784_b2963739-1d08-42e8-9c35-c6575d867920/manager/0.log" Jul 06 21:40:01.326245 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:01.326143 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qvftx_b0d0e391-5e48-4199-a818-2c5f72d515f8/manager/0.log" Jul 06 21:40:01.566575 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:01.566537 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w2n27_655b7a90-afc1-492c-9768-ad4802684bb5/manager/0.log" Jul 06 21:40:02.045340 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:02.045311 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7jgv_77e49599-f743-4de7-b2cb-af0dc9c60fc9/discovery/0.log" Jul 06 21:40:02.273693 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:02.273660 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-plmxs_0520ff61-6d0e-43c7-ba0f-ca1e2dec905b/kube-auth-proxy/0.log" Jul 06 21:40:03.123539 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:03.123507 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-w4fd9_accfc042-cfc6-43dc-90d4-f8ca0fed2a7b/main/0.log" Jul 06 21:40:03.497792 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:03.497715 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbljr25_9962659f-2839-4500-9ece-189b62a03ccf/main/0.log" Jul 06 21:40:11.219978 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:11.219932 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fbbpk_5aafc7fe-860b-4994-88e8-e28801d82bbc/global-pull-secret-syncer/0.log" Jul 06 21:40:11.313132 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:11.313105 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-74xlg_e099064e-bb9d-455b-86f1-1537d5d74c23/konnectivity-agent/0.log" Jul 06 21:40:11.442646 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:11.442622 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-218.ec2.internal_31e1f2339baeabe1d7d614e9619cc50e/haproxy/0.log" Jul 06 21:40:15.909152 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:15.909120 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb_1e6796a0-7b4c-434b-a036-a2343549099b/extract/0.log" Jul 06 21:40:15.935314 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:15.935273 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb_1e6796a0-7b4c-434b-a036-a2343549099b/util/0.log" Jul 06 21:40:15.967618 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:15.967585 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mj6zb_1e6796a0-7b4c-434b-a036-a2343549099b/pull/0.log" Jul 06 21:40:15.999419 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:15.999391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg_b4a401be-be68-4e63-80ae-3a1b613402df/extract/0.log" Jul 06 21:40:16.026553 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.026522 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg_b4a401be-be68-4e63-80ae-3a1b613402df/util/0.log" Jul 06 21:40:16.061762 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.061736 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jh4dg_b4a401be-be68-4e63-80ae-3a1b613402df/pull/0.log" Jul 06 21:40:16.092868 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.092840 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s_785eda7a-eab7-4285-953b-3c070c1d35e8/extract/0.log" Jul 06 21:40:16.120888 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.120861 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s_785eda7a-eab7-4285-953b-3c070c1d35e8/util/0.log" Jul 06 21:40:16.155631 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.155606 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd88s_785eda7a-eab7-4285-953b-3c070c1d35e8/pull/0.log" Jul 06 21:40:16.187687 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.187605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2_e14372c6-3738-4f11-a54a-4a7d0649a973/extract/0.log" Jul 06 21:40:16.211037 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.211008 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2_e14372c6-3738-4f11-a54a-4a7d0649a973/util/0.log" Jul 06 21:40:16.235078 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.235052 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqrf2_e14372c6-3738-4f11-a54a-4a7d0649a973/pull/0.log" Jul 06 21:40:16.704026 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.704000 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m8784_b2963739-1d08-42e8-9c35-c6575d867920/manager/0.log" Jul 06 21:40:16.892933 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:16.892901 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qvftx_b0d0e391-5e48-4199-a818-2c5f72d515f8/manager/0.log" Jul 06 21:40:17.017205 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:17.017125 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w2n27_655b7a90-afc1-492c-9768-ad4802684bb5/manager/0.log" Jul 06 21:40:19.236555 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.236524 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cz68_2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c/node-exporter/0.log" Jul 06 21:40:19.259443 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.259415 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cz68_2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c/kube-rbac-proxy/0.log" Jul 06 21:40:19.288428 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.288401 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cz68_2dfdb5ef-7077-4802-9d53-b7dfd8ecc10c/init-textfile/0.log" Jul 06 21:40:19.493464 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.493381 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2ngjz_d35d9d1f-60c2-47d0-9ea6-f998511d854d/kube-rbac-proxy-main/0.log" Jul 06 21:40:19.518168 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.518135 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2ngjz_d35d9d1f-60c2-47d0-9ea6-f998511d854d/kube-rbac-proxy-self/0.log" Jul 06 21:40:19.543802 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.543777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2ngjz_d35d9d1f-60c2-47d0-9ea6-f998511d854d/openshift-state-metrics/0.log" Jul 06 21:40:19.771572 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.771499 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4jjcm_0225d135-bdb8-4c13-b027-f90b340fb97c/prometheus-operator/0.log" Jul 06 21:40:19.797840 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.797799 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4jjcm_0225d135-bdb8-4c13-b027-f90b340fb97c/kube-rbac-proxy/0.log" Jul 06 21:40:19.828634 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.828604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-hsrfw_84d770f3-af3d-4442-99df-f6c2b3759adc/prometheus-operator-admission-webhook/0.log" Jul 06 21:40:19.963015 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.962982 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c67df98db-b9gx9_0c141178-4b66-44b5-ad91-f0edf7bad2c7/thanos-query/0.log" Jul 06 21:40:19.985461 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:19.985431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c67df98db-b9gx9_0c141178-4b66-44b5-ad91-f0edf7bad2c7/kube-rbac-proxy-web/0.log" Jul 06 21:40:20.015101 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:20.015071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c67df98db-b9gx9_0c141178-4b66-44b5-ad91-f0edf7bad2c7/kube-rbac-proxy/0.log" Jul 06 21:40:20.038014 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:20.037932 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c67df98db-b9gx9_0c141178-4b66-44b5-ad91-f0edf7bad2c7/prom-label-proxy/0.log" Jul 06 21:40:20.061063 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:20.061041 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c67df98db-b9gx9_0c141178-4b66-44b5-ad91-f0edf7bad2c7/kube-rbac-proxy-rules/0.log" Jul 06 21:40:20.094181 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:20.094158 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c67df98db-b9gx9_0c141178-4b66-44b5-ad91-f0edf7bad2c7/kube-rbac-proxy-metrics/0.log" Jul 06 21:40:21.577122 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.577072 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956"] Jul 06 21:40:21.577969 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.577941 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c58efa-9e11-4aba-b448-4410ff854711" containerName="maas-api" Jul 06 21:40:21.577969 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.577972 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c58efa-9e11-4aba-b448-4410ff854711" containerName="maas-api" Jul 06 21:40:21.578146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.578017 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0712468-699d-4ebe-ba68-0e550fb40927" containerName="main" Jul 06 21:40:21.578146 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.578027 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0712468-699d-4ebe-ba68-0e550fb40927" containerName="main" Jul 06 21:40:21.578271 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.578173 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c58efa-9e11-4aba-b448-4410ff854711" containerName="maas-api" Jul 06 21:40:21.578271 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.578192 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0712468-699d-4ebe-ba68-0e550fb40927" containerName="main" Jul 06 21:40:21.582279 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.582253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.584957 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.584932 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-64qs2\"/\"kube-root-ca.crt\"" Jul 06 21:40:21.586165 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.586137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-64qs2\"/\"default-dockercfg-hh7hq\"" Jul 06 21:40:21.586330 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.586266 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-64qs2\"/\"openshift-service-ca.crt\"" Jul 06 21:40:21.589360 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.589338 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956"] Jul 06 21:40:21.649642 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.649601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25blz\" (UniqueName: \"kubernetes.io/projected/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-kube-api-access-25blz\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.649826 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.649650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-proc\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.649826 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.649711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-podres\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.649826 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.649773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-lib-modules\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.649826 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.649798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-sys\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.750667 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25blz\" (UniqueName: \"kubernetes.io/projected/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-kube-api-access-25blz\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.750667 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-proc\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.750855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-podres\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.750855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-lib-modules\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.750855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-sys\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.750855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-proc\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.750855 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-sys\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.751019 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-lib-modules\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.751019 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.750917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-podres\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.759902 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.759867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25blz\" (UniqueName: \"kubernetes.io/projected/5e3feb6b-1d73-4534-8dbb-4f2459dde3ea-kube-api-access-25blz\") pod \"perf-node-gather-daemonset-fz956\" (UID: \"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:21.895229 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:21.895178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:22.033942 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:22.033914 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956"] Jul 06 21:40:22.036023 ip-10-0-136-218 kubenswrapper[2562]: W0706 21:40:22.035999 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e3feb6b_1d73_4534_8dbb_4f2459dde3ea.slice/crio-4c8633375b8cac53a116dbc09334d1cf0e4e6f626d93a0d31c5bb30657ef222d WatchSource:0}: Error finding container 4c8633375b8cac53a116dbc09334d1cf0e4e6f626d93a0d31c5bb30657ef222d: Status 404 returned error can't find the container with id 4c8633375b8cac53a116dbc09334d1cf0e4e6f626d93a0d31c5bb30657ef222d Jul 06 21:40:22.542626 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:22.542594 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-665cd7658b-4sbcp_4f1ded78-51f6-4d0f-bfe8-4c23aedb3316/console/0.log" Jul 06 21:40:22.602161 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:22.602119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" event={"ID":"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea","Type":"ContainerStarted","Data":"a9a0685c4eb3906fc4d3b63ddbb5725e6c2f568c6b7fc2afb4fb72274c7e1bb0"} Jul 06 21:40:22.602598 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:22.602185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" event={"ID":"5e3feb6b-1d73-4534-8dbb-4f2459dde3ea","Type":"ContainerStarted","Data":"4c8633375b8cac53a116dbc09334d1cf0e4e6f626d93a0d31c5bb30657ef222d"} Jul 06 21:40:22.602598 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:22.602241 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:22.622942 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:22.622892 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" podStartSLOduration=1.622876721 podStartE2EDuration="1.622876721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:40:22.621324076 +0000 UTC m=+2503.194723361" watchObservedRunningTime="2026-07-06 21:40:22.622876721 +0000 UTC m=+2503.196276005" Jul 06 21:40:24.389780 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:24.389747 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lk57_94eaa925-c08a-4146-9eb6-56941936da53/dns/0.log" Jul 06 21:40:24.417995 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:24.417968 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lk57_94eaa925-c08a-4146-9eb6-56941936da53/kube-rbac-proxy/0.log" Jul 06 21:40:24.691538 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:24.691447 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7cdl_076f53e4-f359-407c-acfa-039d2af4e92a/dns-node-resolver/0.log" Jul 06 21:40:25.343899 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:25.343867 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8f767dfcb-xlmkk_f6258cc2-67cc-4b10-8a24-ef6169b70973/registry/0.log" Jul 06 21:40:25.372797 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:25.372771 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8zkr8_559a6012-02f4-4e54-b987-9e4a9fe14802/node-ca/0.log" Jul 06 21:40:26.668387 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:26.668353 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7jgv_77e49599-f743-4de7-b2cb-af0dc9c60fc9/discovery/0.log" Jul 06 21:40:26.743505 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:26.743471 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-plmxs_0520ff61-6d0e-43c7-ba0f-ca1e2dec905b/kube-auth-proxy/0.log" Jul 06 21:40:27.773759 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:27.773730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nffwv_6dc52850-9167-4cae-ab8e-f022694fa8a9/serve-healthcheck-canary/0.log" Jul 06 21:40:28.425945 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:28.425916 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nb7t_d1b92af3-a521-4d00-8123-5c5ff650ff4c/kube-rbac-proxy/0.log" Jul 06 21:40:28.457321 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:28.457292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nb7t_d1b92af3-a521-4d00-8123-5c5ff650ff4c/exporter/0.log" Jul 06 21:40:28.492251 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:28.492196 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nb7t_d1b92af3-a521-4d00-8123-5c5ff650ff4c/extractor/0.log" Jul 06 21:40:28.616371 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:28.616345 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-fz956" Jul 06 21:40:31.207465 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:31.207434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9chlv_7f7cfc55-faaa-4d9a-86ae-168111eb2d07/manager/0.log" Jul 06 21:40:31.356732 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:31.356699 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zsq6n_a1cd018f-3967-4b94-9aa0-cbcc9a6f469f/manager/0.log" Jul 06 21:40:31.675099 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:31.675069 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lfnx8_e3d6b0f3-859e-4413-88c5-ce2b0e6d5e93/server/0.log" Jul 06 21:40:31.749284 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:31.749250 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5p287_236d9286-242c-4ff0-8f93-de73d3233628/manager/0.log" Jul 06 21:40:31.937685 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:31.937592 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-v6w69_a4c7e993-56fb-4ded-8a06-6d689444ddbe/manager/0.log" Jul 06 21:40:31.955835 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:31.955809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-v6w69_a4c7e993-56fb-4ded-8a06-6d689444ddbe/copy-manifests/0.log" Jul 06 21:40:32.478710 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:32.478681 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7jgv_77e49599-f743-4de7-b2cb-af0dc9c60fc9/discovery/0.log" Jul 06 21:40:32.507138 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:32.507106 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-plmxs_0520ff61-6d0e-43c7-ba0f-ca1e2dec905b/kube-auth-proxy/0.log" Jul 06 21:40:34.078921 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:34.078888 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7jgv_77e49599-f743-4de7-b2cb-af0dc9c60fc9/discovery/0.log" Jul 06 21:40:34.111067 ip-10-0-136-218 kubenswrapper[2562]: I0706 21:40:34.111039 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-plmxs_0520ff61-6d0e-43c7-ba0f-ca1e2dec905b/kube-auth-proxy/0.log"