Jul 02 21:18:19.194137 ip-10-0-131-12 systemd[1]: Starting Kubernetes Kubelet... Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.629172 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633755 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633769 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633773 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633776 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633780 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633787 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633790 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:19.705399 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633794 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633799 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633804 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633806 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633809 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633812 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633815 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633817 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633820 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633822 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633825 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633828 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633830 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633833 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633835 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633838 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633840 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633843 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633846 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:19.707805 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633848 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:19.707340 ip-10-0-131-12 systemd[1]: Started Kubernetes Kubelet. Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633852 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633855 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633857 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633860 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633877 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633880 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633883 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633886 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633888 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633891 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633894 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633897 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633899 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633902 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633905 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633907 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633910 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633913 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:19.721534 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633915 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633919 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633923 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633926 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633929 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633932 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633935 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633937 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633940 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633944 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633947 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633950 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633953 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633956 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633959 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633962 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633965 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633968 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633970 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633972 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:19.723967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633975 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633978 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633980 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633983 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633985 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633989 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633992 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633994 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633997 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.633999 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634002 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634004 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634007 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634011 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634014 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634017 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634020 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634022 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634025 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634027 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:19.729412 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634030 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634032 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634035 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634037 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634041 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634044 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634047 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634049 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634052 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634055 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634058 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634060 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634063 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.634065 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638153 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638170 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638175 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638179 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638185 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638189 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:19.733150 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638192 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638196 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638201 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638205 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638209 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638213 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638217 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638221 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638225 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638228 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638232 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638236 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638240 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638244 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638248 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638252 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638255 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638259 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638263 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638267 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:19.739351 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638271 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638275 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638278 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638282 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638286 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638290 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638294 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638299 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638303 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638307 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638311 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638314 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638318 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638321 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638325 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638329 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638333 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638337 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638340 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638344 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:19.747967 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638347 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638351 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638354 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638358 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638362 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638366 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638371 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638375 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638378 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638382 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638385 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638390 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638393 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638398 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638402 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638406 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638410 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638414 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638418 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:19.748724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638423 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638427 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638432 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638436 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638440 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638444 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638447 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638451 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638457 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638462 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638467 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638471 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638475 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638480 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638484 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638488 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638491 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638495 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638503 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:19.749474 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638509 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638513 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638519 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638525 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638529 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638533 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638537 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638541 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638544 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638548 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638553 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638557 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638560 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638565 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.638569 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639147 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639155 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639159 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639163 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:19.750186 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639167 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639171 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639175 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639179 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639183 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639187 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639191 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639194 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639199 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639203 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639206 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639210 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639214 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639218 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639222 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639225 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639229 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639233 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639237 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639240 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:19.750750 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639244 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639248 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639251 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639255 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639259 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639263 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639267 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639271 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639275 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639279 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639283 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639287 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639291 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639294 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639298 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639302 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639306 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639309 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639314 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639317 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:19.751390 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639321 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639325 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639329 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639332 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639336 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639340 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639344 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639347 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639350 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639354 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639359 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639363 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639367 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639371 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639375 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639379 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639383 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639387 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639391 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:19.751946 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639395 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639399 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639406 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639411 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639415 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639426 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639430 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639434 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639440 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639445 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639449 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639452 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639456 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639460 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639465 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639471 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639480 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639486 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639490 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:19.752565 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639495 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639500 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639503 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639507 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639511 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639515 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639519 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639525 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639531 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639536 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639540 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639544 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639548 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639552 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639556 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639560 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.639564 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639662 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639673 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639683 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 21:18:19.753069 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639689 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639696 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639701 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639707 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639713 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639718 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639722 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639727 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639732 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639739 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639743 2554 flags.go:64] FLAG: --cgroup-root="" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639747 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639752 2554 flags.go:64] FLAG: --client-ca-file="" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639758 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639763 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639769 2554 flags.go:64] FLAG: --cluster-domain="" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639773 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639778 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639783 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639788 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639794 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639798 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639803 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 21:18:19.753552 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639807 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639812 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639817 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639823 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639828 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639832 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639844 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639849 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639853 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639858 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639878 2554 flags.go:64] FLAG: --enable-server="true" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639884 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639892 2554 flags.go:64] FLAG: --event-burst="100" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639896 2554 flags.go:64] FLAG: --event-qps="50" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639901 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639905 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639910 2554 flags.go:64] FLAG: --eviction-hard="" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639915 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639922 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639927 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639931 2554 flags.go:64] FLAG: --eviction-soft="" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639936 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639940 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639945 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639950 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 21:18:19.754151 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639955 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639959 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639963 2554 flags.go:64] FLAG: --feature-gates="" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639969 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639973 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639978 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639983 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639987 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639992 2554 flags.go:64] FLAG: --help="false" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.639997 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-131-12.ec2.internal" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640002 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640007 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640011 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640016 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640021 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640026 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640030 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640034 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640039 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640043 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640048 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640052 2554 flags.go:64] FLAG: --kube-reserved="" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640056 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640060 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 21:18:19.754754 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640065 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640070 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640075 2554 flags.go:64] FLAG: --lock-file="" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640080 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640084 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640088 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640096 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640101 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640106 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640110 2554 flags.go:64] FLAG: --logging-format="text" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640115 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640119 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640124 2554 flags.go:64] FLAG: --manifest-url="" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640128 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640135 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640140 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640146 2554 flags.go:64] FLAG: --max-pods="110" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640150 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640155 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640159 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640163 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640168 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640172 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640177 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640188 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 21:18:19.755507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640193 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640197 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640202 2554 flags.go:64] FLAG: --pod-cidr="" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640206 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640214 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640218 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640223 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640227 2554 flags.go:64] FLAG: --port="10250" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640234 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640239 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d499c6b7425a6677" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640244 2554 flags.go:64] FLAG: --qos-reserved="" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640248 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640253 2554 flags.go:64] FLAG: --register-node="true" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640258 2554 flags.go:64] FLAG: --register-with-taints="" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640263 2554 flags.go:64] FLAG: --registry-burst="10" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640268 2554 flags.go:64] FLAG: --registry-qps="5" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640272 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640276 2554 flags.go:64] FLAG: --reserved-memory="" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640283 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640288 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640293 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640297 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640302 2554 flags.go:64] FLAG: --runonce="false" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640306 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640311 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 21:18:19.756214 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640316 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640320 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640324 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640329 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640340 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640344 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640348 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640352 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640356 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640361 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640365 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640369 2554 flags.go:64] FLAG: --system-cgroups="" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640374 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640382 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640386 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640391 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640397 2554 flags.go:64] FLAG: --tls-min-version="" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640401 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640406 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640410 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640415 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640419 2554 flags.go:64] FLAG: --v="2" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640425 2554 flags.go:64] FLAG: --version="false" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640432 2554 flags.go:64] FLAG: --vmodule="" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640438 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 21:18:19.757109 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.640443 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640624 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640633 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640638 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640642 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640646 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640650 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640653 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640657 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640661 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640665 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640669 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640673 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640677 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640680 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640684 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640688 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640693 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640696 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640700 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:19.757735 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640704 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640708 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640714 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640718 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640722 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640726 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640729 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640733 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640737 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640741 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640744 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640749 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640753 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640756 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640762 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640766 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640769 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640773 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640777 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640781 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:19.758371 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640785 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640788 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640792 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640796 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640800 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640804 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640809 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640815 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640820 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640823 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640827 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640831 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640835 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640840 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640847 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640850 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640854 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640858 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640862 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:19.758982 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640879 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640883 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640887 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640891 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640896 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640901 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640905 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640911 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640915 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640918 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640922 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640926 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640930 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640933 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640937 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640942 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640945 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640949 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640952 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640957 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:19.759569 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640960 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640964 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640968 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640972 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640976 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640980 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640984 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640990 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640994 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.640998 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641002 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641006 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641010 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641013 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641019 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641024 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641028 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641032 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641041 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:19.760089 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641048 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.641052 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.641715 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.648343 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.648363 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.649772 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.649780 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649839 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649844 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649848 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649850 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649853 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649856 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649858 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:19.760740 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649861 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649877 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649882 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649885 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649888 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649891 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649894 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649897 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649900 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649904 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649907 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649909 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649913 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649915 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649919 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649922 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649925 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649927 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649930 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:19.761123 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649934 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649937 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649940 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649943 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649947 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649950 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649954 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649957 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649959 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649962 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649965 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649967 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649970 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649973 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649975 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649978 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649980 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649982 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649985 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649987 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:19.761922 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649992 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649995 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.649997 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650000 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650003 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650005 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650008 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650011 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650013 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650016 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650018 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650021 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650025 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650028 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650030 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650033 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650036 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650039 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650041 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650044 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:19.762771 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650047 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650049 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650052 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650054 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650057 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650060 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650062 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650065 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650067 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650070 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650072 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650075 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650078 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650081 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650083 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650086 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650089 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650091 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650094 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:19.763692 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650096 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650099 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650102 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650104 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650107 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650111 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650114 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650116 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650119 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650122 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650124 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650127 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650129 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650132 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.650137 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:19.764691 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650252 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650257 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650259 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650262 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650265 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650268 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650270 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650273 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650275 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650277 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650280 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650286 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650289 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650291 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650294 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650297 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650299 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650302 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650304 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650307 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:19.765422 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650309 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650312 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650316 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650318 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650321 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650323 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650326 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650328 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650331 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650334 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650336 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650339 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650342 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650344 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650347 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650349 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650352 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650354 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650357 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650359 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:19.766307 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650362 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650364 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650367 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650370 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650373 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650375 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650378 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650381 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650383 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650386 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650388 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650392 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650396 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650399 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650403 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650405 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650407 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650410 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650413 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:19.767180 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650415 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650418 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650421 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650423 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650426 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650428 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650431 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650433 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650435 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650438 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650440 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650444 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650447 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650450 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650453 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650456 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650460 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650463 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650465 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:19.767976 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650469 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650472 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650475 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650478 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650481 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650484 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650487 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650490 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650493 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650496 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650499 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650502 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650504 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650507 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650510 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650512 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650515 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650517 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650520 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650522 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:19.768781 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:19.650525 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.650530 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.650650 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.653032 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.654359 2554 server.go:1019] "Starting client certificate rotation" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.654463 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.654497 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.656995 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.660421 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.672688 2554 log.go:25] "Validated CRI v1 runtime API" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.675526 2554 log.go:25] "Validated CRI v1 image API" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.677050 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 21:18:19.769548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.681706 2554 fs.go:135] Filesystem UUIDs: map[00a93038-1834-406a-99ef-fb5c60ace290:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d3b290a4-9e7f-4d36-a646-bba4de860e96:/dev/nvme0n1p3] Jul 02 21:18:19.769858 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.681721 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.687272 2554 manager.go:216] Machine: {Timestamp:2026-07-02 21:18:19.685815985 +0000 UTC m=+0.365290793 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112009 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28521a337c3b6d6678f3f7bad315d8 SystemUUID:ec28521a-337c-3b6d-6678-f3f7bad315d8 BootID:6377eb6b-07a8-48e3-a101-3a8086c8fd2f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:bf:c5:bf:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:bf:c5:bf:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:2a:14:44:c2:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.687369 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.687447 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.690122 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.690159 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.690825 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.690835 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 21:18:19.769939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.690843 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.691702 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.692898 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.694758 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696412 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696528 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696557 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696572 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696583 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696592 2554 kubelet.go:398] "Adding apiserver pod source" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696601 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696962 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.696983 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.699503 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.701397 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.701425 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702362 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702375 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702382 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702393 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702405 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702411 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702420 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702425 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702431 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702437 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702454 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.702460 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.703187 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.703194 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.706444 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.706448 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.706448 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.706621 2554 server.go:1268] "Started kubelet" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.706685 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.706695 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.706768 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.708485 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.708814 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 02 21:18:19.770354 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.718540 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.721367 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.721610 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.722410 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.722482 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.722500 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.722626 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.722633 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.722642 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.723523 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.723538 2554 factory.go:55] Registering systemd factory Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.723545 2554 factory.go:223] Registration of the systemd container factory successfully Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.722777 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-12.ec2.internal.18be95b346e816f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-12.ec2.internal,UID:ip-10-0-131-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-12.ec2.internal,},FirstTimestamp:2026-07-02 21:18:19.706595064 +0000 UTC m=+0.386069872,LastTimestamp:2026-07-02 21:18:19.706595064 +0000 UTC m=+0.386069872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-12.ec2.internal,}" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.723772 2554 factory.go:153] Registering CRI-O factory Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.723784 2554 factory.go:223] Registration of the crio container factory successfully Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.723801 2554 factory.go:103] Registering Raw factory Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.723810 2554 manager.go:1196] Started watching for new ooms in manager Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.724252 2554 manager.go:349] Starting recovery of all containers Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.724567 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.734286 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.736661 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxp6x" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.739949 2554 manager.go:354] Recovery completed Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.743631 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxp6x" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.748009 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.749881 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.749911 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.749925 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.750423 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.750424 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.750482 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.750500 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.751248 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:19.772093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.751277 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:19.773342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.751291 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:19.773342 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.752194 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-12.ec2.internal.18be95b3497cc8dc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-12.ec2.internal,UID:ip-10-0-131-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-12.ec2.internal,},FirstTimestamp:2026-07-02 21:18:19.749894364 +0000 UTC m=+0.429369176,LastTimestamp:2026-07-02 21:18:19.749894364 +0000 UTC m=+0.429369176,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-12.ec2.internal,}" Jul 02 21:18:19.773342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.752438 2554 policy_none.go:49] "None policy: Start" Jul 02 21:18:19.773342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.752453 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 21:18:19.773342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.752467 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 21:18:19.773342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.754427 2554 policy_none.go:47] "Start" Jul 02 21:18:19.781504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.781486 2554 manager.go:337] "Starting Device Plugin manager" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.781532 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.781545 2554 server.go:87] "Starting device plugin registration server" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.781762 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.781773 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.781934 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.781991 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.781999 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.782439 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 21:18:19.807505 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.782486 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:19.830145 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.830112 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 21:18:19.831360 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.831338 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 21:18:19.831446 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.831378 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 21:18:19.831446 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.831405 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 21:18:19.831525 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.831446 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 21:18:19.833900 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.833863 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:19.882825 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.882767 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:19.883749 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.883731 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:19.883825 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.883760 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:19.883825 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.883770 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:19.883825 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.883793 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-12.ec2.internal" Jul 02 21:18:19.893386 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.893370 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-12.ec2.internal" Jul 02 21:18:19.893440 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.893390 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-12.ec2.internal\": node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:19.923435 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.923412 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:19.932449 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.932428 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal"] Jul 02 21:18:19.932522 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.932496 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:19.933854 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.933834 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:19.933945 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.933882 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:19.933945 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.933900 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:19.936235 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.936223 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:19.936382 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.936366 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:19.936429 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.936398 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:19.936970 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.936953 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:19.937061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.936953 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:19.937061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.936982 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:19.937061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.936992 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:19.937061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.937007 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:19.937061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.937024 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:19.939265 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.939250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 02 21:18:19.939343 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.939276 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:19.939933 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.939918 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:19.940000 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.939949 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:19.940000 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:19.939966 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:19.967576 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.967557 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-12.ec2.internal\" not found" node="ip-10-0-131-12.ec2.internal" Jul 02 21:18:19.971940 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:19.971924 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-12.ec2.internal\" not found" node="ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.023713 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.023563 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:20.023713 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.023665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cee05caf27e33be51c7f6266ac8029f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"7cee05caf27e33be51c7f6266ac8029f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.124703 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.124663 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:20.124703 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.124679 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cee05caf27e33be51c7f6266ac8029f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"7cee05caf27e33be51c7f6266ac8029f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.124841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.124722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cee05caf27e33be51c7f6266ac8029f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"7cee05caf27e33be51c7f6266ac8029f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.124841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.124726 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cee05caf27e33be51c7f6266ac8029f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"7cee05caf27e33be51c7f6266ac8029f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.124841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.124743 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8cc86d8d444839b73f1e1fa89fc9a35-config\") pod \"kube-apiserver-proxy-ip-10-0-131-12.ec2.internal\" (UID: \"f8cc86d8d444839b73f1e1fa89fc9a35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.225383 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.225295 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:20.225383 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.225317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cee05caf27e33be51c7f6266ac8029f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"7cee05caf27e33be51c7f6266ac8029f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.225383 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.225353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8cc86d8d444839b73f1e1fa89fc9a35-config\") pod \"kube-apiserver-proxy-ip-10-0-131-12.ec2.internal\" (UID: \"f8cc86d8d444839b73f1e1fa89fc9a35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.225562 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.225402 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8cc86d8d444839b73f1e1fa89fc9a35-config\") pod \"kube-apiserver-proxy-ip-10-0-131-12.ec2.internal\" (UID: \"f8cc86d8d444839b73f1e1fa89fc9a35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.225562 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.225408 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cee05caf27e33be51c7f6266ac8029f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"7cee05caf27e33be51c7f6266ac8029f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.270484 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.270457 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.275752 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.275446 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 02 21:18:20.325623 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.325597 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:20.425994 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.425969 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:20.526402 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.526316 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:20.626784 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.626756 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:20.653928 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.653905 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 21:18:20.654037 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:20.654020 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 21:18:20.727048 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:20.727026 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:22.536251 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:22.536217 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 21:13:21 +0000 UTC" deadline="2028-01-09 08:31:45.247270789 +0000 UTC" Jul 02 21:18:22.536251 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:22.536245 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13331h13m22.711028264s" Jul 02 21:18:22.616647 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:22.616622 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:22.672657 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:22.672633 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:22.694147 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:22.694110 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cee05caf27e33be51c7f6266ac8029f.slice/crio-63447f119d52992879c81b729940ffcc0b8169e94273f67f5d704c9e970842f5 WatchSource:0}: Error finding container 63447f119d52992879c81b729940ffcc0b8169e94273f67f5d704c9e970842f5: Status 404 returned error can't find the container with id 63447f119d52992879c81b729940ffcc0b8169e94273f67f5d704c9e970842f5 Jul 02 21:18:22.694623 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:22.694598 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8cc86d8d444839b73f1e1fa89fc9a35.slice/crio-4a3512ef21f74d42c86390f28066f84424e0f04cabe88b74039eb07c3dee6557 WatchSource:0}: Error finding container 4a3512ef21f74d42c86390f28066f84424e0f04cabe88b74039eb07c3dee6557: Status 404 returned error can't find the container with id 4a3512ef21f74d42c86390f28066f84424e0f04cabe88b74039eb07c3dee6557 Jul 02 21:18:22.699074 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:22.699057 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:18:22.717033 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:22.717011 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:22.732596 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:22.732578 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:22.817665 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:22.817604 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:22.917988 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:22.917966 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:23.018624 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.018595 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 02 21:18:23.097535 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.097464 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:23.113101 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.113074 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 02 21:18:23.125955 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.125927 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:18:23.127500 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.127454 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 02 21:18:23.136213 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.136196 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:18:23.487042 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.486968 2554 apiserver.go:52] "Watching apiserver" Jul 02 21:18:23.498008 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.497974 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 21:18:23.499261 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.499230 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-gfztc","openshift-image-registry/node-ca-kqgrw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal","openshift-network-diagnostics/network-check-target-87w6b","openshift-ovn-kubernetes/ovnkube-node-pfkb2","kube-system/global-pull-secret-syncer-gn5q7","kube-system/konnectivity-agent-w5d26","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz","openshift-multus/multus-additional-cni-plugins-5rww5","openshift-multus/multus-wv6fc","openshift-multus/network-metrics-daemon-p2gmk","openshift-network-operator/iptables-alerter-8wh8r","kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal","openshift-cluster-node-tuning-operator/tuned-k7q9p"] Jul 02 21:18:23.501790 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.501766 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.503961 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.503831 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:23.503961 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.503909 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:23.504616 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.504594 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 21:18:23.505614 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.504650 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 21:18:23.505614 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.504791 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jsx94\"" Jul 02 21:18:23.506504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.506482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.508360 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.508339 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 21:18:23.508484 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.508378 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 21:18:23.508644 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.508536 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-szc9x\"" Jul 02 21:18:23.508644 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.508569 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:23.508644 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.508633 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:23.508857 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.508810 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 21:18:23.511262 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.511223 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.512788 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.512142 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 21:18:23.513732 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.513450 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 21:18:23.513732 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.513673 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 21:18:23.513732 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.513722 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.514191 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.514173 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 21:18:23.514357 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.514344 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 21:18:23.514819 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.514534 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 21:18:23.514819 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.514555 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 21:18:23.514819 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.514649 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jgkd9\"" Jul 02 21:18:23.515589 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.515574 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 21:18:23.516292 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.515943 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.516292 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.516080 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 21:18:23.516292 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.516089 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:18:23.516292 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.516084 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d4pz6\"" Jul 02 21:18:23.517856 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.517826 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 21:18:23.518188 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.518065 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 21:18:23.518188 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.518152 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 21:18:23.518536 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.518518 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 21:18:23.518619 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.518544 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 21:18:23.518619 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.518544 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j9jmq\"" Jul 02 21:18:23.518939 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.518921 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.520311 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520294 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-socket-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.520489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.520489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520346 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520368 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-ovn\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520391 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9f1b4d3-efb8-4a53-b441-60280928d211-iptables-alerter-script\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.520489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-slash\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520454 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-run-netns\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-node-log\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovnkube-config\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520516 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9f1b4d3-efb8-4a53-b441-60280928d211-host-slash\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520538 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-var-lib-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-cni-netd\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520583 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovn-node-metrics-cert\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj27x\" (UniqueName: \"kubernetes.io/projected/f9f1b4d3-efb8-4a53-b441-60280928d211-kube-api-access-sj27x\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520632 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-device-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-systemd\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-etc-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520733 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovnkube-script-lib\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9fd8d29f-08ab-420f-9b76-8e897399db15-konnectivity-ca\") pod \"konnectivity-agent-w5d26\" (UID: \"9fd8d29f-08ab-420f-9b76-8e897399db15\") " pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.520841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xptp\" (UniqueName: \"kubernetes.io/projected/73c60e37-12fa-4053-8317-cadbfb90914e-kube-api-access-7xptp\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520879 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520904 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-env-overrides\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520929 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.520981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6n7n\" (UniqueName: \"kubernetes.io/projected/46b40c26-be7b-49dc-af65-7067d02f205e-kube-api-access-d6n7n\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-registration-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521032 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-systemd-units\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-cni-bin\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g47cv\" (UniqueName: \"kubernetes.io/projected/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-kube-api-access-g47cv\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521121 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-kubelet\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521159 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-log-socket\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.521570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9fd8d29f-08ab-420f-9b76-8e897399db15-agent-certs\") pod \"konnectivity-agent-w5d26\" (UID: \"9fd8d29f-08ab-420f-9b76-8e897399db15\") " pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.522182 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-sys-fs\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.522182 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.521747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.522278 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.522235 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 21:18:23.522472 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.522384 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tczz5\"" Jul 02 21:18:23.522472 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.522440 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 21:18:23.523773 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.523753 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.524271 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.524255 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 21:18:23.524352 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.524276 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 21:18:23.524352 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.524342 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 21:18:23.524521 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.524493 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hfw7r\"" Jul 02 21:18:23.526430 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.526241 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nmg2z\"" Jul 02 21:18:23.526547 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.526438 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.526547 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.526486 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 21:18:23.526547 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.526488 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:23.526698 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.526605 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:18:23.528181 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.528163 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.529987 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.529969 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vb7wc\"" Jul 02 21:18:23.530262 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.530243 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 21:18:23.530571 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.530550 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:18:23.545395 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.545362 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5v7b" Jul 02 21:18:23.552955 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.552935 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5v7b" Jul 02 21:18:23.613146 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.613125 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 21:18:23.621766 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621744 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9fd8d29f-08ab-420f-9b76-8e897399db15-konnectivity-ca\") pod \"konnectivity-agent-w5d26\" (UID: \"9fd8d29f-08ab-420f-9b76-8e897399db15\") " pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.621879 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:23.621879 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621790 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.621879 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621827 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.622028 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-env-overrides\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.622028 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621942 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-os-release\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.622028 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621970 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abfce80c-bd3a-4ec8-b24c-a04cafa23131-kubelet-config\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.622028 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.621994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-lib-modules\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.622212 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622019 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-cnibin\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.622212 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622071 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jcgk\" (UniqueName: \"kubernetes.io/projected/26354f55-ef32-4074-9b09-208f03cc5b18-kube-api-access-8jcgk\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.622212 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/804dd64c-2c91-45a9-9a35-5b7914d881e9-serviceca\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.622212 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysconfig\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.622212 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622201 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-sys\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622226 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjps\" (UniqueName: \"kubernetes.io/projected/7cb73377-8763-4c62-b2ef-2f76615670d5-kube-api-access-zwjps\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-log-socket\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622281 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-conf-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-modprobe-d\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9fd8d29f-08ab-420f-9b76-8e897399db15-agent-certs\") pod \"konnectivity-agent-w5d26\" (UID: \"9fd8d29f-08ab-420f-9b76-8e897399db15\") " pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622337 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9fd8d29f-08ab-420f-9b76-8e897399db15-konnectivity-ca\") pod \"konnectivity-agent-w5d26\" (UID: \"9fd8d29f-08ab-420f-9b76-8e897399db15\") " pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-sys-fs\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622359 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-env-overrides\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622337 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-log-socket\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-system-cni-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysctl-conf\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622436 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-sys-fs\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-socket-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.622468 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622467 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-ovn\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622511 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-k8s-cni-cncf-io\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622547 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-var-lib-kubelet\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622593 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-ovn\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-run-netns\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-node-log\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-cni-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622680 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-socket-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622683 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-hostroot\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622684 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-run-netns\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622703 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-node-log\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9718ee7-0618-4091-a314-4a734bf90c03-multus-daemon-config\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.623108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-os-release\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9f1b4d3-efb8-4a53-b441-60280928d211-host-slash\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-var-lib-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-cni-netd\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622857 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-var-lib-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622866 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9f1b4d3-efb8-4a53-b441-60280928d211-host-slash\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622880 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-multus-certs\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622895 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-cni-netd\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-kubernetes\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj27x\" (UniqueName: \"kubernetes.io/projected/f9f1b4d3-efb8-4a53-b441-60280928d211-kube-api-access-sj27x\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622915 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.622981 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623030 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-systemd\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovnkube-script-lib\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.623769 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623073 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-run-systemd\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623089 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60156939-3d05-4b01-8292-3718ccd6ccf9-tmp-dir\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623112 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-cnibin\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xptp\" (UniqueName: \"kubernetes.io/projected/73c60e37-12fa-4053-8317-cadbfb90914e-kube-api-access-7xptp\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623226 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623270 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-netns\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-etc-kubernetes\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-systemd\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6n7n\" (UniqueName: \"kubernetes.io/projected/46b40c26-be7b-49dc-af65-7067d02f205e-kube-api-access-d6n7n\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-registration-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-systemd-units\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.624441 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-cni-bin\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.623508 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623521 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47cv\" (UniqueName: \"kubernetes.io/projected/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-kube-api-access-g47cv\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623542 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-registration-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623545 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-kubelet\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623569 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovnkube-script-lib\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.623591 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:18:24.123557053 +0000 UTC m=+3.013480034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623600 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-kubelet\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623602 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-systemd-units\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623620 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5tf9\" (UniqueName: \"kubernetes.io/projected/804dd64c-2c91-45a9-9a35-5b7914d881e9-kube-api-access-g5tf9\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623654 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-cni-bin\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60156939-3d05-4b01-8292-3718ccd6ccf9-hosts-file\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.625001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9718ee7-0618-4091-a314-4a734bf90c03-cni-binary-copy\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623744 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-kubelet\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-system-cni-dir\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623785 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-run\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysctl-d\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9f1b4d3-efb8-4a53-b441-60280928d211-iptables-alerter-script\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-slash\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovnkube-config\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vv5h\" (UniqueName: \"kubernetes.io/projected/60156939-3d05-4b01-8292-3718ccd6ccf9-kube-api-access-9vv5h\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-socket-dir-parent\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623944 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623952 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-host-slash\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.625580 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.623992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-host\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624022 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovn-node-metrics-cert\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-cni-bin\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624147 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abfce80c-bd3a-4ec8-b24c-a04cafa23131-dbus\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624211 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cb73377-8763-4c62-b2ef-2f76615670d5-tmp\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-device-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-etc-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624289 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-cni-multus\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624326 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-etc-openvswitch\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624318 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlltn\" (UniqueName: \"kubernetes.io/projected/d9718ee7-0618-4091-a314-4a734bf90c03-kube-api-access-zlltn\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804dd64c-2c91-45a9-9a35-5b7914d881e9-host\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624380 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73c60e37-12fa-4053-8317-cadbfb90914e-device-dir\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-tuned\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.626173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624449 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9f1b4d3-efb8-4a53-b441-60280928d211-iptables-alerter-script\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.626812 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.624551 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovnkube-config\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.627054 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.627006 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" event={"ID":"f8cc86d8d444839b73f1e1fa89fc9a35","Type":"ContainerStarted","Data":"4a3512ef21f74d42c86390f28066f84424e0f04cabe88b74039eb07c3dee6557"} Jul 02 21:18:23.628029 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.628005 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9fd8d29f-08ab-420f-9b76-8e897399db15-agent-certs\") pod \"konnectivity-agent-w5d26\" (UID: \"9fd8d29f-08ab-420f-9b76-8e897399db15\") " pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.628123 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.628069 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" event={"ID":"7cee05caf27e33be51c7f6266ac8029f","Type":"ContainerStarted","Data":"63447f119d52992879c81b729940ffcc0b8169e94273f67f5d704c9e970842f5"} Jul 02 21:18:23.628532 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.628499 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-ovn-node-metrics-cert\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.630761 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.630742 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:23.630843 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.630769 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:23.630843 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.630783 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7kwbx for pod openshift-network-diagnostics/network-check-target-87w6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:23.630920 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.630855 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx podName:c7d35c0e-96e5-4391-aea6-0a6875785994 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:24.130836187 +0000 UTC m=+3.020759170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7kwbx" (UniqueName: "kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx") pod "network-check-target-87w6b" (UID: "c7d35c0e-96e5-4391-aea6-0a6875785994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:23.633451 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.633397 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj27x\" (UniqueName: \"kubernetes.io/projected/f9f1b4d3-efb8-4a53-b441-60280928d211-kube-api-access-sj27x\") pod \"iptables-alerter-8wh8r\" (UID: \"f9f1b4d3-efb8-4a53-b441-60280928d211\") " pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.633999 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.633967 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xptp\" (UniqueName: \"kubernetes.io/projected/73c60e37-12fa-4053-8317-cadbfb90914e-kube-api-access-7xptp\") pod \"aws-ebs-csi-driver-node-tdqkz\" (UID: \"73c60e37-12fa-4053-8317-cadbfb90914e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.634142 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.634094 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47cv\" (UniqueName: \"kubernetes.io/projected/a05ebb61-0f41-416f-b32d-6f8aeaf990c8-kube-api-access-g47cv\") pod \"ovnkube-node-pfkb2\" (UID: \"a05ebb61-0f41-416f-b32d-6f8aeaf990c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.634663 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.634642 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6n7n\" (UniqueName: \"kubernetes.io/projected/46b40c26-be7b-49dc-af65-7067d02f205e-kube-api-access-d6n7n\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:23.725524 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725488 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.725686 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725538 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.725686 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5tf9\" (UniqueName: \"kubernetes.io/projected/804dd64c-2c91-45a9-9a35-5b7914d881e9-kube-api-access-g5tf9\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.725686 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725601 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60156939-3d05-4b01-8292-3718ccd6ccf9-hosts-file\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.725686 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9718ee7-0618-4091-a314-4a734bf90c03-cni-binary-copy\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.725686 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-kubelet\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.725686 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-system-cni-dir\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.726004 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725735 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-kubelet\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.726733 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.725751 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60156939-3d05-4b01-8292-3718ccd6ccf9-hosts-file\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.726733 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.726673 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.726733 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.726702 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.726964 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.726760 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-system-cni-dir\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-run\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727241 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9718ee7-0618-4091-a314-4a734bf90c03-cni-binary-copy\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysctl-d\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727304 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vv5h\" (UniqueName: \"kubernetes.io/projected/60156939-3d05-4b01-8292-3718ccd6ccf9-kube-api-access-9vv5h\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-socket-dir-parent\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727386 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-run\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-host\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-cni-bin\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727482 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abfce80c-bd3a-4ec8-b24c-a04cafa23131-dbus\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727532 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cb73377-8763-4c62-b2ef-2f76615670d5-tmp\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-cni-multus\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlltn\" (UniqueName: \"kubernetes.io/projected/d9718ee7-0618-4091-a314-4a734bf90c03-kube-api-access-zlltn\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.728974 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804dd64c-2c91-45a9-9a35-5b7914d881e9-host\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-tuned\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727771 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysctl-d\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727786 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-os-release\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abfce80c-bd3a-4ec8-b24c-a04cafa23131-kubelet-config\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-lib-modules\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.727959 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-cnibin\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728011 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jcgk\" (UniqueName: \"kubernetes.io/projected/26354f55-ef32-4074-9b09-208f03cc5b18-kube-api-access-8jcgk\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/804dd64c-2c91-45a9-9a35-5b7914d881e9-serviceca\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysconfig\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728115 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-sys\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjps\" (UniqueName: \"kubernetes.io/projected/7cb73377-8763-4c62-b2ef-2f76615670d5-kube-api-access-zwjps\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-conf-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-modprobe-d\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-system-cni-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.729719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysctl-conf\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728514 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-k8s-cni-cncf-io\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728542 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abfce80c-bd3a-4ec8-b24c-a04cafa23131-dbus\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-var-lib-kubelet\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-cni-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-hostroot\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728664 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9718ee7-0618-4091-a314-4a734bf90c03-multus-daemon-config\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728724 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-var-lib-kubelet\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728813 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysconfig\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728909 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-os-release\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.728970 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abfce80c-bd3a-4ec8-b24c-a04cafa23131-kubelet-config\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729137 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-lib-modules\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729160 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-sys\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729199 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-cnibin\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729238 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9718ee7-0618-4091-a314-4a734bf90c03-multus-daemon-config\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.730409 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729480 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-modprobe-d\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729510 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-conf-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729571 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-system-cni-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729611 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-socket-dir-parent\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729696 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-sysctl-conf\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729807 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-k8s-cni-cncf-io\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-os-release\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-multus-certs\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-kubernetes\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729950 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60156939-3d05-4b01-8292-3718ccd6ccf9-tmp-dir\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729981 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-cnibin\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.729990 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/804dd64c-2c91-45a9-9a35-5b7914d881e9-serviceca\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26354f55-ef32-4074-9b09-208f03cc5b18-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730201 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.731075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-netns\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730287 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-host\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730313 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-os-release\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730336 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-netns\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730340 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-cni-bin\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730351 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-etc-kubernetes\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730389 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-systemd\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730465 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-hostroot\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730509 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-multus-cni-dir\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730873 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-etc-kubernetes\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730903 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-systemd\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730951 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804dd64c-2c91-45a9-9a35-5b7914d881e9-host\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.730981 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.730995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26354f55-ef32-4074-9b09-208f03cc5b18-cnibin\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.731025 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-run-multus-certs\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.731038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9718ee7-0618-4091-a314-4a734bf90c03-host-var-lib-cni-multus\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.731721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.731089 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-kubernetes\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.732456 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:23.731169 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret podName:abfce80c-bd3a-4ec8-b24c-a04cafa23131 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:24.231145139 +0000 UTC m=+3.121068110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret") pod "global-pull-secret-syncer-gn5q7" (UID: "abfce80c-bd3a-4ec8-b24c-a04cafa23131") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:23.732456 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.731467 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60156939-3d05-4b01-8292-3718ccd6ccf9-tmp-dir\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.732742 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.732722 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7cb73377-8763-4c62-b2ef-2f76615670d5-etc-tuned\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.735057 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.735035 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cb73377-8763-4c62-b2ef-2f76615670d5-tmp\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.735996 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.735970 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5tf9\" (UniqueName: \"kubernetes.io/projected/804dd64c-2c91-45a9-9a35-5b7914d881e9-kube-api-access-g5tf9\") pod \"node-ca-kqgrw\" (UID: \"804dd64c-2c91-45a9-9a35-5b7914d881e9\") " pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.736740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.736394 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vv5h\" (UniqueName: \"kubernetes.io/projected/60156939-3d05-4b01-8292-3718ccd6ccf9-kube-api-access-9vv5h\") pod \"node-resolver-gfztc\" (UID: \"60156939-3d05-4b01-8292-3718ccd6ccf9\") " pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.737647 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.737584 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjps\" (UniqueName: \"kubernetes.io/projected/7cb73377-8763-4c62-b2ef-2f76615670d5-kube-api-access-zwjps\") pod \"tuned-k7q9p\" (UID: \"7cb73377-8763-4c62-b2ef-2f76615670d5\") " pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:23.738243 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.738225 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlltn\" (UniqueName: \"kubernetes.io/projected/d9718ee7-0618-4091-a314-4a734bf90c03-kube-api-access-zlltn\") pod \"multus-wv6fc\" (UID: \"d9718ee7-0618-4091-a314-4a734bf90c03\") " pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.738856 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.738837 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jcgk\" (UniqueName: \"kubernetes.io/projected/26354f55-ef32-4074-9b09-208f03cc5b18-kube-api-access-8jcgk\") pod \"multus-additional-cni-plugins-5rww5\" (UID: \"26354f55-ef32-4074-9b09-208f03cc5b18\") " pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.783630 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.783596 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:23.814639 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.814606 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:23.831503 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.831480 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" Jul 02 21:18:23.839899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.839872 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:23.849572 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.849542 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wh8r" Jul 02 21:18:23.859090 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.859070 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5rww5" Jul 02 21:18:23.864720 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.864701 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gfztc" Jul 02 21:18:23.873430 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.873398 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqgrw" Jul 02 21:18:23.880011 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.879994 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wv6fc" Jul 02 21:18:23.886645 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:23.886630 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" Jul 02 21:18:24.134113 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:24.134023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:24.134113 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:24.134088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:24.134341 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.134174 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:24.134341 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.134214 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:24.134341 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.134232 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:24.134341 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.134245 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7kwbx for pod openshift-network-diagnostics/network-check-target-87w6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:24.134341 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.134253 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:18:25.134231141 +0000 UTC m=+4.024154117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:24.134341 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.134284 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx podName:c7d35c0e-96e5-4391-aea6-0a6875785994 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:25.13427433 +0000 UTC m=+4.024197299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kwbx" (UniqueName: "kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx") pod "network-check-target-87w6b" (UID: "c7d35c0e-96e5-4391-aea6-0a6875785994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:24.235227 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:24.235193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:24.235382 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.235316 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:24.235456 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:24.235391 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret podName:abfce80c-bd3a-4ec8-b24c-a04cafa23131 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:25.235371146 +0000 UTC m=+4.125294117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret") pod "global-pull-secret-syncer-gn5q7" (UID: "abfce80c-bd3a-4ec8-b24c-a04cafa23131") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:24.556427 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:24.556347 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:13:23 +0000 UTC" deadline="2028-01-23 12:02:49.616839491 +0000 UTC" Jul 02 21:18:24.556427 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:24.556373 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13670h44m25.060468905s" Jul 02 21:18:24.633974 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.633941 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb73377_8763_4c62_b2ef_2f76615670d5.slice/crio-f223f51ad091b07e93b6581407423220a0bf2680f73ce4e654689b43ff545bfc WatchSource:0}: Error finding container f223f51ad091b07e93b6581407423220a0bf2680f73ce4e654689b43ff545bfc: Status 404 returned error can't find the container with id f223f51ad091b07e93b6581407423220a0bf2680f73ce4e654689b43ff545bfc Jul 02 21:18:24.642244 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.642063 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26354f55_ef32_4074_9b09_208f03cc5b18.slice/crio-69b72424f4e1fd9d21949f46e9ffb498bd41cd12512f52ed1f5498a570c3107c WatchSource:0}: Error finding container 69b72424f4e1fd9d21949f46e9ffb498bd41cd12512f52ed1f5498a570c3107c: Status 404 returned error can't find the container with id 69b72424f4e1fd9d21949f46e9ffb498bd41cd12512f52ed1f5498a570c3107c Jul 02 21:18:24.644183 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.644071 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9718ee7_0618_4091_a314_4a734bf90c03.slice/crio-cb03f5f3ad521c07f079526f7a3e01220d3807a8751d6786bd039efa93538f7e WatchSource:0}: Error finding container cb03f5f3ad521c07f079526f7a3e01220d3807a8751d6786bd039efa93538f7e: Status 404 returned error can't find the container with id cb03f5f3ad521c07f079526f7a3e01220d3807a8751d6786bd039efa93538f7e Jul 02 21:18:24.645167 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.645144 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60156939_3d05_4b01_8292_3718ccd6ccf9.slice/crio-ae34986574dd949991f7d7fbc71a48d4de75730100042e336b2889d35a5171bd WatchSource:0}: Error finding container ae34986574dd949991f7d7fbc71a48d4de75730100042e336b2889d35a5171bd: Status 404 returned error can't find the container with id ae34986574dd949991f7d7fbc71a48d4de75730100042e336b2889d35a5171bd Jul 02 21:18:24.646228 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.645715 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f1b4d3_efb8_4a53_b441_60280928d211.slice/crio-bf2a535124ad00a6340d7d09a266f0ca89dab22935ba89a9f87d46eb710aed63 WatchSource:0}: Error finding container bf2a535124ad00a6340d7d09a266f0ca89dab22935ba89a9f87d46eb710aed63: Status 404 returned error can't find the container with id bf2a535124ad00a6340d7d09a266f0ca89dab22935ba89a9f87d46eb710aed63 Jul 02 21:18:24.646576 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.646476 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd8d29f_08ab_420f_9b76_8e897399db15.slice/crio-987963a687b64aa6b781e5358d3c87262a818fe084edba224d7dd8f46d40c15a WatchSource:0}: Error finding container 987963a687b64aa6b781e5358d3c87262a818fe084edba224d7dd8f46d40c15a: Status 404 returned error can't find the container with id 987963a687b64aa6b781e5358d3c87262a818fe084edba224d7dd8f46d40c15a Jul 02 21:18:24.649113 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.648401 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804dd64c_2c91_45a9_9a35_5b7914d881e9.slice/crio-bebcad60da29b21ff7a1f5380c4827711800ba2b7452f3c4fde6084a6191a7e5 WatchSource:0}: Error finding container bebcad60da29b21ff7a1f5380c4827711800ba2b7452f3c4fde6084a6191a7e5: Status 404 returned error can't find the container with id bebcad60da29b21ff7a1f5380c4827711800ba2b7452f3c4fde6084a6191a7e5 Jul 02 21:18:24.651594 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.650639 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c60e37_12fa_4053_8317_cadbfb90914e.slice/crio-1b5638c057303d1f7c04011cb9888b762670d925eded71884e8af99c13c72de9 WatchSource:0}: Error finding container 1b5638c057303d1f7c04011cb9888b762670d925eded71884e8af99c13c72de9: Status 404 returned error can't find the container with id 1b5638c057303d1f7c04011cb9888b762670d925eded71884e8af99c13c72de9 Jul 02 21:18:24.651594 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:24.651526 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05ebb61_0f41_416f_b32d_6f8aeaf990c8.slice/crio-d10eaf02961aa55a3cb6a38a1f25a082321931f2bcd421ae97a22ac5015023c5 WatchSource:0}: Error finding container d10eaf02961aa55a3cb6a38a1f25a082321931f2bcd421ae97a22ac5015023c5: Status 404 returned error can't find the container with id d10eaf02961aa55a3cb6a38a1f25a082321931f2bcd421ae97a22ac5015023c5 Jul 02 21:18:25.142801 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.142503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:25.142801 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.142763 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:25.142801 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.142783 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:25.143062 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.142841 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:18:27.142819607 +0000 UTC m=+6.032742589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:25.143062 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.142913 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:25.143062 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.142932 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:25.143062 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.142944 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7kwbx for pod openshift-network-diagnostics/network-check-target-87w6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:25.143062 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.142992 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx podName:c7d35c0e-96e5-4391-aea6-0a6875785994 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:27.142977224 +0000 UTC m=+6.032900208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kwbx" (UniqueName: "kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx") pod "network-check-target-87w6b" (UID: "c7d35c0e-96e5-4391-aea6-0a6875785994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:25.243492 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.243448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:25.243672 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.243647 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:25.243763 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.243716 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret podName:abfce80c-bd3a-4ec8-b24c-a04cafa23131 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:27.243698678 +0000 UTC m=+6.133621653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret") pod "global-pull-secret-syncer-gn5q7" (UID: "abfce80c-bd3a-4ec8-b24c-a04cafa23131") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:25.556900 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.556817 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:13:23 +0000 UTC" deadline="2027-12-12 03:47:23.230720948 +0000 UTC" Jul 02 21:18:25.556900 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.556857 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12654h28m57.673868126s" Jul 02 21:18:25.624195 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.624166 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:25.624312 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.624292 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:25.624700 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.624680 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:25.624803 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.624785 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:25.624865 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.624851 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:25.624938 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.624918 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:25.638824 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.638799 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w5d26" event={"ID":"9fd8d29f-08ab-420f-9b76-8e897399db15","Type":"ContainerStarted","Data":"987963a687b64aa6b781e5358d3c87262a818fe084edba224d7dd8f46d40c15a"} Jul 02 21:18:25.643083 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.643057 2554 generic.go:356] "Generic (PLEG): container finished" podID="7cee05caf27e33be51c7f6266ac8029f" containerID="f9ba1ed390999aa91453544c827eb92031d0f7450856bcc39cfabc485a89be71" exitCode=0 Jul 02 21:18:25.643193 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.643133 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" event={"ID":"7cee05caf27e33be51c7f6266ac8029f","Type":"ContainerDied","Data":"f9ba1ed390999aa91453544c827eb92031d0f7450856bcc39cfabc485a89be71"} Jul 02 21:18:25.647706 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.647682 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" event={"ID":"73c60e37-12fa-4053-8317-cadbfb90914e","Type":"ContainerStarted","Data":"1b5638c057303d1f7c04011cb9888b762670d925eded71884e8af99c13c72de9"} Jul 02 21:18:25.651089 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.650922 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wh8r" event={"ID":"f9f1b4d3-efb8-4a53-b441-60280928d211","Type":"ContainerStarted","Data":"bf2a535124ad00a6340d7d09a266f0ca89dab22935ba89a9f87d46eb710aed63"} Jul 02 21:18:25.653250 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.653188 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gfztc" event={"ID":"60156939-3d05-4b01-8292-3718ccd6ccf9","Type":"ContainerStarted","Data":"ae34986574dd949991f7d7fbc71a48d4de75730100042e336b2889d35a5171bd"} Jul 02 21:18:25.655682 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.655190 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wv6fc" event={"ID":"d9718ee7-0618-4091-a314-4a734bf90c03","Type":"ContainerStarted","Data":"cb03f5f3ad521c07f079526f7a3e01220d3807a8751d6786bd039efa93538f7e"} Jul 02 21:18:25.657843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.657763 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerStarted","Data":"69b72424f4e1fd9d21949f46e9ffb498bd41cd12512f52ed1f5498a570c3107c"} Jul 02 21:18:25.660263 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.660241 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" event={"ID":"7cb73377-8763-4c62-b2ef-2f76615670d5","Type":"ContainerStarted","Data":"f223f51ad091b07e93b6581407423220a0bf2680f73ce4e654689b43ff545bfc"} Jul 02 21:18:25.670785 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.670761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" event={"ID":"f8cc86d8d444839b73f1e1fa89fc9a35","Type":"ContainerStarted","Data":"0ba507877b6758abd0d0eaca13ecdfe65b5f5873b65737b6872235e59abf1efb"} Jul 02 21:18:25.676338 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.676285 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"d10eaf02961aa55a3cb6a38a1f25a082321931f2bcd421ae97a22ac5015023c5"} Jul 02 21:18:25.679600 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.679578 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqgrw" event={"ID":"804dd64c-2c91-45a9-9a35-5b7914d881e9","Type":"ContainerStarted","Data":"bebcad60da29b21ff7a1f5380c4827711800ba2b7452f3c4fde6084a6191a7e5"} Jul 02 21:18:25.685435 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:25.684963 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" podStartSLOduration=2.68494744 podStartE2EDuration="2.68494744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:25.68457331 +0000 UTC m=+4.574496302" watchObservedRunningTime="2026-07-02 21:18:25.68494744 +0000 UTC m=+4.574870433" Jul 02 21:18:25.803470 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.803350 2554 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:60d76d51dac424f46a693b8b319b38803b48ebb091938c4153ffa0fafb50fd11" Jul 02 21:18:25.803806 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.803742 2554 kuberuntime_manager.go:1459] "Unhandled Error" err="container node-ca start failed in pod node-ca-kqgrw_openshift-image-registry(804dd64c-2c91-45a9-9a35-5b7914d881e9): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 02 21:18:25.804009 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.803972 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-image-registry/node-ca-kqgrw" podUID="804dd64c-2c91-45a9-9a35-5b7914d881e9" Jul 02 21:18:25.814533 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.814502 2554 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:8ebb1baa96f04db88699b99401e049bcc277fc57f13a823f9b1c573698c0f0ec: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49287a1683e255a8c7d468520a3bd9e589ec8c38863ecc28ce4886ed0cce9828" Jul 02 21:18:25.814626 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.814591 2554 kuberuntime_manager.go:1459] "Unhandled Error" err="init container egress-router-binary-copy start failed in pod multus-additional-cni-plugins-5rww5_openshift-multus(26354f55-ef32-4074-9b09-208f03cc5b18): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:8ebb1baa96f04db88699b99401e049bcc277fc57f13a823f9b1c573698c0f0ec: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 02 21:18:25.814688 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.814627 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:8ebb1baa96f04db88699b99401e049bcc277fc57f13a823f9b1c573698c0f0ec: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-multus/multus-additional-cni-plugins-5rww5" podUID="26354f55-ef32-4074-9b09-208f03cc5b18" Jul 02 21:18:25.979669 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.979620 2554 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a1931e9885740d5feab66e603e77a3ac8c2a2a552e7edbb0e54817a8bc00c15d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5be8cdcf34f35a89a70b6bfa49e66897641871237570b3e09766f83a0a473e6a" Jul 02 21:18:25.979890 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.979745 2554 kuberuntime_manager.go:1459] "Unhandled Error" err="container tuned start failed in pod tuned-k7q9p_openshift-cluster-node-tuning-operator(7cb73377-8763-4c62-b2ef-2f76615670d5): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a1931e9885740d5feab66e603e77a3ac8c2a2a552e7edbb0e54817a8bc00c15d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 02 21:18:25.979890 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:25.979788 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a1931e9885740d5feab66e603e77a3ac8c2a2a552e7edbb0e54817a8bc00c15d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" podUID="7cb73377-8763-4c62-b2ef-2f76615670d5" Jul 02 21:18:26.692883 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:26.691629 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" event={"ID":"7cee05caf27e33be51c7f6266ac8029f","Type":"ContainerStarted","Data":"f741de3b888f056e2c8c4e2ebc0c0d0b3adc9dd33fe920ccc21384bc96bfe5c8"} Jul 02 21:18:26.695392 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:26.694525 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49287a1683e255a8c7d468520a3bd9e589ec8c38863ecc28ce4886ed0cce9828\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:8ebb1baa96f04db88699b99401e049bcc277fc57f13a823f9b1c573698c0f0ec: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-multus/multus-additional-cni-plugins-5rww5" podUID="26354f55-ef32-4074-9b09-208f03cc5b18" Jul 02 21:18:26.695392 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:26.695009 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:60d76d51dac424f46a693b8b319b38803b48ebb091938c4153ffa0fafb50fd11\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-image-registry/node-ca-kqgrw" podUID="804dd64c-2c91-45a9-9a35-5b7914d881e9" Jul 02 21:18:26.695392 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:26.695294 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5be8cdcf34f35a89a70b6bfa49e66897641871237570b3e09766f83a0a473e6a\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a1931e9885740d5feab66e603e77a3ac8c2a2a552e7edbb0e54817a8bc00c15d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" podUID="7cb73377-8763-4c62-b2ef-2f76615670d5" Jul 02 21:18:26.727573 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:26.727498 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" podStartSLOduration=3.727479993 podStartE2EDuration="3.727479993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:26.714506652 +0000 UTC m=+5.604429645" watchObservedRunningTime="2026-07-02 21:18:26.727479993 +0000 UTC m=+5.617402989" Jul 02 21:18:27.164537 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:27.164505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:27.164714 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:27.164573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:27.164714 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.164688 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:27.164714 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.164711 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:27.164834 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.164713 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:27.164834 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.164721 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7kwbx for pod openshift-network-diagnostics/network-check-target-87w6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:27.164834 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.164777 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:18:31.164759531 +0000 UTC m=+10.054682514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:27.164834 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.164795 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx podName:c7d35c0e-96e5-4391-aea6-0a6875785994 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:31.164785851 +0000 UTC m=+10.054708835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kwbx" (UniqueName: "kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx") pod "network-check-target-87w6b" (UID: "c7d35c0e-96e5-4391-aea6-0a6875785994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:27.265665 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:27.265571 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:27.265826 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.265740 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:27.265826 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.265811 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret podName:abfce80c-bd3a-4ec8-b24c-a04cafa23131 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:31.265791215 +0000 UTC m=+10.155714201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret") pod "global-pull-secret-syncer-gn5q7" (UID: "abfce80c-bd3a-4ec8-b24c-a04cafa23131") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:27.621992 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:27.621919 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:27.621992 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:27.621944 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:27.621992 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:27.621944 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:27.622256 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.622048 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:27.622256 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.622191 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:27.622368 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:27.622262 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:29.621381 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:29.621347 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:29.621822 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:29.621350 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:29.621822 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:29.621506 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:29.621939 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:29.621905 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:29.621995 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:29.621955 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:29.622072 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:29.622054 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:30.700944 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:30.700907 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w5d26" event={"ID":"9fd8d29f-08ab-420f-9b76-8e897399db15","Type":"ContainerStarted","Data":"d0731c02d88d51b6eda494be9f1846053340bc05eaddbc8ee382f892b7a534c1"} Jul 02 21:18:30.702814 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:30.702750 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" event={"ID":"73c60e37-12fa-4053-8317-cadbfb90914e","Type":"ContainerStarted","Data":"404143b4c395ab994bf7d724bc143fd4a6880c291434f9dda8ca65e1c5b8c00b"} Jul 02 21:18:30.704343 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:30.704315 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gfztc" event={"ID":"60156939-3d05-4b01-8292-3718ccd6ccf9","Type":"ContainerStarted","Data":"ecede1db26218a407a3247a3196bf1295f02a2d637f243c71a2b6f6d317454e5"} Jul 02 21:18:30.715159 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:30.715110 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w5d26" podStartSLOduration=4.671216974 podStartE2EDuration="9.715092732s" totalImagesPullingTime="5.043875758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:30.714960058 +0000 UTC m=+9.604883051" watchObservedRunningTime="2026-07-02 21:18:30.715092732 +0000 UTC m=+9.605015722" Jul 02 21:18:30.728189 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:30.728158 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gfztc" podStartSLOduration=4.680829517 podStartE2EDuration="9.728146732s" totalImagesPullingTime="5.047317215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:30.727939027 +0000 UTC m=+9.617862017" watchObservedRunningTime="2026-07-02 21:18:30.728146732 +0000 UTC m=+9.618069723" Jul 02 21:18:30.765243 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:30.765210 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 21:18:31.195085 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.195052 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:31.195243 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.195114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:31.195297 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.195247 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:31.195297 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.195269 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:31.195297 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.195282 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7kwbx for pod openshift-network-diagnostics/network-check-target-87w6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:31.195407 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.195327 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx podName:c7d35c0e-96e5-4391-aea6-0a6875785994 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:39.195313517 +0000 UTC m=+18.085236486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kwbx" (UniqueName: "kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx") pod "network-check-target-87w6b" (UID: "c7d35c0e-96e5-4391-aea6-0a6875785994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:31.195663 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.195649 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:31.195725 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.195696 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:18:39.195683711 +0000 UTC m=+18.085606680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:31.296153 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.296091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:31.296321 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.296204 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:31.296321 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.296270 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret podName:abfce80c-bd3a-4ec8-b24c-a04cafa23131 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:39.296252593 +0000 UTC m=+18.186175569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret") pod "global-pull-secret-syncer-gn5q7" (UID: "abfce80c-bd3a-4ec8-b24c-a04cafa23131") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:31.576539 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.576443 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T21:18:30.765228638Z","UUID":"3f0b3877-1786-4ef1-bf92-2ebce02a6c6d","Handler":null,"Name":"","Endpoint":""} Jul 02 21:18:31.578000 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.577979 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 21:18:31.578130 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.578023 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 21:18:31.622498 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.622472 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:31.622641 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.622595 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:31.622699 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.622669 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:31.622996 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.622968 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:31.623092 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.623036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:31.623145 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:31.623112 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:31.708016 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.707987 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" event={"ID":"73c60e37-12fa-4053-8317-cadbfb90914e","Type":"ContainerStarted","Data":"1263242aebcd92511c96fc21e5b1b478a47a40e00732f9db6fb85f6a1061dd56"} Jul 02 21:18:31.709260 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.709238 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wh8r" event={"ID":"f9f1b4d3-efb8-4a53-b441-60280928d211","Type":"ContainerStarted","Data":"374f58d16d84c7e27c9b7347c10998cbd5499c23730a392e83580e2d6dc62cd3"} Jul 02 21:18:31.722796 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:31.722758 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8wh8r" podStartSLOduration=5.674819497 podStartE2EDuration="10.722746033s" totalImagesPullingTime="5.047926536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:31.722533588 +0000 UTC m=+10.612456580" watchObservedRunningTime="2026-07-02 21:18:31.722746033 +0000 UTC m=+10.612669023" Jul 02 21:18:32.714365 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:32.714331 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" event={"ID":"73c60e37-12fa-4053-8317-cadbfb90914e","Type":"ContainerStarted","Data":"7484b4e24f11d855751553aaf6f5399279dceef4fe30ff5a03b66468bd741bf5"} Jul 02 21:18:33.398166 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.398129 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:33.398830 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.398803 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:33.413464 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.413390 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqkz" podStartSLOduration=5.540525489 podStartE2EDuration="12.413370198s" totalImagesPullingTime="6.872844709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:32.734638348 +0000 UTC m=+11.624561339" watchObservedRunningTime="2026-07-02 21:18:33.413370198 +0000 UTC m=+12.303293189" Jul 02 21:18:33.621232 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.621198 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:33.621408 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.621200 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:33.621408 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:33.621295 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:33.621523 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:33.621432 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:33.621523 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.621469 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:33.621583 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:33.621553 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:33.716479 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.716391 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:33.716929 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:33.716888 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w5d26" Jul 02 21:18:35.622103 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:35.621878 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:35.622656 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:35.621878 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:35.622656 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:35.622211 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:35.622656 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:35.622026 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:35.622656 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:35.622313 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:35.622656 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:35.622351 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:37.621869 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:37.621835 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:37.622293 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:37.621964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:37.622293 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:37.621975 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:37.622293 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:37.621999 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:37.622293 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:37.622089 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:37.622293 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:37.622185 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:39.256704 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:39.256660 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:39.257173 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:39.256724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:39.257173 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.256835 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:39.257173 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.256845 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:39.257173 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.256858 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:39.257173 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.256872 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7kwbx for pod openshift-network-diagnostics/network-check-target-87w6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:39.257173 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.256910 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:18:55.256891993 +0000 UTC m=+34.146814963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:39.257173 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.256928 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx podName:c7d35c0e-96e5-4391-aea6-0a6875785994 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:55.256918948 +0000 UTC m=+34.146841929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kwbx" (UniqueName: "kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx") pod "network-check-target-87w6b" (UID: "c7d35c0e-96e5-4391-aea6-0a6875785994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:39.357108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:39.357074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:39.357284 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.357250 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:39.357352 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.357323 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret podName:abfce80c-bd3a-4ec8-b24c-a04cafa23131 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:55.357302555 +0000 UTC m=+34.247225539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret") pod "global-pull-secret-syncer-gn5q7" (UID: "abfce80c-bd3a-4ec8-b24c-a04cafa23131") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:39.621450 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:39.621407 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:39.621630 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.621519 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:39.621630 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:39.621432 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:39.621630 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:39.621407 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:39.621791 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.621633 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:39.621870 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:39.621845 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:41.622410 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:41.622379 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:41.623036 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:41.622495 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:41.623036 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:41.622689 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:41.623036 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:41.622788 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:41.623036 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:41.622843 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:41.623036 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:41.622942 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:43.622197 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.621955 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:43.622841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.621977 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:43.622841 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:43.622296 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:43.622841 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.622018 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:43.622841 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:43.622387 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:43.622841 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:43.622496 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:43.737547 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.737510 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wv6fc" event={"ID":"d9718ee7-0618-4091-a314-4a734bf90c03","Type":"ContainerStarted","Data":"c75c9654e32edd9cd4d75a43237e011d3233005b4d6de09335d7df1f7cfc16d2"} Jul 02 21:18:43.741554 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.741525 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"7f716b0743c8cb4e958e0834b174cd4cfb77f2c253d58e6102345ae6574d4cd1"} Jul 02 21:18:43.741682 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.741612 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"639e6147dcc1f700bd2430d4ab252ff568495fe2e6b438cc283d18b9a91fc92e"} Jul 02 21:18:43.741682 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.741660 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"f1446fa445fcd825d03e4598d208abb8499d3d1fef59f98c7e8aec9bdc6e0333"} Jul 02 21:18:43.741853 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.741709 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"f42c4953b9e07e14f6e594a054cea3ff4be0b9c716473c108b59e2f8a4a99e52"} Jul 02 21:18:43.741853 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.741755 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"5e1d8aa578353f5d87ed293c9cdd2d332ec1dd4eb50703a4a603d6c1a0ce6639"} Jul 02 21:18:43.741853 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.741804 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"2dfe58ab903d462e5383a32bbe4ae7346e8d20a33fed128deaa8c56ab97f2296"} Jul 02 21:18:43.757469 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:43.757403 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wv6fc" podStartSLOduration=4.349201492 podStartE2EDuration="22.75738602s" totalImagesPullingTime="18.408184528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:43.756864283 +0000 UTC m=+22.646787275" watchObservedRunningTime="2026-07-02 21:18:43.75738602 +0000 UTC m=+22.647309013" Jul 02 21:18:45.621529 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.621497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:45.621917 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.621541 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:45.621917 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.621497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:45.621917 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:45.621635 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:45.621917 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:45.621738 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:45.621917 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:45.621832 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:45.747752 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.747714 2554 generic.go:356] "Generic (PLEG): container finished" podID="26354f55-ef32-4074-9b09-208f03cc5b18" containerID="72a170ae82c917f60743af4ef5444bdfdfe0dc24ecec73109920c14df04ec2ed" exitCode=0 Jul 02 21:18:45.747911 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.747800 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerDied","Data":"72a170ae82c917f60743af4ef5444bdfdfe0dc24ecec73109920c14df04ec2ed"} Jul 02 21:18:45.751537 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.751511 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"efaec3ca9c1522a2e1e7ef5cd14671f06076ceb0a17e835976e27dfa528e1d0b"} Jul 02 21:18:45.753040 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.753021 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqgrw" event={"ID":"804dd64c-2c91-45a9-9a35-5b7914d881e9","Type":"ContainerStarted","Data":"5d25e6f4df01de948342ce09d606fe5af4121b3e6e1eaf05ecadf090f18305e9"} Jul 02 21:18:45.783899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:45.783823 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kqgrw" podStartSLOduration=4.245445172 podStartE2EDuration="24.783810778s" totalImagesPullingTime="20.538365606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 21:18:45.783178804 +0000 UTC m=+24.673101795" watchObservedRunningTime="2026-07-02 21:18:45.783810778 +0000 UTC m=+24.673733769" Jul 02 21:18:47.621489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:47.621456 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:47.621489 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:47.621490 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:47.621972 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:47.621465 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:47.621972 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:47.621574 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:47.621972 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:47.621626 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:47.621972 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:47.621741 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:49.621518 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.621335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:49.622345 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.621335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:49.622345 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:49.621622 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:49.622345 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:49.621696 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:49.622345 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.621405 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:49.622345 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:49.621800 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:49.763446 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.763332 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" event={"ID":"7cb73377-8763-4c62-b2ef-2f76615670d5","Type":"ContainerStarted","Data":"d35b0e1c19a5f86c34491435694a51dfdd3fecab0669e66374b7e77683ef38fe"} Jul 02 21:18:49.766721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.766696 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" event={"ID":"a05ebb61-0f41-416f-b32d-6f8aeaf990c8","Type":"ContainerStarted","Data":"b8f94fbd4e2c76a3e1d9c27bf5a78cda0cb03a151cb015a5c297a9aad81d6428"} Jul 02 21:18:49.766953 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.766932 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:49.767023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.767008 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:49.767158 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.767041 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:49.781982 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.781947 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:49.782608 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.782591 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:18:49.784664 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.784625 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k7q9p" podStartSLOduration=2.908463828 podStartE2EDuration="27.784614152s" totalImagesPullingTime="24.876150324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 21:18:49.783959997 +0000 UTC m=+28.673882988" watchObservedRunningTime="2026-07-02 21:18:49.784614152 +0000 UTC m=+28.674537143" Jul 02 21:18:49.831705 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:49.831657 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" podStartSLOduration=10.421059282 podStartE2EDuration="28.831640423s" totalImagesPullingTime="18.410581141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:49.831269736 +0000 UTC m=+28.721192733" watchObservedRunningTime="2026-07-02 21:18:49.831640423 +0000 UTC m=+28.721563416" Jul 02 21:18:51.140835 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:51.140793 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gn5q7"] Jul 02 21:18:51.141538 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:51.140976 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:51.141538 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:51.141088 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:51.142504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:51.142482 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87w6b"] Jul 02 21:18:51.142619 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:51.142578 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:51.142689 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:51.142671 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:51.160064 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:51.160037 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p2gmk"] Jul 02 21:18:51.160195 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:51.160146 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:51.160267 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:51.160244 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:52.622134 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:52.621988 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:52.622555 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:52.622030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:52.622555 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:52.622216 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:52.622555 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:52.622045 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:52.622555 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:52.622276 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:52.622555 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:52.622371 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:52.774189 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:52.774111 2554 generic.go:356] "Generic (PLEG): container finished" podID="26354f55-ef32-4074-9b09-208f03cc5b18" containerID="11fdb0ea81faed1b0cacac9a255bc5d57f9943c1e8e85a512ae57ed7840357fc" exitCode=0 Jul 02 21:18:52.774189 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:52.774162 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerDied","Data":"11fdb0ea81faed1b0cacac9a255bc5d57f9943c1e8e85a512ae57ed7840357fc"} Jul 02 21:18:53.778445 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:53.778400 2554 generic.go:356] "Generic (PLEG): container finished" podID="26354f55-ef32-4074-9b09-208f03cc5b18" containerID="7582313105ff479a7df1142c6124f4bd871e86eeb9d58746fbb3e2997990c99e" exitCode=0 Jul 02 21:18:53.778824 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:53.778454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerDied","Data":"7582313105ff479a7df1142c6124f4bd871e86eeb9d58746fbb3e2997990c99e"} Jul 02 21:18:54.622052 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:54.622020 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:54.622201 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:54.622122 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:54.622201 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:54.622153 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:54.622291 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:54.622125 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87w6b" podUID="c7d35c0e-96e5-4391-aea6-0a6875785994" Jul 02 21:18:54.622291 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:54.622246 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2gmk" podUID="46b40c26-be7b-49dc-af65-7067d02f205e" Jul 02 21:18:54.622360 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:54.622336 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gn5q7" podUID="abfce80c-bd3a-4ec8-b24c-a04cafa23131" Jul 02 21:18:54.782342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:54.782259 2554 generic.go:356] "Generic (PLEG): container finished" podID="26354f55-ef32-4074-9b09-208f03cc5b18" containerID="952e1c8270bb54e4cd40118607da0f9edfec0fc304f3f87794ea5b81e00e7bbd" exitCode=0 Jul 02 21:18:54.782342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:54.782307 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerDied","Data":"952e1c8270bb54e4cd40118607da0f9edfec0fc304f3f87794ea5b81e00e7bbd"} Jul 02 21:18:55.283904 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.283869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:55.284056 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.283923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:55.284056 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.284013 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:55.284056 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.284044 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:55.284188 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.284069 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.284051996 +0000 UTC m=+66.173974966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:55.284188 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.284068 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:55.284188 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.284091 2554 projected.go:196] Error preparing data for projected volume kube-api-access-7kwbx for pod openshift-network-diagnostics/network-check-target-87w6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:55.284188 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.284157 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx podName:c7d35c0e-96e5-4391-aea6-0a6875785994 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.284146084 +0000 UTC m=+66.174069054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kwbx" (UniqueName: "kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx") pod "network-check-target-87w6b" (UID: "c7d35c0e-96e5-4391-aea6-0a6875785994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:55.384593 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.384559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:55.384764 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.384672 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:55.384764 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:55.384739 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret podName:abfce80c-bd3a-4ec8-b24c-a04cafa23131 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.384721536 +0000 UTC m=+66.274644505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret") pod "global-pull-secret-syncer-gn5q7" (UID: "abfce80c-bd3a-4ec8-b24c-a04cafa23131") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:55.859134 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.859095 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeReady" Jul 02 21:18:55.859568 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.859227 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 21:18:55.919768 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.919734 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-675b6ddc8c-cm8tb"] Jul 02 21:18:55.939308 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.939281 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v6f7m"] Jul 02 21:18:55.939452 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.939401 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:55.943482 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.943460 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 21:18:55.943639 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.943618 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 21:18:55.944301 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.944284 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 21:18:55.944592 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.944578 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p4wrm\"" Jul 02 21:18:55.951867 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.951848 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-675b6ddc8c-cm8tb"] Jul 02 21:18:55.951955 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.951942 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:55.954615 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.954599 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 21:18:55.954689 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.954620 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 21:18:55.954689 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.954682 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-69xqz\"" Jul 02 21:18:55.958019 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.957969 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 21:18:55.958112 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.958079 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v6f7m"] Jul 02 21:18:55.962957 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.962940 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wllr6"] Jul 02 21:18:55.988398 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.988378 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wllr6"] Jul 02 21:18:55.988512 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.988468 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:55.992772 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.992756 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 21:18:55.992877 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.992802 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.992938 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.992923 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bftgm\"" Jul 02 21:18:55.993325 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:55.993310 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 21:18:56.089681 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-image-registry-private-configuration\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.089855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-trusted-ca\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.089855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scs44\" (UniqueName: \"kubernetes.io/projected/a8309612-c115-4433-80fb-25fb0708c372-kube-api-access-scs44\") pod \"ingress-canary-wllr6\" (UID: \"a8309612-c115-4433-80fb-25fb0708c372\") " pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:56.089855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-ca-trust-extracted\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.089855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-certificates\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.089855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089815 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089862 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089885 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkjdj\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-kube-api-access-rkjdj\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089954 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-bound-sa-token\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.089991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-installation-pull-secrets\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.090024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwndd\" (UniqueName: \"kubernetes.io/projected/1049fda3-73e0-488b-9235-a9ad8ecd0f35-kube-api-access-nwndd\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.090055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1049fda3-73e0-488b-9235-a9ad8ecd0f35-tmp-dir\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.090094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1049fda3-73e0-488b-9235-a9ad8ecd0f35-config-volume\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.090171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.090115 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8309612-c115-4433-80fb-25fb0708c372-cert\") pod \"ingress-canary-wllr6\" (UID: \"a8309612-c115-4433-80fb-25fb0708c372\") " pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:56.190531 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.190531 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjdj\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-kube-api-access-rkjdj\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.190737 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-bound-sa-token\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.190737 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-installation-pull-secrets\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.190737 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.190608 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:56.190737 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.190632 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675b6ddc8c-cm8tb: secret "image-registry-tls" not found Jul 02 21:18:56.190737 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwndd\" (UniqueName: \"kubernetes.io/projected/1049fda3-73e0-488b-9235-a9ad8ecd0f35-kube-api-access-nwndd\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.190737 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.190691 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls podName:7af1f35e-a1e5-4d97-989d-ed2e4a09d496 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:56.690670159 +0000 UTC m=+35.580593144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls") pod "image-registry-675b6ddc8c-cm8tb" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496") : secret "image-registry-tls" not found Jul 02 21:18:56.190737 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1049fda3-73e0-488b-9235-a9ad8ecd0f35-tmp-dir\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.191052 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190766 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1049fda3-73e0-488b-9235-a9ad8ecd0f35-config-volume\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.191052 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8309612-c115-4433-80fb-25fb0708c372-cert\") pod \"ingress-canary-wllr6\" (UID: \"a8309612-c115-4433-80fb-25fb0708c372\") " pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:56.191052 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.190982 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-image-registry-private-configuration\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.191052 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191025 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-trusted-ca\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.191217 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scs44\" (UniqueName: \"kubernetes.io/projected/a8309612-c115-4433-80fb-25fb0708c372-kube-api-access-scs44\") pod \"ingress-canary-wllr6\" (UID: \"a8309612-c115-4433-80fb-25fb0708c372\") " pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:56.191217 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-ca-trust-extracted\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.191217 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-certificates\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.191217 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191121 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1049fda3-73e0-488b-9235-a9ad8ecd0f35-tmp-dir\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.191217 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191149 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.191453 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.191244 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:56.191453 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.191277 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls podName:1049fda3-73e0-488b-9235-a9ad8ecd0f35 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:56.691267035 +0000 UTC m=+35.581190005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls") pod "dns-default-v6f7m" (UID: "1049fda3-73e0-488b-9235-a9ad8ecd0f35") : secret "dns-default-metrics-tls" not found Jul 02 21:18:56.191453 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191333 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1049fda3-73e0-488b-9235-a9ad8ecd0f35-config-volume\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.191690 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191668 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-ca-trust-extracted\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.192084 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.191949 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-certificates\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.192687 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.192659 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-trusted-ca\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.195119 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.195087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-image-registry-private-configuration\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.195195 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.195106 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-installation-pull-secrets\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.195395 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.195373 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8309612-c115-4433-80fb-25fb0708c372-cert\") pod \"ingress-canary-wllr6\" (UID: \"a8309612-c115-4433-80fb-25fb0708c372\") " pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:56.206624 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.206602 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-bound-sa-token\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.206889 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.206861 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwndd\" (UniqueName: \"kubernetes.io/projected/1049fda3-73e0-488b-9235-a9ad8ecd0f35-kube-api-access-nwndd\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.207342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.207322 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjdj\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-kube-api-access-rkjdj\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.207799 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.207778 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scs44\" (UniqueName: \"kubernetes.io/projected/a8309612-c115-4433-80fb-25fb0708c372-kube-api-access-scs44\") pod \"ingress-canary-wllr6\" (UID: \"a8309612-c115-4433-80fb-25fb0708c372\") " pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:56.295922 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.295888 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wllr6" Jul 02 21:18:56.475464 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.475375 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wllr6"] Jul 02 21:18:56.478903 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:18:56.478870 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8309612_c115_4433_80fb_25fb0708c372.slice/crio-cd8c2ed2eec4c5f6954c26eec8331c72c7294900a7af482aaba4528ac349f197 WatchSource:0}: Error finding container cd8c2ed2eec4c5f6954c26eec8331c72c7294900a7af482aaba4528ac349f197: Status 404 returned error can't find the container with id cd8c2ed2eec4c5f6954c26eec8331c72c7294900a7af482aaba4528ac349f197 Jul 02 21:18:56.621464 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.621428 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:18:56.621464 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.621456 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:18:56.621464 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.621464 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:18:56.627792 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.627766 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:18:56.627962 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.627834 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:18:56.628915 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.628778 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:18:56.628915 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.628817 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:18:56.628915 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.628828 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r4vsj\"" Jul 02 21:18:56.628915 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.628817 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lxff2\"" Jul 02 21:18:56.695335 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.695303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:56.695455 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.695346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:56.695505 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.695462 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:56.695537 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.695512 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls podName:1049fda3-73e0-488b-9235-a9ad8ecd0f35 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:57.695499145 +0000 UTC m=+36.585422118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls") pod "dns-default-v6f7m" (UID: "1049fda3-73e0-488b-9235-a9ad8ecd0f35") : secret "dns-default-metrics-tls" not found Jul 02 21:18:56.695537 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.695520 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:56.695537 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.695535 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675b6ddc8c-cm8tb: secret "image-registry-tls" not found Jul 02 21:18:56.695626 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:56.695593 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls podName:7af1f35e-a1e5-4d97-989d-ed2e4a09d496 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:57.695578965 +0000 UTC m=+36.585501939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls") pod "image-registry-675b6ddc8c-cm8tb" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496") : secret "image-registry-tls" not found Jul 02 21:18:56.787290 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:56.787210 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wllr6" event={"ID":"a8309612-c115-4433-80fb-25fb0708c372","Type":"ContainerStarted","Data":"cd8c2ed2eec4c5f6954c26eec8331c72c7294900a7af482aaba4528ac349f197"} Jul 02 21:18:57.705344 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:57.705313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:57.705794 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:57.705360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:57.705794 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:57.705492 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:57.705794 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:57.705558 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls podName:1049fda3-73e0-488b-9235-a9ad8ecd0f35 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:59.705543074 +0000 UTC m=+38.595466043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls") pod "dns-default-v6f7m" (UID: "1049fda3-73e0-488b-9235-a9ad8ecd0f35") : secret "dns-default-metrics-tls" not found Jul 02 21:18:57.705794 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:57.705499 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:57.705794 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:57.705600 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675b6ddc8c-cm8tb: secret "image-registry-tls" not found Jul 02 21:18:57.705794 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:57.705672 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls podName:7af1f35e-a1e5-4d97-989d-ed2e4a09d496 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:59.705653923 +0000 UTC m=+38.595576915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls") pod "image-registry-675b6ddc8c-cm8tb" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496") : secret "image-registry-tls" not found Jul 02 21:18:59.720951 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:59.720918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:18:59.721329 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:59.720970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:18:59.721329 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:59.721082 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:59.721329 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:59.721097 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:59.721329 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:59.721109 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675b6ddc8c-cm8tb: secret "image-registry-tls" not found Jul 02 21:18:59.721329 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:59.721143 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls podName:1049fda3-73e0-488b-9235-a9ad8ecd0f35 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:03.721127087 +0000 UTC m=+42.611050056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls") pod "dns-default-v6f7m" (UID: "1049fda3-73e0-488b-9235-a9ad8ecd0f35") : secret "dns-default-metrics-tls" not found Jul 02 21:18:59.721329 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:18:59.721161 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls podName:7af1f35e-a1e5-4d97-989d-ed2e4a09d496 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:03.721154126 +0000 UTC m=+42.611077095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls") pod "image-registry-675b6ddc8c-cm8tb" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496") : secret "image-registry-tls" not found Jul 02 21:18:59.795566 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:59.795525 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wllr6" event={"ID":"a8309612-c115-4433-80fb-25fb0708c372","Type":"ContainerStarted","Data":"7b9db117d1a2cd0cfc92e1b6458fc0e8c87d66400f7d023e30effc3bf4f6f645"} Jul 02 21:18:59.811576 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:18:59.811525 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wllr6" podStartSLOduration=2.477871066 podStartE2EDuration="4.811505833s" totalImagesPullingTime="2.333634767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:59.809884121 +0000 UTC m=+38.699807115" watchObservedRunningTime="2026-07-02 21:18:59.811505833 +0000 UTC m=+38.701428827" Jul 02 21:19:00.974792 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:00.974746 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:01.067775 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:01.067705 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:01.166980 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:01.166906 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:01.266703 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:01.266672 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:01.802392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:01.802359 2554 generic.go:356] "Generic (PLEG): container finished" podID="26354f55-ef32-4074-9b09-208f03cc5b18" containerID="d553a7b24c8aa9cfbf29eb1e366108876feff690d59de2bc7829eb8be586f427" exitCode=0 Jul 02 21:19:01.802548 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:01.802410 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerDied","Data":"d553a7b24c8aa9cfbf29eb1e366108876feff690d59de2bc7829eb8be586f427"} Jul 02 21:19:02.807773 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:02.807741 2554 generic.go:356] "Generic (PLEG): container finished" podID="26354f55-ef32-4074-9b09-208f03cc5b18" containerID="55e5a6fdc404f033349efeb2f72feb6313b7edfe1662c5d04b4b928a66a53902" exitCode=0 Jul 02 21:19:02.807773 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:02.807777 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerDied","Data":"55e5a6fdc404f033349efeb2f72feb6313b7edfe1662c5d04b4b928a66a53902"} Jul 02 21:19:03.604098 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:03.604053 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:03.704378 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:03.704335 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:03.748982 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:03.748952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:19:03.749124 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:03.748990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:19:03.749124 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:03.749111 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:03.749230 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:03.749175 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls podName:1049fda3-73e0-488b-9235-a9ad8ecd0f35 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:11.749156073 +0000 UTC m=+50.639079055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls") pod "dns-default-v6f7m" (UID: "1049fda3-73e0-488b-9235-a9ad8ecd0f35") : secret "dns-default-metrics-tls" not found Jul 02 21:19:03.749230 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:03.749112 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:19:03.749230 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:03.749207 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675b6ddc8c-cm8tb: secret "image-registry-tls" not found Jul 02 21:19:03.749381 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:03.749244 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls podName:7af1f35e-a1e5-4d97-989d-ed2e4a09d496 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:11.749233679 +0000 UTC m=+50.639156648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls") pod "image-registry-675b6ddc8c-cm8tb" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496") : secret "image-registry-tls" not found Jul 02 21:19:03.812953 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:03.812929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rww5" event={"ID":"26354f55-ef32-4074-9b09-208f03cc5b18","Type":"ContainerStarted","Data":"0a467d44a8dbefba7a6a5cd6c8ff42270140c5f6a163dad5c0ba780843f9196b"} Jul 02 21:19:03.842482 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:03.842433 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5rww5" podStartSLOduration=6.36886419 podStartE2EDuration="42.842398338s" totalImagesPullingTime="36.473534148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 21:19:03.841106231 +0000 UTC m=+42.731029223" watchObservedRunningTime="2026-07-02 21:19:03.842398338 +0000 UTC m=+42.732321307" Jul 02 21:19:03.971621 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:03.971537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:04.068505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:04.068469 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:11.801731 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:11.801695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:19:11.802123 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:11.801769 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:19:11.802123 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:11.801836 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:19:11.802123 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:11.801861 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675b6ddc8c-cm8tb: secret "image-registry-tls" not found Jul 02 21:19:11.802123 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:11.801910 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls podName:7af1f35e-a1e5-4d97-989d-ed2e4a09d496 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.801895311 +0000 UTC m=+66.691818279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls") pod "image-registry-675b6ddc8c-cm8tb" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496") : secret "image-registry-tls" not found Jul 02 21:19:11.802123 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:11.801844 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:11.802123 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:11.801986 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls podName:1049fda3-73e0-488b-9235-a9ad8ecd0f35 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.801971415 +0000 UTC m=+66.691894387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls") pod "dns-default-v6f7m" (UID: "1049fda3-73e0-488b-9235-a9ad8ecd0f35") : secret "dns-default-metrics-tls" not found Jul 02 21:19:18.409998 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.409969 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm"] Jul 02 21:19:18.457982 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.457960 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc"] Jul 02 21:19:18.458122 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.458070 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.462437 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.462401 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.462621 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.462485 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 21:19:18.463113 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.463092 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.463193 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.463121 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 21:19:18.463305 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.463121 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lbnnk\"" Jul 02 21:19:18.465435 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.465403 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm"] Jul 02 21:19:18.465543 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.465446 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc"] Jul 02 21:19:18.465543 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.465498 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" Jul 02 21:19:18.467625 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.467606 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.467715 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.467655 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pgvsr\"" Jul 02 21:19:18.467715 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.467707 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.507632 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.507614 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275"] Jul 02 21:19:18.531262 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.531243 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv"] Jul 02 21:19:18.531399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.531318 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.534241 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.534222 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-47tq6\"" Jul 02 21:19:18.534336 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.534222 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 21:19:18.534759 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.534744 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.534843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.534748 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 21:19:18.542900 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.542885 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.544246 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.544226 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq"] Jul 02 21:19:18.544361 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.544334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:18.546961 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.546941 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qnpzp\"" Jul 02 21:19:18.547361 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.547128 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.547361 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.547157 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.547633 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.547616 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 21:19:18.547952 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.547934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfdmz\" (UniqueName: \"kubernetes.io/projected/d6cac955-3771-4c7e-bc77-efc16830d84c-kube-api-access-sfdmz\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.548053 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.548001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.548053 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.548034 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d6cac955-3771-4c7e-bc77-efc16830d84c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.548403 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.548248 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbj2p\" (UniqueName: \"kubernetes.io/projected/3a72569c-8e3f-4837-bf0c-0806319a9866-kube-api-access-cbj2p\") pod \"volume-data-source-validator-5d456fdbcd-vl4cc\" (UID: \"3a72569c-8e3f-4837-bf0c-0806319a9866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" Jul 02 21:19:18.558737 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.558719 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-w4x6d"] Jul 02 21:19:18.558840 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.558824 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.561135 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.561120 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 21:19:18.561215 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.561119 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 21:19:18.561719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.561702 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.561794 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.561725 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.562755 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.562741 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rk8c2\"" Jul 02 21:19:18.570740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.570723 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bf9b5bf9-wx657"] Jul 02 21:19:18.570850 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.570817 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.576241 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.576226 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d928h\"" Jul 02 21:19:18.576454 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.576439 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 21:19:18.576503 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.576471 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.576925 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.576912 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 21:19:18.577509 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.577498 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.583296 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.583282 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 21:19:18.596702 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.596682 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275"] Jul 02 21:19:18.596779 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.596708 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv"] Jul 02 21:19:18.596779 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.596725 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-w4x6d"] Jul 02 21:19:18.596779 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.596737 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bf9b5bf9-wx657"] Jul 02 21:19:18.596779 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.596749 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq"] Jul 02 21:19:18.596902 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.596783 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.599125 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.599100 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 21:19:18.599195 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.599160 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 21:19:18.599238 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.599194 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 21:19:18.599365 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.599352 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-flwgx\"" Jul 02 21:19:18.599446 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.599379 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 21:19:18.599446 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.599429 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.599588 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.599574 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.608330 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.608311 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nmd6f"] Jul 02 21:19:18.620143 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.620127 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.624692 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.624673 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:18.624807 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.624755 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s7pnp\"" Jul 02 21:19:18.624877 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.624808 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 21:19:18.625844 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.625411 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 21:19:18.625844 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.625446 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:18.625958 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.625893 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nmd6f"] Jul 02 21:19:18.630602 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.630586 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 21:19:18.649527 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/481a79ac-3ca8-4ae3-aec9-96837247eafd-snapshots\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.649621 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d482789f-015f-4cbd-ad3d-53b26d2be8e8-config\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.649621 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649551 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/481a79ac-3ca8-4ae3-aec9-96837247eafd-serving-cert\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.649621 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649572 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f2313b7-516a-4e4e-ba0d-47c39826ff22-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.649621 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481a79ac-3ca8-4ae3-aec9-96837247eafd-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.649831 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481a79ac-3ca8-4ae3-aec9-96837247eafd-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.649831 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649692 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d6cac955-3771-4c7e-bc77-efc16830d84c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.649831 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649724 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.649831 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75p6v\" (UniqueName: \"kubernetes.io/projected/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-kube-api-access-75p6v\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.649831 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbj2p\" (UniqueName: \"kubernetes.io/projected/3a72569c-8e3f-4837-bf0c-0806319a9866-kube-api-access-cbj2p\") pod \"volume-data-source-validator-5d456fdbcd-vl4cc\" (UID: \"3a72569c-8e3f-4837-bf0c-0806319a9866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" Jul 02 21:19:18.649831 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-trusted-ca\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/481a79ac-3ca8-4ae3-aec9-96837247eafd-tmp\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npdjr\" (UniqueName: \"kubernetes.io/projected/e3cd3f80-73b8-4293-b59c-43beb4b975fc-kube-api-access-npdjr\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2jm5\" (UniqueName: \"kubernetes.io/projected/481a79ac-3ca8-4ae3-aec9-96837247eafd-kube-api-access-k2jm5\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.649992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-config\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650019 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2313b7-516a-4e4e-ba0d-47c39826ff22-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650049 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfdmz\" (UniqueName: \"kubernetes.io/projected/d6cac955-3771-4c7e-bc77-efc16830d84c-kube-api-access-sfdmz\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.650108 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-default-certificate\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650115 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d482789f-015f-4cbd-ad3d-53b26d2be8e8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650197 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxgp\" (UniqueName: \"kubernetes.io/projected/4e89b856-d514-4d3c-9598-a717ee9980d2-kube-api-access-npxgp\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650228 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkbv7\" (UniqueName: \"kubernetes.io/projected/8f2313b7-516a-4e4e-ba0d-47c39826ff22-kube-api-access-qkbv7\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:18.650249 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:18.650299 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls podName:d6cac955-3771-4c7e-bc77-efc16830d84c nodeName:}" failed. No retries permitted until 2026-07-02 21:19:19.150285048 +0000 UTC m=+58.040208017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-df2pm" (UID: "d6cac955-3771-4c7e-bc77-efc16830d84c") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650319 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-serving-cert\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650343 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d6cac955-3771-4c7e-bc77-efc16830d84c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-stats-auth\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.650504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.650408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wqx2\" (UniqueName: \"kubernetes.io/projected/d482789f-015f-4cbd-ad3d-53b26d2be8e8-kube-api-access-4wqx2\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.662743 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.662697 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfdmz\" (UniqueName: \"kubernetes.io/projected/d6cac955-3771-4c7e-bc77-efc16830d84c-kube-api-access-sfdmz\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:18.663373 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.663350 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbj2p\" (UniqueName: \"kubernetes.io/projected/3a72569c-8e3f-4837-bf0c-0806319a9866-kube-api-access-cbj2p\") pod \"volume-data-source-validator-5d456fdbcd-vl4cc\" (UID: \"3a72569c-8e3f-4837-bf0c-0806319a9866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" Jul 02 21:19:18.751601 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-stats-auth\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.751698 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wqx2\" (UniqueName: \"kubernetes.io/projected/d482789f-015f-4cbd-ad3d-53b26d2be8e8-kube-api-access-4wqx2\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.751698 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/481a79ac-3ca8-4ae3-aec9-96837247eafd-snapshots\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.751698 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d482789f-015f-4cbd-ad3d-53b26d2be8e8-config\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.751698 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751680 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/481a79ac-3ca8-4ae3-aec9-96837247eafd-serving-cert\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751708 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f2313b7-516a-4e4e-ba0d-47c39826ff22-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751732 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481a79ac-3ca8-4ae3-aec9-96837247eafd-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751755 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481a79ac-3ca8-4ae3-aec9-96837247eafd-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751783 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75p6v\" (UniqueName: \"kubernetes.io/projected/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-kube-api-access-75p6v\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751844 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-trusted-ca\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751870 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:18.751899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/481a79ac-3ca8-4ae3-aec9-96837247eafd-tmp\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npdjr\" (UniqueName: \"kubernetes.io/projected/e3cd3f80-73b8-4293-b59c-43beb4b975fc-kube-api-access-npdjr\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:18.751935 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.751958 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2jm5\" (UniqueName: \"kubernetes.io/projected/481a79ac-3ca8-4ae3-aec9-96837247eafd-kube-api-access-k2jm5\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:18.752000 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:19.251983317 +0000 UTC m=+58.141906292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : secret "router-metrics-certs-default" not found Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752022 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-config\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2313b7-516a-4e4e-ba0d-47c39826ff22-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-default-certificate\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d482789f-015f-4cbd-ad3d-53b26d2be8e8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npxgp\" (UniqueName: \"kubernetes.io/projected/4e89b856-d514-4d3c-9598-a717ee9980d2-kube-api-access-npxgp\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkbv7\" (UniqueName: \"kubernetes.io/projected/8f2313b7-516a-4e4e-ba0d-47c39826ff22-kube-api-access-qkbv7\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.752274 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.752847 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-serving-cert\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.752847 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752326 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f2313b7-516a-4e4e-ba0d-47c39826ff22-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.752847 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752357 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d482789f-015f-4cbd-ad3d-53b26d2be8e8-config\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.752847 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:18.752462 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:18.752847 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:18.752519 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls podName:e3cd3f80-73b8-4293-b59c-43beb4b975fc nodeName:}" failed. No retries permitted until 2026-07-02 21:19:19.252502631 +0000 UTC m=+58.142425601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5zskv" (UID: "e3cd3f80-73b8-4293-b59c-43beb4b975fc") : secret "samples-operator-tls" not found Jul 02 21:19:18.752847 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752752 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/481a79ac-3ca8-4ae3-aec9-96837247eafd-tmp\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.753210 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.752949 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481a79ac-3ca8-4ae3-aec9-96837247eafd-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.753998 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:18.753304 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:19.25328614 +0000 UTC m=+58.143209111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:18.753998 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.753410 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-trusted-ca\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.753998 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.753544 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/481a79ac-3ca8-4ae3-aec9-96837247eafd-snapshots\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.753998 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.753960 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481a79ac-3ca8-4ae3-aec9-96837247eafd-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.754320 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.754299 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-config\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.754474 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.754455 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/481a79ac-3ca8-4ae3-aec9-96837247eafd-serving-cert\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.754915 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.754885 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-serving-cert\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.755231 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.755208 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-default-certificate\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.755276 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.755209 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d482789f-015f-4cbd-ad3d-53b26d2be8e8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.755322 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.755306 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-stats-auth\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.755836 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.755820 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2313b7-516a-4e4e-ba0d-47c39826ff22-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.761867 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.761848 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wqx2\" (UniqueName: \"kubernetes.io/projected/d482789f-015f-4cbd-ad3d-53b26d2be8e8-kube-api-access-4wqx2\") pod \"service-ca-operator-5d46d9ffd4-6m275\" (UID: \"d482789f-015f-4cbd-ad3d-53b26d2be8e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.762682 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.762648 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75p6v\" (UniqueName: \"kubernetes.io/projected/e2d307a8-10e4-49b0-9afc-6aff6d0497e2-kube-api-access-75p6v\") pod \"console-operator-68b757fb67-nmd6f\" (UID: \"e2d307a8-10e4-49b0-9afc-6aff6d0497e2\") " pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.766673 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.766653 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npdjr\" (UniqueName: \"kubernetes.io/projected/e3cd3f80-73b8-4293-b59c-43beb4b975fc-kube-api-access-npdjr\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:18.768711 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.768689 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2jm5\" (UniqueName: \"kubernetes.io/projected/481a79ac-3ca8-4ae3-aec9-96837247eafd-kube-api-access-k2jm5\") pod \"insights-operator-5c847dcfc4-w4x6d\" (UID: \"481a79ac-3ca8-4ae3-aec9-96837247eafd\") " pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.768829 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.768813 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxgp\" (UniqueName: \"kubernetes.io/projected/4e89b856-d514-4d3c-9598-a717ee9980d2-kube-api-access-npxgp\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:18.769600 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.769585 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkbv7\" (UniqueName: \"kubernetes.io/projected/8f2313b7-516a-4e4e-ba0d-47c39826ff22-kube-api-access-qkbv7\") pod \"kube-storage-version-migrator-operator-846bf668f7-ggmhq\" (UID: \"8f2313b7-516a-4e4e-ba0d-47c39826ff22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.774634 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.774619 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" Jul 02 21:19:18.839594 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.839568 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" Jul 02 21:19:18.866710 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.866684 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" Jul 02 21:19:18.878857 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.878832 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" Jul 02 21:19:18.928462 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.928129 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:18.929654 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:18.929404 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc"] Jul 02 21:19:18.933870 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:18.933837 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a72569c_8e3f_4837_bf0c_0806319a9866.slice/crio-6c12e24255eba737d5aa9d83ee046dfd65e9d1bf4a5c55f596a141ee703601ab WatchSource:0}: Error finding container 6c12e24255eba737d5aa9d83ee046dfd65e9d1bf4a5c55f596a141ee703601ab: Status 404 returned error can't find the container with id 6c12e24255eba737d5aa9d83ee046dfd65e9d1bf4a5c55f596a141ee703601ab Jul 02 21:19:19.017487 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.017398 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275"] Jul 02 21:19:19.069372 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.069349 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-w4x6d"] Jul 02 21:19:19.071545 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:19.071516 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481a79ac_3ca8_4ae3_aec9_96837247eafd.slice/crio-d039946d69d36c75a5c7cde0120c8520a67beb89a107cdff79be6940413894f9 WatchSource:0}: Error finding container d039946d69d36c75a5c7cde0120c8520a67beb89a107cdff79be6940413894f9: Status 404 returned error can't find the container with id d039946d69d36c75a5c7cde0120c8520a67beb89a107cdff79be6940413894f9 Jul 02 21:19:19.082981 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.082934 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq"] Jul 02 21:19:19.085901 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:19.085880 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2313b7_516a_4e4e_ba0d_47c39826ff22.slice/crio-b2a7736e792168917a100c921375eb3c870291e886d4209b0954b405bb2fef76 WatchSource:0}: Error finding container b2a7736e792168917a100c921375eb3c870291e886d4209b0954b405bb2fef76: Status 404 returned error can't find the container with id b2a7736e792168917a100c921375eb3c870291e886d4209b0954b405bb2fef76 Jul 02 21:19:19.103470 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.103445 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nmd6f"] Jul 02 21:19:19.106193 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:19.106172 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d307a8_10e4_49b0_9afc_6aff6d0497e2.slice/crio-162d893e844c87e26afbc55f563ed70c7b66af994d2f0c336b96a663685f95ca WatchSource:0}: Error finding container 162d893e844c87e26afbc55f563ed70c7b66af994d2f0c336b96a663685f95ca: Status 404 returned error can't find the container with id 162d893e844c87e26afbc55f563ed70c7b66af994d2f0c336b96a663685f95ca Jul 02 21:19:19.157004 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.156973 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:19.157138 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:19.157120 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:19.157184 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:19.157176 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls podName:d6cac955-3771-4c7e-bc77-efc16830d84c nodeName:}" failed. No retries permitted until 2026-07-02 21:19:20.157160951 +0000 UTC m=+59.047083919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-df2pm" (UID: "d6cac955-3771-4c7e-bc77-efc16830d84c") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:19.257894 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.257820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:19.257894 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.257889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:19.258092 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:19.257975 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:19.258092 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:19.258007 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:20.257984438 +0000 UTC m=+59.147907424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:19.258092 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.258062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:19.258092 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:19.258088 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:20.25806759 +0000 UTC m=+59.147990571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : secret "router-metrics-certs-default" not found Jul 02 21:19:19.258289 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:19.258153 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:19.258289 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:19.258201 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls podName:e3cd3f80-73b8-4293-b59c-43beb4b975fc nodeName:}" failed. No retries permitted until 2026-07-02 21:19:20.258188303 +0000 UTC m=+59.148111275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5zskv" (UID: "e3cd3f80-73b8-4293-b59c-43beb4b975fc") : secret "samples-operator-tls" not found Jul 02 21:19:19.854386 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.854346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" event={"ID":"481a79ac-3ca8-4ae3-aec9-96837247eafd","Type":"ContainerStarted","Data":"d039946d69d36c75a5c7cde0120c8520a67beb89a107cdff79be6940413894f9"} Jul 02 21:19:19.856396 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.856321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" event={"ID":"d482789f-015f-4cbd-ad3d-53b26d2be8e8","Type":"ContainerStarted","Data":"3dcc185b041339f6601880fa52cf5c09df2516943211199d515aca296128ea67"} Jul 02 21:19:19.858199 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.858134 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" event={"ID":"e2d307a8-10e4-49b0-9afc-6aff6d0497e2","Type":"ContainerStarted","Data":"162d893e844c87e26afbc55f563ed70c7b66af994d2f0c336b96a663685f95ca"} Jul 02 21:19:19.859593 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.859567 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" event={"ID":"8f2313b7-516a-4e4e-ba0d-47c39826ff22","Type":"ContainerStarted","Data":"b2a7736e792168917a100c921375eb3c870291e886d4209b0954b405bb2fef76"} Jul 02 21:19:19.861049 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:19.860991 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" event={"ID":"3a72569c-8e3f-4837-bf0c-0806319a9866","Type":"ContainerStarted","Data":"6c12e24255eba737d5aa9d83ee046dfd65e9d1bf4a5c55f596a141ee703601ab"} Jul 02 21:19:20.167049 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:20.166378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:20.167049 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:20.166613 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:20.167049 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:20.166678 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls podName:d6cac955-3771-4c7e-bc77-efc16830d84c nodeName:}" failed. No retries permitted until 2026-07-02 21:19:22.166660333 +0000 UTC m=+61.056583325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-df2pm" (UID: "d6cac955-3771-4c7e-bc77-efc16830d84c") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:20.267024 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:20.266995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:20.267122 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:20.267070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:20.267220 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:20.267186 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:20.267345 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:20.267306 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:20.267408 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:20.267343 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:22.267322395 +0000 UTC m=+61.157245378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:20.267408 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:20.267372 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls podName:e3cd3f80-73b8-4293-b59c-43beb4b975fc nodeName:}" failed. No retries permitted until 2026-07-02 21:19:22.267361188 +0000 UTC m=+61.157284161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5zskv" (UID: "e3cd3f80-73b8-4293-b59c-43beb4b975fc") : secret "samples-operator-tls" not found Jul 02 21:19:20.267408 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:20.267392 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:20.267589 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:20.267456 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:22.267438526 +0000 UTC m=+61.157361498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : secret "router-metrics-certs-default" not found Jul 02 21:19:20.864775 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:20.864737 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" event={"ID":"3a72569c-8e3f-4837-bf0c-0806319a9866","Type":"ContainerStarted","Data":"2f868c04256c1eb416431310be962692ccab96d680ad930af3dcec3c8af8a446"} Jul 02 21:19:20.883462 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:20.883399 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-vl4cc" podStartSLOduration=1.5650435470000001 podStartE2EDuration="2.883383254s" totalImagesPullingTime="1.318339707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:20.882725637 +0000 UTC m=+59.772648629" watchObservedRunningTime="2026-07-02 21:19:20.883383254 +0000 UTC m=+59.773306245" Jul 02 21:19:21.782199 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:21.782172 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pfkb2" Jul 02 21:19:22.184480 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.184443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:22.184845 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:22.184598 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:22.184845 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:22.184664 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls podName:d6cac955-3771-4c7e-bc77-efc16830d84c nodeName:}" failed. No retries permitted until 2026-07-02 21:19:26.184645962 +0000 UTC m=+65.074568931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-df2pm" (UID: "d6cac955-3771-4c7e-bc77-efc16830d84c") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:22.285250 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.285214 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:22.285449 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.285300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:22.285449 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.285339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:22.285449 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:22.285429 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:22.285629 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:22.285458 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:26.285429825 +0000 UTC m=+65.175352811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:22.285629 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:22.285490 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:26.285478591 +0000 UTC m=+65.175401563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : secret "router-metrics-certs-default" not found Jul 02 21:19:22.285629 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:22.285461 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:22.285629 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:22.285540 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls podName:e3cd3f80-73b8-4293-b59c-43beb4b975fc nodeName:}" failed. No retries permitted until 2026-07-02 21:19:26.285523069 +0000 UTC m=+65.175446040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5zskv" (UID: "e3cd3f80-73b8-4293-b59c-43beb4b975fc") : secret "samples-operator-tls" not found Jul 02 21:19:22.876163 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.875191 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" event={"ID":"8f2313b7-516a-4e4e-ba0d-47c39826ff22","Type":"ContainerStarted","Data":"8e434bdc281759d3928ebf9e3d75e0a421f2568f13fc6a08bc7c0813f5684206"} Jul 02 21:19:22.878651 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.878167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" event={"ID":"481a79ac-3ca8-4ae3-aec9-96837247eafd","Type":"ContainerStarted","Data":"d12190e692cef8093dee7cc9f4c151d953476cbbff0ae58654be1c7600b02ba6"} Jul 02 21:19:22.881600 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.881572 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" event={"ID":"d482789f-015f-4cbd-ad3d-53b26d2be8e8","Type":"ContainerStarted","Data":"33aafc83c0b94e86f8993054b2fe5bd5aeb4009a3e6f6d83dcdd7caab31c0894"} Jul 02 21:19:22.883319 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.883297 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" event={"ID":"e2d307a8-10e4-49b0-9afc-6aff6d0497e2","Type":"ContainerStarted","Data":"99bd8e35112acae1790146e8dd340ad06ed319eee7fcfb74a76821d34ee9ea2f"} Jul 02 21:19:22.883804 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.883736 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:22.885132 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.885104 2554 patch_prober.go:28] interesting pod/console-operator-68b757fb67-nmd6f container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jul 02 21:19:22.885233 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.885154 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" Jul 02 21:19:22.893397 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.893350 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" podStartSLOduration=1.222551907 podStartE2EDuration="4.893336399s" totalImagesPullingTime="3.670784492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:22.89238804 +0000 UTC m=+61.782311033" watchObservedRunningTime="2026-07-02 21:19:22.893336399 +0000 UTC m=+61.783259368" Jul 02 21:19:22.909054 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.909003 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podStartSLOduration=1.251527335 podStartE2EDuration="4.908982834s" totalImagesPullingTime="3.657455499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:22.908240775 +0000 UTC m=+61.798163766" watchObservedRunningTime="2026-07-02 21:19:22.908982834 +0000 UTC m=+61.798905826" Jul 02 21:19:22.924325 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.924284 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" podStartSLOduration=1.182862109 podStartE2EDuration="4.924270306s" totalImagesPullingTime="3.741408197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:22.923115352 +0000 UTC m=+61.813038355" watchObservedRunningTime="2026-07-02 21:19:22.924270306 +0000 UTC m=+61.814193276" Jul 02 21:19:22.943348 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:22.942944 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" podStartSLOduration=1.257124086 podStartE2EDuration="4.942925944s" totalImagesPullingTime="3.685801858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:22.941501527 +0000 UTC m=+61.831424519" watchObservedRunningTime="2026-07-02 21:19:22.942925944 +0000 UTC m=+61.832848938" Jul 02 21:19:23.888504 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:23.888473 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/0.log" Jul 02 21:19:23.888950 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:23.888520 2554 generic.go:356] "Generic (PLEG): container finished" podID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" containerID="99bd8e35112acae1790146e8dd340ad06ed319eee7fcfb74a76821d34ee9ea2f" exitCode=255 Jul 02 21:19:23.888950 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:23.888556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" event={"ID":"e2d307a8-10e4-49b0-9afc-6aff6d0497e2","Type":"ContainerDied","Data":"99bd8e35112acae1790146e8dd340ad06ed319eee7fcfb74a76821d34ee9ea2f"} Jul 02 21:19:23.888950 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:23.888825 2554 scope.go:117] "RemoveContainer" containerID="99bd8e35112acae1790146e8dd340ad06ed319eee7fcfb74a76821d34ee9ea2f" Jul 02 21:19:24.033541 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.033512 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nfvss"] Jul 02 21:19:24.036888 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.036865 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.040133 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.039727 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t9dsl\"" Jul 02 21:19:24.040133 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.039987 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 21:19:24.040550 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.040525 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 21:19:24.057559 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.057531 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nfvss"] Jul 02 21:19:24.105353 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.105324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgzcj\" (UniqueName: \"kubernetes.io/projected/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-api-access-cgzcj\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.105496 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.105364 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-crio-socket\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.105562 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.105531 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-data-volume\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.105619 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.105564 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.105658 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.105641 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.115430 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.115399 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd"] Jul 02 21:19:24.118320 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.118306 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" Jul 02 21:19:24.121626 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.121605 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-26hl7\"" Jul 02 21:19:24.121739 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.121655 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 21:19:24.121921 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.121905 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:24.135560 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.135538 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd"] Jul 02 21:19:24.206770 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.206709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-data-volume\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.206770 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.206741 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.206923 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.206792 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmd5j\" (UniqueName: \"kubernetes.io/projected/4268d712-f549-493d-ae05-61419b4280ba-kube-api-access-pmd5j\") pod \"migrator-d57d58cc9-vkljd\" (UID: \"4268d712-f549-493d-ae05-61419b4280ba\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" Jul 02 21:19:24.206923 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.206820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.206923 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.206860 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:24.206923 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.206911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgzcj\" (UniqueName: \"kubernetes.io/projected/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-api-access-cgzcj\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.206923 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.206919 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:24.207130 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.206931 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:24.706910547 +0000 UTC m=+63.596833522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:24.207130 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.206968 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:24.706950614 +0000 UTC m=+63.596873584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : configmap "kube-rbac-proxy" not found Jul 02 21:19:24.207130 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.207001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-crio-socket\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.207130 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.207010 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-data-volume\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.207130 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.207085 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-crio-socket\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.219660 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.219642 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgzcj\" (UniqueName: \"kubernetes.io/projected/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-api-access-cgzcj\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.307589 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.307554 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmd5j\" (UniqueName: \"kubernetes.io/projected/4268d712-f549-493d-ae05-61419b4280ba-kube-api-access-pmd5j\") pod \"migrator-d57d58cc9-vkljd\" (UID: \"4268d712-f549-493d-ae05-61419b4280ba\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" Jul 02 21:19:24.317454 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.317408 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmd5j\" (UniqueName: \"kubernetes.io/projected/4268d712-f549-493d-ae05-61419b4280ba-kube-api-access-pmd5j\") pod \"migrator-d57d58cc9-vkljd\" (UID: \"4268d712-f549-493d-ae05-61419b4280ba\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" Jul 02 21:19:24.427745 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.427716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" Jul 02 21:19:24.556014 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.555880 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd"] Jul 02 21:19:24.558435 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:24.558395 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4268d712_f549_493d_ae05_61419b4280ba.slice/crio-fc183b4b4566b303c62e711033b337e4ed97453c43cfc47e7d420fdc0b508d38 WatchSource:0}: Error finding container fc183b4b4566b303c62e711033b337e4ed97453c43cfc47e7d420fdc0b508d38: Status 404 returned error can't find the container with id fc183b4b4566b303c62e711033b337e4ed97453c43cfc47e7d420fdc0b508d38 Jul 02 21:19:24.559941 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.559921 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq"] Jul 02 21:19:24.564194 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.564179 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" Jul 02 21:19:24.566334 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.566317 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rmjmq\"" Jul 02 21:19:24.578141 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.578109 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq"] Jul 02 21:19:24.610830 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.610808 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thlsb\" (UniqueName: \"kubernetes.io/projected/0e40aa46-9b65-4162-835d-29cd892aec65-kube-api-access-thlsb\") pod \"network-check-source-989f8b8dc-7b4gq\" (UID: \"0e40aa46-9b65-4162-835d-29cd892aec65\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" Jul 02 21:19:24.711366 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.711329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.711570 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.711378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:24.711570 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.711478 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:24.711570 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.711527 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:24.711570 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.711544 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:25.711531727 +0000 UTC m=+64.601454696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : configmap "kube-rbac-proxy" not found Jul 02 21:19:24.711781 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.711584 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:25.711567632 +0000 UTC m=+64.601490602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:24.711781 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.711607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thlsb\" (UniqueName: \"kubernetes.io/projected/0e40aa46-9b65-4162-835d-29cd892aec65-kube-api-access-thlsb\") pod \"network-check-source-989f8b8dc-7b4gq\" (UID: \"0e40aa46-9b65-4162-835d-29cd892aec65\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" Jul 02 21:19:24.719071 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.719049 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:19:24.729916 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.729859 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:19:24.740991 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.740969 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thlsb\" (UniqueName: \"kubernetes.io/projected/0e40aa46-9b65-4162-835d-29cd892aec65-kube-api-access-thlsb\") pod \"network-check-source-989f8b8dc-7b4gq\" (UID: \"0e40aa46-9b65-4162-835d-29cd892aec65\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" Jul 02 21:19:24.872015 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.871981 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" Jul 02 21:19:24.892874 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.892844 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" event={"ID":"4268d712-f549-493d-ae05-61419b4280ba","Type":"ContainerStarted","Data":"fc183b4b4566b303c62e711033b337e4ed97453c43cfc47e7d420fdc0b508d38"} Jul 02 21:19:24.894413 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.894394 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/1.log" Jul 02 21:19:24.894848 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.894829 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/0.log" Jul 02 21:19:24.894934 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.894869 2554 generic.go:356] "Generic (PLEG): container finished" podID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" containerID="abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b" exitCode=255 Jul 02 21:19:24.894934 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.894920 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" event={"ID":"e2d307a8-10e4-49b0-9afc-6aff6d0497e2","Type":"ContainerDied","Data":"abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b"} Jul 02 21:19:24.895051 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.895004 2554 scope.go:117] "RemoveContainer" containerID="99bd8e35112acae1790146e8dd340ad06ed319eee7fcfb74a76821d34ee9ea2f" Jul 02 21:19:24.895166 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:24.895152 2554 scope.go:117] "RemoveContainer" containerID="abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b" Jul 02 21:19:24.895356 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:24.895333 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:19:25.007067 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:25.007000 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq"] Jul 02 21:19:25.009723 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:25.009687 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e40aa46_9b65_4162_835d_29cd892aec65.slice/crio-c73d81343f21f0d886440fe2c0aa596c60e61ca863b6d7ab1bbab4ed0095a6e6 WatchSource:0}: Error finding container c73d81343f21f0d886440fe2c0aa596c60e61ca863b6d7ab1bbab4ed0095a6e6: Status 404 returned error can't find the container with id c73d81343f21f0d886440fe2c0aa596c60e61ca863b6d7ab1bbab4ed0095a6e6 Jul 02 21:19:25.431996 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:25.431967 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gfztc_60156939-3d05-4b01-8292-3718ccd6ccf9/dns-node-resolver/0.log" Jul 02 21:19:25.721050 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:25.720960 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:25.721050 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:25.721038 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:25.721272 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:25.721093 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:25.721272 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:25.721123 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:25.721272 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:25.721168 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.721147755 +0000 UTC m=+66.611070729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:25.721272 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:25.721189 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.721178641 +0000 UTC m=+66.611101609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : configmap "kube-rbac-proxy" not found Jul 02 21:19:25.899936 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:25.899909 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/1.log" Jul 02 21:19:25.900356 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:25.900258 2554 scope.go:117] "RemoveContainer" containerID="abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b" Jul 02 21:19:25.900472 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:25.900446 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:19:25.901350 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:25.901327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" event={"ID":"0e40aa46-9b65-4162-835d-29cd892aec65","Type":"ContainerStarted","Data":"c73d81343f21f0d886440fe2c0aa596c60e61ca863b6d7ab1bbab4ed0095a6e6"} Jul 02 21:19:26.227719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.227694 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:26.227852 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:26.227832 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:26.227917 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:26.227902 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls podName:d6cac955-3771-4c7e-bc77-efc16830d84c nodeName:}" failed. No retries permitted until 2026-07-02 21:19:34.227883651 +0000 UTC m=+73.117806626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-df2pm" (UID: "d6cac955-3771-4c7e-bc77-efc16830d84c") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:26.328450 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.328407 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:26.328591 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.328528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:26.328591 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:26.328578 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:34.328556376 +0000 UTC m=+73.218479352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:26.328715 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.328611 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:26.328715 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:26.328632 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:26.328715 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:26.328683 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:34.328668557 +0000 UTC m=+73.218591542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : secret "router-metrics-certs-default" not found Jul 02 21:19:26.328851 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:26.328737 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:26.328851 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:26.328793 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls podName:e3cd3f80-73b8-4293-b59c-43beb4b975fc nodeName:}" failed. No retries permitted until 2026-07-02 21:19:34.328776344 +0000 UTC m=+73.218699333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5zskv" (UID: "e3cd3f80-73b8-4293-b59c-43beb4b975fc") : secret "samples-operator-tls" not found Jul 02 21:19:26.431955 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.431888 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqgrw_804dd64c-2c91-45a9-9a35-5b7914d881e9/node-ca/0.log" Jul 02 21:19:26.831970 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.831880 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wllr6_a8309612-c115-4433-80fb-25fb0708c372/serve-healthcheck-canary/0.log" Jul 02 21:19:26.907478 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.907443 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" event={"ID":"4268d712-f549-493d-ae05-61419b4280ba","Type":"ContainerStarted","Data":"82f95c0a55a35c55c7a3b666b47bb4ab9f4472a34cee565b43fdfb5810dab65d"} Jul 02 21:19:26.907821 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.907502 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" event={"ID":"4268d712-f549-493d-ae05-61419b4280ba","Type":"ContainerStarted","Data":"41fde1bdd48906906cf5a7812c5bd9f46508e29f06055684f38dbc8279962cd7"} Jul 02 21:19:26.924696 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:26.924652 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vkljd" podStartSLOduration=1.355434741 podStartE2EDuration="2.924637989s" totalImagesPullingTime="1.569203248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:26.92330751 +0000 UTC m=+65.813230500" watchObservedRunningTime="2026-07-02 21:19:26.924637989 +0000 UTC m=+65.814560980" Jul 02 21:19:27.337742 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.337705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:19:27.337940 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.337853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:19:27.340721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.340697 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kwbx\" (UniqueName: \"kubernetes.io/projected/c7d35c0e-96e5-4391-aea6-0a6875785994-kube-api-access-7kwbx\") pod \"network-check-target-87w6b\" (UID: \"c7d35c0e-96e5-4391-aea6-0a6875785994\") " pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:19:27.342638 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.342609 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:19:27.348644 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.348623 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 21:19:27.348772 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.348687 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs podName:46b40c26-be7b-49dc-af65-7067d02f205e nodeName:}" failed. No retries permitted until 2026-07-02 21:20:31.348667 +0000 UTC m=+130.238589969 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs") pod "network-metrics-daemon-p2gmk" (UID: "46b40c26-be7b-49dc-af65-7067d02f205e") : secret "metrics-daemon-secret" not found Jul 02 21:19:27.439182 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.439146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:19:27.441790 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.441770 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:19:27.452354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.452335 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abfce80c-bd3a-4ec8-b24c-a04cafa23131-original-pull-secret\") pod \"global-pull-secret-syncer-gn5q7\" (UID: \"abfce80c-bd3a-4ec8-b24c-a04cafa23131\") " pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:19:27.536134 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.536109 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r4vsj\"" Jul 02 21:19:27.544171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.544143 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:19:27.548044 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.548025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gn5q7" Jul 02 21:19:27.745377 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.742292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:27.745377 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.742366 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:27.745377 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.742668 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:27.745377 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.742750 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:31.742724314 +0000 UTC m=+70.632647298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : configmap "kube-rbac-proxy" not found Jul 02 21:19:27.745377 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.743304 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:27.745377 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.743365 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:31.743348305 +0000 UTC m=+70.633271291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:27.843303 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.843264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:19:27.843507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:27.843356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:19:27.843507 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.843411 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:19:27.843507 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.843453 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675b6ddc8c-cm8tb: secret "image-registry-tls" not found Jul 02 21:19:27.843507 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.843497 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:27.843746 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.843532 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls podName:7af1f35e-a1e5-4d97-989d-ed2e4a09d496 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:59.843510851 +0000 UTC m=+98.733433820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls") pod "image-registry-675b6ddc8c-cm8tb" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496") : secret "image-registry-tls" not found Jul 02 21:19:27.843746 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:27.843548 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls podName:1049fda3-73e0-488b-9235-a9ad8ecd0f35 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:59.84353992 +0000 UTC m=+98.733462891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls") pod "dns-default-v6f7m" (UID: "1049fda3-73e0-488b-9235-a9ad8ecd0f35") : secret "dns-default-metrics-tls" not found Jul 02 21:19:28.097961 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.097929 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gn5q7"] Jul 02 21:19:28.100881 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:28.100855 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfce80c_bd3a_4ec8_b24c_a04cafa23131.slice/crio-ce71d4af5210dd08d2662df4a3795b8b7f5595b9a8b293af97cf8a86410a57e1 WatchSource:0}: Error finding container ce71d4af5210dd08d2662df4a3795b8b7f5595b9a8b293af97cf8a86410a57e1: Status 404 returned error can't find the container with id ce71d4af5210dd08d2662df4a3795b8b7f5595b9a8b293af97cf8a86410a57e1 Jul 02 21:19:28.108373 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.108350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87w6b"] Jul 02 21:19:28.110411 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:28.110389 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d35c0e_96e5_4391_aea6_0a6875785994.slice/crio-28fad6465b2d5908809b5734027986ca18467fe32eda3b8063a019aa12c3648a WatchSource:0}: Error finding container 28fad6465b2d5908809b5734027986ca18467fe32eda3b8063a019aa12c3648a: Status 404 returned error can't find the container with id 28fad6465b2d5908809b5734027986ca18467fe32eda3b8063a019aa12c3648a Jul 02 21:19:28.917015 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.916977 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87w6b" event={"ID":"c7d35c0e-96e5-4391-aea6-0a6875785994","Type":"ContainerStarted","Data":"6e51f16d8e3d01971624b2d5b4febd3e7d73161ae442e29ace9d5683118055a9"} Jul 02 21:19:28.917210 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.917133 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:19:28.917210 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.917170 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87w6b" event={"ID":"c7d35c0e-96e5-4391-aea6-0a6875785994","Type":"ContainerStarted","Data":"28fad6465b2d5908809b5734027986ca18467fe32eda3b8063a019aa12c3648a"} Jul 02 21:19:28.918351 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.918328 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" event={"ID":"0e40aa46-9b65-4162-835d-29cd892aec65","Type":"ContainerStarted","Data":"1b6a99eb31ebad03087aa2bc03409c95c4ba73398044e44885f20985bb91c9a0"} Jul 02 21:19:28.919507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.919483 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gn5q7" event={"ID":"abfce80c-bd3a-4ec8-b24c-a04cafa23131","Type":"ContainerStarted","Data":"ce71d4af5210dd08d2662df4a3795b8b7f5595b9a8b293af97cf8a86410a57e1"} Jul 02 21:19:28.929207 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.929188 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:28.929728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.929710 2554 scope.go:117] "RemoveContainer" containerID="abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b" Jul 02 21:19:28.929927 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:28.929908 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:19:28.940133 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.940086 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-87w6b" podStartSLOduration=67.940071216 podStartE2EDuration="1m7.940071216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:28.938489617 +0000 UTC m=+67.828412609" watchObservedRunningTime="2026-07-02 21:19:28.940071216 +0000 UTC m=+67.829994209" Jul 02 21:19:28.956467 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:28.956413 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7b4gq" podStartSLOduration=1.997454971 podStartE2EDuration="4.956400365s" totalImagesPullingTime="2.958945394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:28.955494948 +0000 UTC m=+67.845417941" watchObservedRunningTime="2026-07-02 21:19:28.956400365 +0000 UTC m=+67.846323378" Jul 02 21:19:31.777820 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:31.777783 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:31.778268 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:31.777837 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:31.778268 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:31.777966 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:31.778268 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:31.777974 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:31.778268 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:31.778024 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:39.778009042 +0000 UTC m=+78.667932011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : configmap "kube-rbac-proxy" not found Jul 02 21:19:31.778268 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:31.778037 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:39.77803088 +0000 UTC m=+78.667953849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:32.884669 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:32.884636 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:32.885051 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:32.885014 2554 scope.go:117] "RemoveContainer" containerID="abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b" Jul 02 21:19:32.885167 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:32.885147 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:19:32.933060 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:32.933030 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gn5q7" event={"ID":"abfce80c-bd3a-4ec8-b24c-a04cafa23131","Type":"ContainerStarted","Data":"05fc003f79f5f47a5c3a29e13ddd456a17140e8518d644c64616737608aa3360"} Jul 02 21:19:32.959691 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:32.959647 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gn5q7" podStartSLOduration=67.115934015 podStartE2EDuration="1m10.959632975s" totalImagesPullingTime="3.84369896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:32.958661086 +0000 UTC m=+71.848584078" watchObservedRunningTime="2026-07-02 21:19:32.959632975 +0000 UTC m=+71.849555965" Jul 02 21:19:34.299894 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.299852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:34.300293 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:34.300001 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:34.300293 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:34.300066 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls podName:d6cac955-3771-4c7e-bc77-efc16830d84c nodeName:}" failed. No retries permitted until 2026-07-02 21:19:50.30005175 +0000 UTC m=+89.189974719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-df2pm" (UID: "d6cac955-3771-4c7e-bc77-efc16830d84c") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:34.401230 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.401189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:34.401450 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.401290 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:34.401450 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.401332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:34.401450 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:34.401355 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:50.401337851 +0000 UTC m=+89.291260820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:34.401638 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:34.401454 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:34.401638 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:34.401515 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs podName:4e89b856-d514-4d3c-9598-a717ee9980d2 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:50.401498486 +0000 UTC m=+89.291421458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs") pod "router-default-bf9b5bf9-wx657" (UID: "4e89b856-d514-4d3c-9598-a717ee9980d2") : secret "router-metrics-certs-default" not found Jul 02 21:19:34.403728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.403705 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3cd3f80-73b8-4293-b59c-43beb4b975fc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5zskv\" (UID: \"e3cd3f80-73b8-4293-b59c-43beb4b975fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:34.456897 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.456869 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qnpzp\"" Jul 02 21:19:34.465052 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.465031 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" Jul 02 21:19:34.606783 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.606756 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv"] Jul 02 21:19:34.940610 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:34.940578 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" event={"ID":"e3cd3f80-73b8-4293-b59c-43beb4b975fc","Type":"ContainerStarted","Data":"d177531043301e7eb3ce9ff7bf0472466fa2d1e086706717e801bcfe13849869"} Jul 02 21:19:36.949663 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:36.949627 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" event={"ID":"e3cd3f80-73b8-4293-b59c-43beb4b975fc","Type":"ContainerStarted","Data":"01fe773be78410620a8fda6bf07b7302ed6123154f4918bd36ef70347605da2f"} Jul 02 21:19:36.950033 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:36.949714 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" event={"ID":"e3cd3f80-73b8-4293-b59c-43beb4b975fc","Type":"ContainerStarted","Data":"458c6dd982f5f37c02ea5e7d322223bb2b1bc1e81155661f81dcc3db26620825"} Jul 02 21:19:36.967253 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:36.967207 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5zskv" podStartSLOduration=17.43461228 podStartE2EDuration="18.967192437s" totalImagesPullingTime="1.532580157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:36.966059961 +0000 UTC m=+75.855982952" watchObservedRunningTime="2026-07-02 21:19:36.967192437 +0000 UTC m=+75.857115427" Jul 02 21:19:39.844743 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:39.844709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:39.845131 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:39.844759 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:39.845131 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:39.844847 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:39.845131 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:39.844908 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls podName:b88d1857-f7b5-4e0f-95b6-c450af8df5ee nodeName:}" failed. No retries permitted until 2026-07-02 21:19:55.844891895 +0000 UTC m=+94.734814865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfvss" (UID: "b88d1857-f7b5-4e0f-95b6-c450af8df5ee") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:39.845252 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:39.845234 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:47.621847 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:47.621723 2554 scope.go:117] "RemoveContainer" containerID="abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b" Jul 02 21:19:47.983818 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:47.983744 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:19:47.984140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:47.984126 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/1.log" Jul 02 21:19:47.984200 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:47.984158 2554 generic.go:356] "Generic (PLEG): container finished" podID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" containerID="83c3e7866628805834f35233fb21926a490cf05f6a9c318a35b4563fe16392c8" exitCode=255 Jul 02 21:19:47.984200 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:47.984195 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" event={"ID":"e2d307a8-10e4-49b0-9afc-6aff6d0497e2","Type":"ContainerDied","Data":"83c3e7866628805834f35233fb21926a490cf05f6a9c318a35b4563fe16392c8"} Jul 02 21:19:47.984264 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:47.984234 2554 scope.go:117] "RemoveContainer" containerID="abf480ab9ce3e5988655c8a6504e254781f434a1efd84985f92fd0fccbbfee1b" Jul 02 21:19:47.984630 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:47.984613 2554 scope.go:117] "RemoveContainer" containerID="83c3e7866628805834f35233fb21926a490cf05f6a9c318a35b4563fe16392c8" Jul 02 21:19:47.984804 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:47.984786 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:19:48.928902 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:48.928869 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:48.988089 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:48.988065 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:19:48.988398 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:48.988383 2554 scope.go:117] "RemoveContainer" containerID="83c3e7866628805834f35233fb21926a490cf05f6a9c318a35b4563fe16392c8" Jul 02 21:19:48.988568 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:48.988549 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:19:50.328512 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.328477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:50.330785 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.330764 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cac955-3771-4c7e-bc77-efc16830d84c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-df2pm\" (UID: \"d6cac955-3771-4c7e-bc77-efc16830d84c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:50.429048 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.429023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:50.429189 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.429079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:50.429660 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.429636 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e89b856-d514-4d3c-9598-a717ee9980d2-service-ca-bundle\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:50.431275 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.431258 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e89b856-d514-4d3c-9598-a717ee9980d2-metrics-certs\") pod \"router-default-bf9b5bf9-wx657\" (UID: \"4e89b856-d514-4d3c-9598-a717ee9980d2\") " pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:50.572750 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.572723 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lbnnk\"" Jul 02 21:19:50.579981 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.579936 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" Jul 02 21:19:50.709579 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.709553 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-flwgx\"" Jul 02 21:19:50.712396 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.712350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm"] Jul 02 21:19:50.714637 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.714617 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:50.715045 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:50.715021 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cac955_3771_4c7e_bc77_efc16830d84c.slice/crio-4a8e4f4865b3dc01d358419dbc929f60316e23aa5ef633e256ad31079cf5ee28 WatchSource:0}: Error finding container 4a8e4f4865b3dc01d358419dbc929f60316e23aa5ef633e256ad31079cf5ee28: Status 404 returned error can't find the container with id 4a8e4f4865b3dc01d358419dbc929f60316e23aa5ef633e256ad31079cf5ee28 Jul 02 21:19:50.845870 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.845800 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bf9b5bf9-wx657"] Jul 02 21:19:50.848832 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:50.848804 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e89b856_d514_4d3c_9598_a717ee9980d2.slice/crio-ca571960e1c3bf716be6303e9e8be6ea4417c47bb58a7fd0237014338bba516b WatchSource:0}: Error finding container ca571960e1c3bf716be6303e9e8be6ea4417c47bb58a7fd0237014338bba516b: Status 404 returned error can't find the container with id ca571960e1c3bf716be6303e9e8be6ea4417c47bb58a7fd0237014338bba516b Jul 02 21:19:50.995822 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.995793 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" event={"ID":"d6cac955-3771-4c7e-bc77-efc16830d84c","Type":"ContainerStarted","Data":"4a8e4f4865b3dc01d358419dbc929f60316e23aa5ef633e256ad31079cf5ee28"} Jul 02 21:19:50.997222 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.997195 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bf9b5bf9-wx657" event={"ID":"4e89b856-d514-4d3c-9598-a717ee9980d2","Type":"ContainerStarted","Data":"c64913ec7410d30094461d59d557978410876cd39bfaac383183309a545adde6"} Jul 02 21:19:50.997347 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:50.997252 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bf9b5bf9-wx657" event={"ID":"4e89b856-d514-4d3c-9598-a717ee9980d2","Type":"ContainerStarted","Data":"ca571960e1c3bf716be6303e9e8be6ea4417c47bb58a7fd0237014338bba516b"} Jul 02 21:19:51.015780 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:51.015726 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bf9b5bf9-wx657" podStartSLOduration=33.015710225 podStartE2EDuration="33.015710225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:51.015054098 +0000 UTC m=+89.904977090" watchObservedRunningTime="2026-07-02 21:19:51.015710225 +0000 UTC m=+89.905633216" Jul 02 21:19:51.715738 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:51.715700 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:51.718498 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:51.718476 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:52.000852 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:52.000777 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:52.002148 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:52.002127 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bf9b5bf9-wx657" Jul 02 21:19:52.884518 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:52.884493 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:19:52.884866 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:52.884821 2554 scope.go:117] "RemoveContainer" containerID="83c3e7866628805834f35233fb21926a490cf05f6a9c318a35b4563fe16392c8" Jul 02 21:19:52.884982 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:19:52.884963 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:19:53.005644 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:53.005608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" event={"ID":"d6cac955-3771-4c7e-bc77-efc16830d84c","Type":"ContainerStarted","Data":"7b6b4d1e7893c013006a3029d4a0010721e2ea6787571d74b1c1ac5048de8731"} Jul 02 21:19:55.865351 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:55.865313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:55.867674 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:55.867649 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b88d1857-f7b5-4e0f-95b6-c450af8df5ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfvss\" (UID: \"b88d1857-f7b5-4e0f-95b6-c450af8df5ee\") " pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:55.871594 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:55.871572 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nfvss" Jul 02 21:19:56.002836 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:56.002786 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-df2pm" podStartSLOduration=36.350872976 podStartE2EDuration="38.002769784s" totalImagesPullingTime="1.651896808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:53.046103924 +0000 UTC m=+91.936026915" watchObservedRunningTime="2026-07-02 21:19:56.002769784 +0000 UTC m=+94.892692775" Jul 02 21:19:56.003761 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:56.003736 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nfvss"] Jul 02 21:19:56.006578 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:19:56.006551 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88d1857_f7b5_4e0f_95b6_c450af8df5ee.slice/crio-f37f040482d1ab601489026f99853a56bf6565566fb0295157303de47984ed65 WatchSource:0}: Error finding container f37f040482d1ab601489026f99853a56bf6565566fb0295157303de47984ed65: Status 404 returned error can't find the container with id f37f040482d1ab601489026f99853a56bf6565566fb0295157303de47984ed65 Jul 02 21:19:56.017030 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:56.017003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfvss" event={"ID":"b88d1857-f7b5-4e0f-95b6-c450af8df5ee","Type":"ContainerStarted","Data":"f37f040482d1ab601489026f99853a56bf6565566fb0295157303de47984ed65"} Jul 02 21:19:59.897208 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:59.897171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:19:59.897798 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:59.897247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:19:59.899886 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:59.899853 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1049fda3-73e0-488b-9235-a9ad8ecd0f35-metrics-tls\") pod \"dns-default-v6f7m\" (UID: \"1049fda3-73e0-488b-9235-a9ad8ecd0f35\") " pod="openshift-dns/dns-default-v6f7m" Jul 02 21:19:59.900009 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:59.899953 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"image-registry-675b6ddc8c-cm8tb\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:19:59.925131 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:19:59.925101 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-87w6b" Jul 02 21:20:00.152228 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:00.152155 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p4wrm\"" Jul 02 21:20:00.160231 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:00.160184 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:20:00.162321 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:00.162303 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-69xqz\"" Jul 02 21:20:00.171004 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:00.170986 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6f7m" Jul 02 21:20:00.493143 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:00.493036 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-675b6ddc8c-cm8tb"] Jul 02 21:20:00.495753 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:20:00.495725 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af1f35e_a1e5_4d97_989d_ed2e4a09d496.slice/crio-ed08b521c2c099f4caeace90874de4662ca83ee82050a7626af87e1843ad359a WatchSource:0}: Error finding container ed08b521c2c099f4caeace90874de4662ca83ee82050a7626af87e1843ad359a: Status 404 returned error can't find the container with id ed08b521c2c099f4caeace90874de4662ca83ee82050a7626af87e1843ad359a Jul 02 21:20:00.519927 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:00.519907 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v6f7m"] Jul 02 21:20:00.522724 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:20:00.522698 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1049fda3_73e0_488b_9235_a9ad8ecd0f35.slice/crio-5248f88a9072b03bbeccf714434aa81b0cc3cd0103dd89012e4935ba300c026b WatchSource:0}: Error finding container 5248f88a9072b03bbeccf714434aa81b0cc3cd0103dd89012e4935ba300c026b: Status 404 returned error can't find the container with id 5248f88a9072b03bbeccf714434aa81b0cc3cd0103dd89012e4935ba300c026b Jul 02 21:20:01.041793 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:01.041716 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfvss" event={"ID":"b88d1857-f7b5-4e0f-95b6-c450af8df5ee","Type":"ContainerStarted","Data":"1d0505b4ea6f5dcb8d1fc620f37ffd70fec82d1e14590d4f331a4aa7f0c53da3"} Jul 02 21:20:01.043547 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:01.043518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" event={"ID":"7af1f35e-a1e5-4d97-989d-ed2e4a09d496","Type":"ContainerStarted","Data":"96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a"} Jul 02 21:20:01.043680 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:01.043569 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" event={"ID":"7af1f35e-a1e5-4d97-989d-ed2e4a09d496","Type":"ContainerStarted","Data":"ed08b521c2c099f4caeace90874de4662ca83ee82050a7626af87e1843ad359a"} Jul 02 21:20:01.043680 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:01.043633 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:20:01.044962 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:01.044934 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6f7m" event={"ID":"1049fda3-73e0-488b-9235-a9ad8ecd0f35","Type":"ContainerStarted","Data":"5248f88a9072b03bbeccf714434aa81b0cc3cd0103dd89012e4935ba300c026b"} Jul 02 21:20:01.070430 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:01.070355 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" podStartSLOduration=99.070336014 podStartE2EDuration="1m39.070336014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:01.070196521 +0000 UTC m=+99.960119519" watchObservedRunningTime="2026-07-02 21:20:01.070336014 +0000 UTC m=+99.960259006" Jul 02 21:20:02.050057 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:02.050019 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfvss" event={"ID":"b88d1857-f7b5-4e0f-95b6-c450af8df5ee","Type":"ContainerStarted","Data":"0680f6ea7cbd756cdee3ba292f98d5fa72ddf19a57825320091135c2d590d3e4"} Jul 02 21:20:03.056194 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:03.056105 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6f7m" event={"ID":"1049fda3-73e0-488b-9235-a9ad8ecd0f35","Type":"ContainerStarted","Data":"e04e9e1377407842818451433af736d873ab3ed45720918f6b43c473f0da9a3c"} Jul 02 21:20:03.056194 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:03.056200 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6f7m" event={"ID":"1049fda3-73e0-488b-9235-a9ad8ecd0f35","Type":"ContainerStarted","Data":"cf6d464170a4e758c2a657cd773c194ef43afb8ba5e72335c872e009895ba6d1"} Jul 02 21:20:03.056707 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:03.056254 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v6f7m" Jul 02 21:20:03.138625 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:03.138559 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v6f7m" podStartSLOduration=66.242220642 podStartE2EDuration="1m8.13853748s" totalImagesPullingTime="1.896316838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:03.13692261 +0000 UTC m=+102.026845602" watchObservedRunningTime="2026-07-02 21:20:03.13853748 +0000 UTC m=+102.028460473" Jul 02 21:20:04.136870 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.136838 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2c2ww"] Jul 02 21:20:04.145681 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.145644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.149759 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.149730 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 21:20:04.149865 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.149743 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 21:20:04.149865 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.149800 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 21:20:04.149865 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.149761 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jmtvw\"" Jul 02 21:20:04.149865 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.149763 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 21:20:04.233059 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-tls\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233059 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233282 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69b9ba0b-9074-495f-9437-af0d3760114a-metrics-client-ca\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233282 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233208 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfp6g\" (UniqueName: \"kubernetes.io/projected/69b9ba0b-9074-495f-9437-af0d3760114a-kube-api-access-bfp6g\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233282 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233236 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-root\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233282 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233281 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-wtmp\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233523 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233523 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233354 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-sys\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.233523 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.233394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-textfile\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.333921 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.333873 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69b9ba0b-9074-495f-9437-af0d3760114a-metrics-client-ca\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.333942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp6g\" (UniqueName: \"kubernetes.io/projected/69b9ba0b-9074-495f-9437-af0d3760114a-kube-api-access-bfp6g\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.333975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-root\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-wtmp\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-sys\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-textfile\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334471 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-tls\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334471 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334577 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334552 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69b9ba0b-9074-495f-9437-af0d3760114a-metrics-client-ca\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334976 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334651 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-root\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334976 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334717 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-sys\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334976 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334762 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-wtmp\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334976 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334778 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.334976 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.334913 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-textfile\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.337154 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.337133 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.337854 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.337831 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69b9ba0b-9074-495f-9437-af0d3760114a-node-exporter-tls\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.344466 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.344437 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfp6g\" (UniqueName: \"kubernetes.io/projected/69b9ba0b-9074-495f-9437-af0d3760114a-kube-api-access-bfp6g\") pod \"node-exporter-2c2ww\" (UID: \"69b9ba0b-9074-495f-9437-af0d3760114a\") " pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.456475 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.456449 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2c2ww" Jul 02 21:20:04.467120 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:20:04.467061 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b9ba0b_9074_495f_9437_af0d3760114a.slice/crio-c4678f61cea21e5315fca814eab283183e418e6e7b348498810ed8c4d19c569c WatchSource:0}: Error finding container c4678f61cea21e5315fca814eab283183e418e6e7b348498810ed8c4d19c569c: Status 404 returned error can't find the container with id c4678f61cea21e5315fca814eab283183e418e6e7b348498810ed8c4d19c569c Jul 02 21:20:04.621898 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:04.621867 2554 scope.go:117] "RemoveContainer" containerID="83c3e7866628805834f35233fb21926a490cf05f6a9c318a35b4563fe16392c8" Jul 02 21:20:04.622087 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:20:04.622065 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-nmd6f_openshift-console-operator(e2d307a8-10e4-49b0-9afc-6aff6d0497e2)\"" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" podUID="e2d307a8-10e4-49b0-9afc-6aff6d0497e2" Jul 02 21:20:05.066901 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:05.066856 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfvss" event={"ID":"b88d1857-f7b5-4e0f-95b6-c450af8df5ee","Type":"ContainerStarted","Data":"97006f22cfc5f70fe17d7787b98770f711545c4c8b13d3e3051cbaa3261878a0"} Jul 02 21:20:05.068176 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:05.068147 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2ww" event={"ID":"69b9ba0b-9074-495f-9437-af0d3760114a","Type":"ContainerStarted","Data":"c4678f61cea21e5315fca814eab283183e418e6e7b348498810ed8c4d19c569c"} Jul 02 21:20:05.087743 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:05.087686 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nfvss" podStartSLOduration=32.925141816 podStartE2EDuration="41.087666843s" totalImagesPullingTime="8.162525027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:05.086614771 +0000 UTC m=+103.976537763" watchObservedRunningTime="2026-07-02 21:20:05.087666843 +0000 UTC m=+103.977589835" Jul 02 21:20:06.073326 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:06.073290 2554 generic.go:356] "Generic (PLEG): container finished" podID="69b9ba0b-9074-495f-9437-af0d3760114a" containerID="4b917dcaf0cfffe61c787cc6a05511840fee86dda1bcf9e72bfa934c0a4d30da" exitCode=0 Jul 02 21:20:06.073782 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:06.073368 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2ww" event={"ID":"69b9ba0b-9074-495f-9437-af0d3760114a","Type":"ContainerDied","Data":"4b917dcaf0cfffe61c787cc6a05511840fee86dda1bcf9e72bfa934c0a4d30da"} Jul 02 21:20:07.079539 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:07.079503 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2ww" event={"ID":"69b9ba0b-9074-495f-9437-af0d3760114a","Type":"ContainerStarted","Data":"cc6e5861f585d05aabbf3e63954b03e51c24e7264022d6d39b63a2d1a576e3fd"} Jul 02 21:20:07.079899 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:07.079554 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c2ww" event={"ID":"69b9ba0b-9074-495f-9437-af0d3760114a","Type":"ContainerStarted","Data":"7c52c31824dd86650465192042f51bc14e345ccf5d607cf0575aec5d110b5dbd"} Jul 02 21:20:07.100743 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:07.100696 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2c2ww" podStartSLOduration=2.125669942 podStartE2EDuration="3.100682511s" totalImagesPullingTime="906.046738ms" totalInitContainerRuntime="68.965831ms" isStatefulPod=true podCreationTimestamp="2026-07-02 21:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:07.099033826 +0000 UTC m=+105.988956818" watchObservedRunningTime="2026-07-02 21:20:07.100682511 +0000 UTC m=+105.990605502" Jul 02 21:20:09.181493 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:09.181458 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-675b6ddc8c-cm8tb"] Jul 02 21:20:13.062384 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:13.062354 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v6f7m" Jul 02 21:20:17.621877 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:17.621847 2554 scope.go:117] "RemoveContainer" containerID="83c3e7866628805834f35233fb21926a490cf05f6a9c318a35b4563fe16392c8" Jul 02 21:20:18.123080 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:18.123057 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:20:18.123243 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:18.123134 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" event={"ID":"e2d307a8-10e4-49b0-9afc-6aff6d0497e2","Type":"ContainerStarted","Data":"25b937b2a73ee3f0ca8bd337a85d7b853cb798e8eb232e5daacc83aab9ef0384"} Jul 02 21:20:18.123454 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:18.123403 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:20:18.632849 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:18.632820 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-nmd6f" Jul 02 21:20:19.187069 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:19.187042 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:20:29.160447 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:29.160402 2554 generic.go:356] "Generic (PLEG): container finished" podID="d482789f-015f-4cbd-ad3d-53b26d2be8e8" containerID="33aafc83c0b94e86f8993054b2fe5bd5aeb4009a3e6f6d83dcdd7caab31c0894" exitCode=0 Jul 02 21:20:29.160855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:29.160478 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" event={"ID":"d482789f-015f-4cbd-ad3d-53b26d2be8e8","Type":"ContainerDied","Data":"33aafc83c0b94e86f8993054b2fe5bd5aeb4009a3e6f6d83dcdd7caab31c0894"} Jul 02 21:20:29.160855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:29.160787 2554 scope.go:117] "RemoveContainer" containerID="33aafc83c0b94e86f8993054b2fe5bd5aeb4009a3e6f6d83dcdd7caab31c0894" Jul 02 21:20:30.166790 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:30.166752 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6m275" event={"ID":"d482789f-015f-4cbd-ad3d-53b26d2be8e8","Type":"ContainerStarted","Data":"9474c7829ba4a0de8b16dff2546f3dec08aeae855c1aa0f2c11bdba8c11f3681"} Jul 02 21:20:31.445964 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:31.445930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:20:31.448200 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:31.448173 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46b40c26-be7b-49dc-af65-7067d02f205e-metrics-certs\") pod \"network-metrics-daemon-p2gmk\" (UID: \"46b40c26-be7b-49dc-af65-7067d02f205e\") " pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:20:31.744344 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:31.744269 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lxff2\"" Jul 02 21:20:31.752311 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:31.752288 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2gmk" Jul 02 21:20:32.050195 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:32.050173 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p2gmk"] Jul 02 21:20:32.052799 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:20:32.052769 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b40c26_be7b_49dc_af65_7067d02f205e.slice/crio-872de0e20cdb85837b37bd6af5d1e062c4c3b98ed56a9bf43458b660160008f9 WatchSource:0}: Error finding container 872de0e20cdb85837b37bd6af5d1e062c4c3b98ed56a9bf43458b660160008f9: Status 404 returned error can't find the container with id 872de0e20cdb85837b37bd6af5d1e062c4c3b98ed56a9bf43458b660160008f9 Jul 02 21:20:32.175073 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:32.175043 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2gmk" event={"ID":"46b40c26-be7b-49dc-af65-7067d02f205e","Type":"ContainerStarted","Data":"872de0e20cdb85837b37bd6af5d1e062c4c3b98ed56a9bf43458b660160008f9"} Jul 02 21:20:34.183057 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.183027 2554 generic.go:356] "Generic (PLEG): container finished" podID="481a79ac-3ca8-4ae3-aec9-96837247eafd" containerID="d12190e692cef8093dee7cc9f4c151d953476cbbff0ae58654be1c7600b02ba6" exitCode=0 Jul 02 21:20:34.183571 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.183109 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" event={"ID":"481a79ac-3ca8-4ae3-aec9-96837247eafd","Type":"ContainerDied","Data":"d12190e692cef8093dee7cc9f4c151d953476cbbff0ae58654be1c7600b02ba6"} Jul 02 21:20:34.183571 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.183506 2554 scope.go:117] "RemoveContainer" containerID="d12190e692cef8093dee7cc9f4c151d953476cbbff0ae58654be1c7600b02ba6" Jul 02 21:20:34.185067 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.185047 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2gmk" event={"ID":"46b40c26-be7b-49dc-af65-7067d02f205e","Type":"ContainerStarted","Data":"7f5a7f83c3a716c0502c15b2949469b9e81b964ba2898eaf2944904d43b2fedb"} Jul 02 21:20:34.185158 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.185085 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2gmk" event={"ID":"46b40c26-be7b-49dc-af65-7067d02f205e","Type":"ContainerStarted","Data":"34fb53813d4aed1b5ad66c282901f1810a6d2806b7115ab4f6503b4caee176bb"} Jul 02 21:20:34.200868 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.200841 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" podUID="7af1f35e-a1e5-4d97-989d-ed2e4a09d496" containerName="registry" containerID="cri-o://96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a" gracePeriod=30 Jul 02 21:20:34.234531 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.234400 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p2gmk" podStartSLOduration=131.715327834 podStartE2EDuration="2m13.234380283s" totalImagesPullingTime="1.519052449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:34.233807197 +0000 UTC m=+133.123730190" watchObservedRunningTime="2026-07-02 21:20:34.234380283 +0000 UTC m=+133.124303277" Jul 02 21:20:34.483323 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.483286 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:20:34.569675 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569644 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-installation-pull-secrets\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.569843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569686 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-trusted-ca\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.569843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569715 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-bound-sa-token\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.569843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569735 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.569843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569773 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-ca-trust-extracted\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.569843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569789 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-certificates\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.569843 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569819 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkjdj\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-kube-api-access-rkjdj\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.570166 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.569850 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-image-registry-private-configuration\") pod \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\" (UID: \"7af1f35e-a1e5-4d97-989d-ed2e4a09d496\") " Jul 02 21:20:34.570166 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.570142 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:20:34.570166 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.570154 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:20:34.572332 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.572282 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:20:34.572486 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.572443 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:20:34.572576 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.572523 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:20:34.572576 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.572561 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-kube-api-access-rkjdj" (OuterVolumeSpecName: "kube-api-access-rkjdj") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "kube-api-access-rkjdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:20:34.572656 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.572599 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:20:34.580963 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.580938 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7af1f35e-a1e5-4d97-989d-ed2e4a09d496" (UID: "7af1f35e-a1e5-4d97-989d-ed2e4a09d496"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:20:34.670914 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670891 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-trusted-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:34.670914 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670911 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-bound-sa-token\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:34.671023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670920 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:34.671023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670928 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-ca-trust-extracted\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:34.671023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670936 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-registry-certificates\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:34.671023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670944 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkjdj\" (UniqueName: \"kubernetes.io/projected/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-kube-api-access-rkjdj\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:34.671023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670953 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-image-registry-private-configuration\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:34.671023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:34.670962 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7af1f35e-a1e5-4d97-989d-ed2e4a09d496-installation-pull-secrets\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:20:35.190513 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.190479 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-w4x6d" event={"ID":"481a79ac-3ca8-4ae3-aec9-96837247eafd","Type":"ContainerStarted","Data":"ac7f83ea528c6bb0eb3711922fe57617db5454d4744a42ab9ca0413789c72b82"} Jul 02 21:20:35.191628 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.191604 2554 generic.go:356] "Generic (PLEG): container finished" podID="7af1f35e-a1e5-4d97-989d-ed2e4a09d496" containerID="96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a" exitCode=0 Jul 02 21:20:35.191728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.191652 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" event={"ID":"7af1f35e-a1e5-4d97-989d-ed2e4a09d496","Type":"ContainerDied","Data":"96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a"} Jul 02 21:20:35.191728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.191681 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" Jul 02 21:20:35.191728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.191692 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675b6ddc8c-cm8tb" event={"ID":"7af1f35e-a1e5-4d97-989d-ed2e4a09d496","Type":"ContainerDied","Data":"ed08b521c2c099f4caeace90874de4662ca83ee82050a7626af87e1843ad359a"} Jul 02 21:20:35.191728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.191713 2554 scope.go:117] "RemoveContainer" containerID="96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a" Jul 02 21:20:35.199898 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.199874 2554 scope.go:117] "RemoveContainer" containerID="96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a" Jul 02 21:20:35.200199 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:20:35.200168 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a\": container with ID starting with 96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a not found: ID does not exist" containerID="96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a" Jul 02 21:20:35.200287 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.200207 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a"} err="failed to get container status \"96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a\": rpc error: code = NotFound desc = could not find container \"96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a\": container with ID starting with 96436a826f885d3af5c78ebd760802c54690383c1508be669fc5016db220625a not found: ID does not exist" Jul 02 21:20:35.243621 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.243589 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-675b6ddc8c-cm8tb"] Jul 02 21:20:35.251392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.251365 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-675b6ddc8c-cm8tb"] Jul 02 21:20:35.626309 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:35.626280 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7af1f35e-a1e5-4d97-989d-ed2e4a09d496" path="/var/lib/kubelet/pods/7af1f35e-a1e5-4d97-989d-ed2e4a09d496/volumes" Jul 02 21:20:36.270736 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:36.270708 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-df2pm_d6cac955-3771-4c7e-bc77-efc16830d84c/cluster-monitoring-operator/0.log" Jul 02 21:20:37.455866 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:37.455836 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2ww_69b9ba0b-9074-495f-9437-af0d3760114a/init-textfile/0.log" Jul 02 21:20:37.658721 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:37.658691 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2ww_69b9ba0b-9074-495f-9437-af0d3760114a/node-exporter/0.log" Jul 02 21:20:37.860318 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:37.860290 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2ww_69b9ba0b-9074-495f-9437-af0d3760114a/kube-rbac-proxy/0.log" Jul 02 21:20:43.879410 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:43.879370 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:20:44.060264 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:44.060237 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/3.log" Jul 02 21:20:49.243243 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:49.243206 2554 generic.go:356] "Generic (PLEG): container finished" podID="8f2313b7-516a-4e4e-ba0d-47c39826ff22" containerID="8e434bdc281759d3928ebf9e3d75e0a421f2568f13fc6a08bc7c0813f5684206" exitCode=0 Jul 02 21:20:49.243815 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:49.243284 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" event={"ID":"8f2313b7-516a-4e4e-ba0d-47c39826ff22","Type":"ContainerDied","Data":"8e434bdc281759d3928ebf9e3d75e0a421f2568f13fc6a08bc7c0813f5684206"} Jul 02 21:20:49.243815 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:49.243740 2554 scope.go:117] "RemoveContainer" containerID="8e434bdc281759d3928ebf9e3d75e0a421f2568f13fc6a08bc7c0813f5684206" Jul 02 21:20:50.248680 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:20:50.248650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ggmhq" event={"ID":"8f2313b7-516a-4e4e-ba0d-47c39826ff22","Type":"ContainerStarted","Data":"4442442081b8c133d23940356f4a854fe06d575eade9ff081dd854da2eef9f74"} Jul 02 21:22:18.257848 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.257818 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg"] Jul 02 21:22:18.258276 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.258114 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7af1f35e-a1e5-4d97-989d-ed2e4a09d496" containerName="registry" Jul 02 21:22:18.258276 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.258127 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7af1f35e-a1e5-4d97-989d-ed2e4a09d496" containerName="registry" Jul 02 21:22:18.258276 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.258176 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7af1f35e-a1e5-4d97-989d-ed2e4a09d496" containerName="registry" Jul 02 21:22:18.260972 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.260953 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.263198 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.263160 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 21:22:18.263322 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.263212 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 21:22:18.263376 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.263320 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 21:22:18.264179 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.264164 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 21:22:18.269937 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.269918 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg"] Jul 02 21:22:18.287691 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.287667 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k"] Jul 02 21:22:18.291709 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.291689 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.294478 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.294451 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 21:22:18.294765 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.294747 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 21:22:18.294926 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.294896 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 21:22:18.295076 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.295059 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 21:22:18.302394 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.302374 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k"] Jul 02 21:22:18.423189 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac38b761-27dc-424f-96dc-e017a6ca1d7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.423189 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-hub\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.423404 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423211 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8p8\" (UniqueName: \"kubernetes.io/projected/38537cc0-28d6-41cc-b12b-9a385ef150ff-kube-api-access-wn8p8\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.423404 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423261 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38537cc0-28d6-41cc-b12b-9a385ef150ff-tmp\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.423404 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423299 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-ca\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.423404 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.423404 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423374 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.423404 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38537cc0-28d6-41cc-b12b-9a385ef150ff-klusterlet-config\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.423619 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.423461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmlsc\" (UniqueName: \"kubernetes.io/projected/ac38b761-27dc-424f-96dc-e017a6ca1d7f-kube-api-access-lmlsc\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.524858 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524759 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac38b761-27dc-424f-96dc-e017a6ca1d7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.524858 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-hub\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.524858 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524824 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8p8\" (UniqueName: \"kubernetes.io/projected/38537cc0-28d6-41cc-b12b-9a385ef150ff-kube-api-access-wn8p8\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.524858 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38537cc0-28d6-41cc-b12b-9a385ef150ff-tmp\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.525188 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-ca\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.525188 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.525188 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.525188 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524947 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38537cc0-28d6-41cc-b12b-9a385ef150ff-klusterlet-config\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.525188 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.524987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmlsc\" (UniqueName: \"kubernetes.io/projected/ac38b761-27dc-424f-96dc-e017a6ca1d7f-kube-api-access-lmlsc\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.525462 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.525285 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38537cc0-28d6-41cc-b12b-9a385ef150ff-tmp\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.525701 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.525674 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac38b761-27dc-424f-96dc-e017a6ca1d7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.527498 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.527469 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.527728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.527703 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.527776 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.527732 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-ca\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.527852 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.527832 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac38b761-27dc-424f-96dc-e017a6ca1d7f-hub\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.527890 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.527840 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38537cc0-28d6-41cc-b12b-9a385ef150ff-klusterlet-config\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.533308 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.533288 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmlsc\" (UniqueName: \"kubernetes.io/projected/ac38b761-27dc-424f-96dc-e017a6ca1d7f-kube-api-access-lmlsc\") pod \"cluster-proxy-proxy-agent-cd4fd5477-8xf5k\" (UID: \"ac38b761-27dc-424f-96dc-e017a6ca1d7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.533394 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.533345 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8p8\" (UniqueName: \"kubernetes.io/projected/38537cc0-28d6-41cc-b12b-9a385ef150ff-kube-api-access-wn8p8\") pod \"klusterlet-addon-workmgr-58d7d7c674-8pfcg\" (UID: \"38537cc0-28d6-41cc-b12b-9a385ef150ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.570218 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.570181 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:18.617010 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.616982 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" Jul 02 21:22:18.710322 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.710298 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg"] Jul 02 21:22:18.713573 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:22:18.713549 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38537cc0_28d6_41cc_b12b_9a385ef150ff.slice/crio-3d809d27015d30c10f5e923a7c7d018b0891357294969238f22675fa8d21e673 WatchSource:0}: Error finding container 3d809d27015d30c10f5e923a7c7d018b0891357294969238f22675fa8d21e673: Status 404 returned error can't find the container with id 3d809d27015d30c10f5e923a7c7d018b0891357294969238f22675fa8d21e673 Jul 02 21:22:18.755224 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:18.755200 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k"] Jul 02 21:22:18.757364 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:22:18.757332 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac38b761_27dc_424f_96dc_e017a6ca1d7f.slice/crio-da6c2a62b19c90112aad2241a093bac6b7db40006f394d20757aa876c847abd7 WatchSource:0}: Error finding container da6c2a62b19c90112aad2241a093bac6b7db40006f394d20757aa876c847abd7: Status 404 returned error can't find the container with id da6c2a62b19c90112aad2241a093bac6b7db40006f394d20757aa876c847abd7 Jul 02 21:22:19.559575 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:19.559536 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" event={"ID":"38537cc0-28d6-41cc-b12b-9a385ef150ff","Type":"ContainerStarted","Data":"3d809d27015d30c10f5e923a7c7d018b0891357294969238f22675fa8d21e673"} Jul 02 21:22:19.560568 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:19.560545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" event={"ID":"ac38b761-27dc-424f-96dc-e017a6ca1d7f","Type":"ContainerStarted","Data":"da6c2a62b19c90112aad2241a093bac6b7db40006f394d20757aa876c847abd7"} Jul 02 21:22:25.588816 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.588682 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" event={"ID":"38537cc0-28d6-41cc-b12b-9a385ef150ff","Type":"ContainerStarted","Data":"28c0d2cbeb1c3bae9cc2f54a3b5b015a4288369b367c76f53e58d5d9f84d0419"} Jul 02 21:22:25.588816 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.588808 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:25.590887 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.590858 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" Jul 02 21:22:25.591196 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.591174 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" event={"ID":"ac38b761-27dc-424f-96dc-e017a6ca1d7f","Type":"ContainerStarted","Data":"3c76fa1a30106bf5d4c079d12b08d4ea3eccedfb6f5b2108bd30d3fffd35ae8e"} Jul 02 21:22:25.591277 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.591204 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" event={"ID":"ac38b761-27dc-424f-96dc-e017a6ca1d7f","Type":"ContainerStarted","Data":"d3a0ee2e3f0b227753fc4d734ed78f1d3f47bcb17275c832f8d36a60b2dc1ea7"} Jul 02 21:22:25.591277 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.591216 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" event={"ID":"ac38b761-27dc-424f-96dc-e017a6ca1d7f","Type":"ContainerStarted","Data":"87db07aa0ae64c7920dd416f59bd09c01104a5b8ab98bfe504d34ed6b259e970"} Jul 02 21:22:25.604589 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.604543 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58d7d7c674-8pfcg" podStartSLOduration=1.178314308 podStartE2EDuration="7.604530608s" totalImagesPullingTime="6.4262163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:22:25.603102629 +0000 UTC m=+244.493025620" watchObservedRunningTime="2026-07-02 21:22:25.604530608 +0000 UTC m=+244.494453598" Jul 02 21:22:25.620354 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:22:25.620317 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4fd5477-8xf5k" podStartSLOduration=1.234776077 podStartE2EDuration="7.620305366s" totalImagesPullingTime="6.385529289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:22:25.619656219 +0000 UTC m=+244.509579215" watchObservedRunningTime="2026-07-02 21:22:25.620305366 +0000 UTC m=+244.510228373" Jul 02 21:23:21.519979 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:23:21.519943 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:23:21.525101 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:23:21.525078 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:23:21.533223 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:23:21.533198 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 21:28:21.547355 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:28:21.547330 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:28:21.549663 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:28:21.549641 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:30:55.575309 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.575275 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64"] Jul 02 21:30:55.578379 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.578362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:55.581183 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.581148 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 21:30:55.581307 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.581259 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q64dw\"" Jul 02 21:30:55.581854 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.581838 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-e36cd-kube-rbac-proxy-sar-config\"" Jul 02 21:30:55.581918 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.581839 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-e36cd-serving-cert\"" Jul 02 21:30:55.588599 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.588577 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64"] Jul 02 21:30:55.658629 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.658603 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:55.658795 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.658773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af504310-588c-43b8-912b-2c56a6dd7992-openshift-service-ca-bundle\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:55.759365 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.759331 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af504310-588c-43b8-912b-2c56a6dd7992-openshift-service-ca-bundle\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:55.759550 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.759378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:55.759550 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:30:55.759510 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-e36cd-serving-cert: secret "switch-graph-e36cd-serving-cert" not found Jul 02 21:30:55.759675 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:30:55.759563 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls podName:af504310-588c-43b8-912b-2c56a6dd7992 nodeName:}" failed. No retries permitted until 2026-07-02 21:30:56.259547851 +0000 UTC m=+755.149470820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls") pod "switch-graph-e36cd-68f8c7995c-glw64" (UID: "af504310-588c-43b8-912b-2c56a6dd7992") : secret "switch-graph-e36cd-serving-cert" not found Jul 02 21:30:55.760036 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:55.760010 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af504310-588c-43b8-912b-2c56a6dd7992-openshift-service-ca-bundle\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:56.263471 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:56.263437 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:56.263639 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:30:56.263562 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-e36cd-serving-cert: secret "switch-graph-e36cd-serving-cert" not found Jul 02 21:30:56.263639 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:30:56.263616 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls podName:af504310-588c-43b8-912b-2c56a6dd7992 nodeName:}" failed. No retries permitted until 2026-07-02 21:30:57.263601925 +0000 UTC m=+756.153524894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls") pod "switch-graph-e36cd-68f8c7995c-glw64" (UID: "af504310-588c-43b8-912b-2c56a6dd7992") : secret "switch-graph-e36cd-serving-cert" not found Jul 02 21:30:57.271002 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:57.270964 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:57.273408 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:57.273385 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls\") pod \"switch-graph-e36cd-68f8c7995c-glw64\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:57.388521 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:57.388488 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:30:57.510553 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:57.510523 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64"] Jul 02 21:30:57.513265 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:30:57.513230 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf504310_588c_43b8_912b_2c56a6dd7992.slice/crio-faa99c1566d5a7a91db43d63c27b7635e548d394482727bb0251bda3cfc4ccd0 WatchSource:0}: Error finding container faa99c1566d5a7a91db43d63c27b7635e548d394482727bb0251bda3cfc4ccd0: Status 404 returned error can't find the container with id faa99c1566d5a7a91db43d63c27b7635e548d394482727bb0251bda3cfc4ccd0 Jul 02 21:30:57.515564 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:57.515547 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:30:58.413525 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:30:58.413487 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" event={"ID":"af504310-588c-43b8-912b-2c56a6dd7992","Type":"ContainerStarted","Data":"faa99c1566d5a7a91db43d63c27b7635e548d394482727bb0251bda3cfc4ccd0"} Jul 02 21:31:00.422279 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:00.422244 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" event={"ID":"af504310-588c-43b8-912b-2c56a6dd7992","Type":"ContainerStarted","Data":"6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083"} Jul 02 21:31:00.422678 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:00.422371 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:31:00.438333 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:00.438290 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podStartSLOduration=2.947675471 podStartE2EDuration="5.438276607s" totalImagesPullingTime="2.490601136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:00.437083094 +0000 UTC m=+759.327006098" watchObservedRunningTime="2026-07-02 21:31:00.438276607 +0000 UTC m=+759.328199599" Jul 02 21:31:06.431808 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:06.431780 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:31:09.829943 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:09.829909 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64"] Jul 02 21:31:09.830428 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:09.830146 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" containerID="cri-o://6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083" gracePeriod=30 Jul 02 21:31:11.430773 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:11.430732 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:16.430209 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:16.430171 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:21.430916 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:21.430878 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:21.431311 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:21.430985 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:31:25.566864 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.566826 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7"] Jul 02 21:31:25.569101 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.569080 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:25.571132 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.571111 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\"" Jul 02 21:31:25.571277 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.571262 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\"" Jul 02 21:31:25.579328 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.579306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7"] Jul 02 21:31:25.693075 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.693043 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:25.693253 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.693111 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f667116-a685-46d7-9c79-96e9a15fc44c-openshift-service-ca-bundle\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:25.793550 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.793515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:25.793713 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.793570 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f667116-a685-46d7-9c79-96e9a15fc44c-openshift-service-ca-bundle\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:25.793713 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:31:25.793664 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found Jul 02 21:31:25.793797 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:31:25.793755 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls podName:9f667116-a685-46d7-9c79-96e9a15fc44c nodeName:}" failed. No retries permitted until 2026-07-02 21:31:26.293737736 +0000 UTC m=+785.183660705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls") pod "model-chainer-77cb85d899-bjbw7" (UID: "9f667116-a685-46d7-9c79-96e9a15fc44c") : secret "model-chainer-serving-cert" not found Jul 02 21:31:25.794160 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:25.794142 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f667116-a685-46d7-9c79-96e9a15fc44c-openshift-service-ca-bundle\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:26.298013 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:26.297970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:26.298197 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:31:26.298129 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found Jul 02 21:31:26.298245 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:31:26.298206 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls podName:9f667116-a685-46d7-9c79-96e9a15fc44c nodeName:}" failed. No retries permitted until 2026-07-02 21:31:27.298191059 +0000 UTC m=+786.188114031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls") pod "model-chainer-77cb85d899-bjbw7" (UID: "9f667116-a685-46d7-9c79-96e9a15fc44c") : secret "model-chainer-serving-cert" not found Jul 02 21:31:26.430804 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:26.430765 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:27.305685 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:27.305653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:27.308006 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:27.307986 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls\") pod \"model-chainer-77cb85d899-bjbw7\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:27.378929 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:27.378903 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:27.499527 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:27.499505 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7"] Jul 02 21:31:27.501847 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:31:27.501821 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f667116_a685_46d7_9c79_96e9a15fc44c.slice/crio-26ec6c217d75a8d94a25f0286ab1160de70ce888c5de5452074fc95ad7b1940f WatchSource:0}: Error finding container 26ec6c217d75a8d94a25f0286ab1160de70ce888c5de5452074fc95ad7b1940f: Status 404 returned error can't find the container with id 26ec6c217d75a8d94a25f0286ab1160de70ce888c5de5452074fc95ad7b1940f Jul 02 21:31:27.516935 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:27.516904 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" event={"ID":"9f667116-a685-46d7-9c79-96e9a15fc44c","Type":"ContainerStarted","Data":"26ec6c217d75a8d94a25f0286ab1160de70ce888c5de5452074fc95ad7b1940f"} Jul 02 21:31:28.521387 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:28.521352 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" event={"ID":"9f667116-a685-46d7-9c79-96e9a15fc44c","Type":"ContainerStarted","Data":"56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760"} Jul 02 21:31:28.521799 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:28.521450 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:28.536437 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:28.536376 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podStartSLOduration=3.536360891 podStartE2EDuration="3.536360891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:28.535667964 +0000 UTC m=+787.425590957" watchObservedRunningTime="2026-07-02 21:31:28.536360891 +0000 UTC m=+787.426283931" Jul 02 21:31:31.430153 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:31.430049 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:34.531600 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:34.531571 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:35.673278 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:35.673248 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7"] Jul 02 21:31:35.673799 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:35.673480 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" containerID="cri-o://56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760" gracePeriod=30 Jul 02 21:31:36.430790 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:36.430754 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:39.529779 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:39.529743 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:39.968025 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:39.968000 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:31:40.107390 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.107364 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af504310-588c-43b8-912b-2c56a6dd7992-openshift-service-ca-bundle\") pod \"af504310-588c-43b8-912b-2c56a6dd7992\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " Jul 02 21:31:40.107593 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.107402 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls\") pod \"af504310-588c-43b8-912b-2c56a6dd7992\" (UID: \"af504310-588c-43b8-912b-2c56a6dd7992\") " Jul 02 21:31:40.107760 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.107738 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af504310-588c-43b8-912b-2c56a6dd7992-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "af504310-588c-43b8-912b-2c56a6dd7992" (UID: "af504310-588c-43b8-912b-2c56a6dd7992"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:31:40.109496 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.109469 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "af504310-588c-43b8-912b-2c56a6dd7992" (UID: "af504310-588c-43b8-912b-2c56a6dd7992"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:31:40.209052 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.209020 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af504310-588c-43b8-912b-2c56a6dd7992-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:31:40.209171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.209054 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af504310-588c-43b8-912b-2c56a6dd7992-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:31:40.568560 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.568471 2554 generic.go:356] "Generic (PLEG): container finished" podID="af504310-588c-43b8-912b-2c56a6dd7992" containerID="6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083" exitCode=0 Jul 02 21:31:40.568560 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.568520 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" Jul 02 21:31:40.568989 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.568556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" event={"ID":"af504310-588c-43b8-912b-2c56a6dd7992","Type":"ContainerDied","Data":"6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083"} Jul 02 21:31:40.568989 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.568607 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64" event={"ID":"af504310-588c-43b8-912b-2c56a6dd7992","Type":"ContainerDied","Data":"faa99c1566d5a7a91db43d63c27b7635e548d394482727bb0251bda3cfc4ccd0"} Jul 02 21:31:40.568989 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.568629 2554 scope.go:117] "RemoveContainer" containerID="6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083" Jul 02 21:31:40.577024 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.577006 2554 scope.go:117] "RemoveContainer" containerID="6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083" Jul 02 21:31:40.577259 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:31:40.577240 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083\": container with ID starting with 6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083 not found: ID does not exist" containerID="6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083" Jul 02 21:31:40.577303 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.577266 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083"} err="failed to get container status \"6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083\": rpc error: code = NotFound desc = could not find container \"6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083\": container with ID starting with 6a0ea6e897dc82f3e1708a748fcfed4060665d819fd724271ea8c802a48d2083 not found: ID does not exist" Jul 02 21:31:40.588076 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.588053 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64"] Jul 02 21:31:40.591840 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:40.591820 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e36cd-68f8c7995c-glw64"] Jul 02 21:31:41.630774 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:41.630742 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af504310-588c-43b8-912b-2c56a6dd7992" path="/var/lib/kubelet/pods/af504310-588c-43b8-912b-2c56a6dd7992/volumes" Jul 02 21:31:44.529946 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:44.529873 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:49.529536 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:49.529490 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:49.529976 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:49.529606 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:31:54.529811 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:54.529775 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:31:59.529801 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:31:59.529764 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:32:04.529896 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:04.529852 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:32:06.315516 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.315492 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:32:06.396140 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.396114 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f667116-a685-46d7-9c79-96e9a15fc44c-openshift-service-ca-bundle\") pod \"9f667116-a685-46d7-9c79-96e9a15fc44c\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " Jul 02 21:32:06.396297 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.396163 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls\") pod \"9f667116-a685-46d7-9c79-96e9a15fc44c\" (UID: \"9f667116-a685-46d7-9c79-96e9a15fc44c\") " Jul 02 21:32:06.396536 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.396505 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f667116-a685-46d7-9c79-96e9a15fc44c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9f667116-a685-46d7-9c79-96e9a15fc44c" (UID: "9f667116-a685-46d7-9c79-96e9a15fc44c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:32:06.398134 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.398111 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9f667116-a685-46d7-9c79-96e9a15fc44c" (UID: "9f667116-a685-46d7-9c79-96e9a15fc44c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:32:06.497169 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.497105 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f667116-a685-46d7-9c79-96e9a15fc44c-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:32:06.497169 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.497129 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f667116-a685-46d7-9c79-96e9a15fc44c-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:32:06.669319 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.669287 2554 generic.go:356] "Generic (PLEG): container finished" podID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerID="56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760" exitCode=0 Jul 02 21:32:06.669493 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.669322 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" event={"ID":"9f667116-a685-46d7-9c79-96e9a15fc44c","Type":"ContainerDied","Data":"56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760"} Jul 02 21:32:06.669493 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.669364 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" event={"ID":"9f667116-a685-46d7-9c79-96e9a15fc44c","Type":"ContainerDied","Data":"26ec6c217d75a8d94a25f0286ab1160de70ce888c5de5452074fc95ad7b1940f"} Jul 02 21:32:06.669493 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.669391 2554 scope.go:117] "RemoveContainer" containerID="56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760" Jul 02 21:32:06.669493 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.669327 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7" Jul 02 21:32:06.678270 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.678047 2554 scope.go:117] "RemoveContainer" containerID="56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760" Jul 02 21:32:06.678455 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:32:06.678295 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760\": container with ID starting with 56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760 not found: ID does not exist" containerID="56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760" Jul 02 21:32:06.678455 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.678327 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760"} err="failed to get container status \"56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760\": rpc error: code = NotFound desc = could not find container \"56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760\": container with ID starting with 56d86f7b6d7f4f392487e3d71bc62ac6c93f730058bce17c31bf4ed4b4f9a760 not found: ID does not exist" Jul 02 21:32:06.690653 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.690630 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7"] Jul 02 21:32:06.693815 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:06.693794 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-77cb85d899-bjbw7"] Jul 02 21:32:07.626271 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:07.626232 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" path="/var/lib/kubelet/pods/9f667116-a685-46d7-9c79-96e9a15fc44c/volumes" Jul 02 21:32:10.048670 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.048637 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x"] Jul 02 21:32:10.049061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.048918 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" Jul 02 21:32:10.049061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.048929 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" Jul 02 21:32:10.049061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.048961 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" Jul 02 21:32:10.049061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.048967 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" Jul 02 21:32:10.049061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.049015 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f667116-a685-46d7-9c79-96e9a15fc44c" containerName="model-chainer" Jul 02 21:32:10.049061 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.049023 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="af504310-588c-43b8-912b-2c56a6dd7992" containerName="switch-graph-e36cd" Jul 02 21:32:10.052055 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.052038 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.054265 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.054239 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 21:32:10.054436 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.054367 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7615e-kube-rbac-proxy-sar-config\"" Jul 02 21:32:10.054436 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.054389 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q64dw\"" Jul 02 21:32:10.054904 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.054888 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7615e-serving-cert\"" Jul 02 21:32:10.060968 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.060944 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x"] Jul 02 21:32:10.125319 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.125282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db3c41f3-789c-42c6-a01e-7e67366cb754-proxy-tls\") pod \"switch-graph-7615e-85ccdd4fcc-82s9x\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.125482 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.125334 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db3c41f3-789c-42c6-a01e-7e67366cb754-openshift-service-ca-bundle\") pod \"switch-graph-7615e-85ccdd4fcc-82s9x\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.226182 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.226151 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db3c41f3-789c-42c6-a01e-7e67366cb754-proxy-tls\") pod \"switch-graph-7615e-85ccdd4fcc-82s9x\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.226182 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.226193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db3c41f3-789c-42c6-a01e-7e67366cb754-openshift-service-ca-bundle\") pod \"switch-graph-7615e-85ccdd4fcc-82s9x\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.226839 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.226814 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db3c41f3-789c-42c6-a01e-7e67366cb754-openshift-service-ca-bundle\") pod \"switch-graph-7615e-85ccdd4fcc-82s9x\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.228536 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.228516 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db3c41f3-789c-42c6-a01e-7e67366cb754-proxy-tls\") pod \"switch-graph-7615e-85ccdd4fcc-82s9x\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.362740 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.362702 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.486554 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.486521 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x"] Jul 02 21:32:10.489451 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:32:10.489405 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3c41f3_789c_42c6_a01e_7e67366cb754.slice/crio-cb2f2fd0ed4dec9e117e24b6d799ce397d59c95c784d666aefbd000208bb32d7 WatchSource:0}: Error finding container cb2f2fd0ed4dec9e117e24b6d799ce397d59c95c784d666aefbd000208bb32d7: Status 404 returned error can't find the container with id cb2f2fd0ed4dec9e117e24b6d799ce397d59c95c784d666aefbd000208bb32d7 Jul 02 21:32:10.686018 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.685908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" event={"ID":"db3c41f3-789c-42c6-a01e-7e67366cb754","Type":"ContainerStarted","Data":"6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b"} Jul 02 21:32:10.686018 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.685989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" event={"ID":"db3c41f3-789c-42c6-a01e-7e67366cb754","Type":"ContainerStarted","Data":"cb2f2fd0ed4dec9e117e24b6d799ce397d59c95c784d666aefbd000208bb32d7"} Jul 02 21:32:10.686280 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.686029 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:10.702399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:10.702357 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podStartSLOduration=0.702343026 podStartE2EDuration="702.343026ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:10.701205958 +0000 UTC m=+829.591128949" watchObservedRunningTime="2026-07-02 21:32:10.702343026 +0000 UTC m=+829.592266017" Jul 02 21:32:16.695291 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:16.695261 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:32:35.858200 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:35.858171 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6"] Jul 02 21:32:35.862181 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:35.862160 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:35.864186 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:35.864160 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a3b0c-kube-rbac-proxy-sar-config\"" Jul 02 21:32:35.864287 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:35.864267 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a3b0c-serving-cert\"" Jul 02 21:32:35.871336 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:35.871315 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6"] Jul 02 21:32:35.930001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:35.929964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28179935-2e9d-4d95-b5bd-78edd9d21658-openshift-service-ca-bundle\") pod \"sequence-graph-a3b0c-c794dd67c-4k8h6\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:35.930001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:35.930002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls\") pod \"sequence-graph-a3b0c-c794dd67c-4k8h6\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:36.030789 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:36.030748 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28179935-2e9d-4d95-b5bd-78edd9d21658-openshift-service-ca-bundle\") pod \"sequence-graph-a3b0c-c794dd67c-4k8h6\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:36.030789 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:36.030789 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls\") pod \"sequence-graph-a3b0c-c794dd67c-4k8h6\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:36.031006 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:32:36.030911 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-a3b0c-serving-cert: secret "sequence-graph-a3b0c-serving-cert" not found Jul 02 21:32:36.031006 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:32:36.030967 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls podName:28179935-2e9d-4d95-b5bd-78edd9d21658 nodeName:}" failed. No retries permitted until 2026-07-02 21:32:36.530950898 +0000 UTC m=+855.420873871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls") pod "sequence-graph-a3b0c-c794dd67c-4k8h6" (UID: "28179935-2e9d-4d95-b5bd-78edd9d21658") : secret "sequence-graph-a3b0c-serving-cert" not found Jul 02 21:32:36.031394 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:36.031373 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28179935-2e9d-4d95-b5bd-78edd9d21658-openshift-service-ca-bundle\") pod \"sequence-graph-a3b0c-c794dd67c-4k8h6\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:36.535136 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:36.535098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls\") pod \"sequence-graph-a3b0c-c794dd67c-4k8h6\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:36.537502 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:36.537476 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls\") pod \"sequence-graph-a3b0c-c794dd67c-4k8h6\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:36.772363 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:36.772337 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:36.895304 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:36.895281 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6"] Jul 02 21:32:36.897774 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:32:36.897748 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28179935_2e9d_4d95_b5bd_78edd9d21658.slice/crio-a40d95a2966c488c45d1340d9001e4b1da36ca0be7d2ab7b0e9fea8f3df9f249 WatchSource:0}: Error finding container a40d95a2966c488c45d1340d9001e4b1da36ca0be7d2ab7b0e9fea8f3df9f249: Status 404 returned error can't find the container with id a40d95a2966c488c45d1340d9001e4b1da36ca0be7d2ab7b0e9fea8f3df9f249 Jul 02 21:32:37.785517 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:37.785484 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" event={"ID":"28179935-2e9d-4d95-b5bd-78edd9d21658","Type":"ContainerStarted","Data":"64719a526f55f49b23871b292e13c78df2984f7bd9ed27ad470dc4c6fd58c753"} Jul 02 21:32:37.785705 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:37.785533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" event={"ID":"28179935-2e9d-4d95-b5bd-78edd9d21658","Type":"ContainerStarted","Data":"a40d95a2966c488c45d1340d9001e4b1da36ca0be7d2ab7b0e9fea8f3df9f249"} Jul 02 21:32:37.785705 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:37.785592 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:32:37.803892 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:37.803851 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podStartSLOduration=2.803837588 podStartE2EDuration="2.803837588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:37.802208006 +0000 UTC m=+856.692130997" watchObservedRunningTime="2026-07-02 21:32:37.803837588 +0000 UTC m=+856.693760579" Jul 02 21:32:43.794787 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:32:43.794759 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:33:21.573267 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:33:21.573189 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:33:21.574609 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:33:21.574583 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:38:21.600558 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:38:21.600474 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:38:21.601111 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:38:21.600560 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:40:24.620985 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:24.620950 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x"] Jul 02 21:40:24.623262 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:24.621393 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" containerID="cri-o://6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b" gracePeriod=30 Jul 02 21:40:26.693742 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:26.693705 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:40:31.693792 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:31.693755 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:40:36.693544 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:36.693508 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:40:36.693936 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:36.693613 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:40:41.692755 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:41.692717 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:40:46.693393 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:46.693306 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:40:50.597357 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:50.597320 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6"] Jul 02 21:40:50.597727 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:50.597590 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" containerID="cri-o://64719a526f55f49b23871b292e13c78df2984f7bd9ed27ad470dc4c6fd58c753" gracePeriod=30 Jul 02 21:40:51.693859 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:51.693812 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:40:53.793479 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:53.793436 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:40:54.767302 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:54.767278 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:40:54.890923 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:54.890840 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db3c41f3-789c-42c6-a01e-7e67366cb754-proxy-tls\") pod \"db3c41f3-789c-42c6-a01e-7e67366cb754\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " Jul 02 21:40:54.890923 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:54.890896 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db3c41f3-789c-42c6-a01e-7e67366cb754-openshift-service-ca-bundle\") pod \"db3c41f3-789c-42c6-a01e-7e67366cb754\" (UID: \"db3c41f3-789c-42c6-a01e-7e67366cb754\") " Jul 02 21:40:54.891360 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:54.891206 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db3c41f3-789c-42c6-a01e-7e67366cb754-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "db3c41f3-789c-42c6-a01e-7e67366cb754" (UID: "db3c41f3-789c-42c6-a01e-7e67366cb754"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:40:54.892820 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:54.892798 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db3c41f3-789c-42c6-a01e-7e67366cb754-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "db3c41f3-789c-42c6-a01e-7e67366cb754" (UID: "db3c41f3-789c-42c6-a01e-7e67366cb754"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:40:54.992301 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:54.992270 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db3c41f3-789c-42c6-a01e-7e67366cb754-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:40:54.992301 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:54.992296 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db3c41f3-789c-42c6-a01e-7e67366cb754-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:40:55.615980 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.615947 2554 generic.go:356] "Generic (PLEG): container finished" podID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerID="6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b" exitCode=0 Jul 02 21:40:55.616255 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.615985 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" Jul 02 21:40:55.616255 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.616026 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" event={"ID":"db3c41f3-789c-42c6-a01e-7e67366cb754","Type":"ContainerDied","Data":"6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b"} Jul 02 21:40:55.616255 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.616084 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x" event={"ID":"db3c41f3-789c-42c6-a01e-7e67366cb754","Type":"ContainerDied","Data":"cb2f2fd0ed4dec9e117e24b6d799ce397d59c95c784d666aefbd000208bb32d7"} Jul 02 21:40:55.616255 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.616117 2554 scope.go:117] "RemoveContainer" containerID="6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b" Jul 02 21:40:55.628456 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.628235 2554 scope.go:117] "RemoveContainer" containerID="6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b" Jul 02 21:40:55.628561 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:40:55.628528 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b\": container with ID starting with 6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b not found: ID does not exist" containerID="6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b" Jul 02 21:40:55.628618 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.628565 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b"} err="failed to get container status \"6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b\": rpc error: code = NotFound desc = could not find container \"6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b\": container with ID starting with 6d85a48f250542746448543527f5c4a38be457a34f662534c94d4cb8aa2ae29b not found: ID does not exist" Jul 02 21:40:55.637750 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.637725 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x"] Jul 02 21:40:55.639674 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:55.639654 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7615e-85ccdd4fcc-82s9x"] Jul 02 21:40:57.631156 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:57.631123 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" path="/var/lib/kubelet/pods/db3c41f3-789c-42c6-a01e-7e67366cb754/volumes" Jul 02 21:40:58.793175 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:40:58.793132 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:03.793098 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:03.793063 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:03.793522 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:03.793174 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:41:08.793231 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:08.793188 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:13.793202 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:13.793154 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:18.793683 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:18.793637 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:20.707359 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:20.707324 2554 generic.go:356] "Generic (PLEG): container finished" podID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerID="64719a526f55f49b23871b292e13c78df2984f7bd9ed27ad470dc4c6fd58c753" exitCode=0 Jul 02 21:41:20.707702 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:20.707364 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" event={"ID":"28179935-2e9d-4d95-b5bd-78edd9d21658","Type":"ContainerDied","Data":"64719a526f55f49b23871b292e13c78df2984f7bd9ed27ad470dc4c6fd58c753"} Jul 02 21:41:21.236456 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.236435 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:41:21.399190 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.399106 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls\") pod \"28179935-2e9d-4d95-b5bd-78edd9d21658\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " Jul 02 21:41:21.399338 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.399231 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28179935-2e9d-4d95-b5bd-78edd9d21658-openshift-service-ca-bundle\") pod \"28179935-2e9d-4d95-b5bd-78edd9d21658\" (UID: \"28179935-2e9d-4d95-b5bd-78edd9d21658\") " Jul 02 21:41:21.399624 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.399590 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28179935-2e9d-4d95-b5bd-78edd9d21658-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "28179935-2e9d-4d95-b5bd-78edd9d21658" (UID: "28179935-2e9d-4d95-b5bd-78edd9d21658"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:41:21.401084 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.401066 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "28179935-2e9d-4d95-b5bd-78edd9d21658" (UID: "28179935-2e9d-4d95-b5bd-78edd9d21658"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:41:21.500804 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.500767 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28179935-2e9d-4d95-b5bd-78edd9d21658-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:41:21.500804 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.500797 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/28179935-2e9d-4d95-b5bd-78edd9d21658-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:41:21.646200 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.646173 2554 scope.go:117] "RemoveContainer" containerID="64719a526f55f49b23871b292e13c78df2984f7bd9ed27ad470dc4c6fd58c753" Jul 02 21:41:21.710235 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.710210 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" Jul 02 21:41:21.710543 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.710240 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6" event={"ID":"28179935-2e9d-4d95-b5bd-78edd9d21658","Type":"ContainerDied","Data":"a40d95a2966c488c45d1340d9001e4b1da36ca0be7d2ab7b0e9fea8f3df9f249"} Jul 02 21:41:21.785031 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.785006 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6"] Jul 02 21:41:21.792093 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:21.792064 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a3b0c-c794dd67c-4k8h6"] Jul 02 21:41:23.626342 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:23.626313 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" path="/var/lib/kubelet/pods/28179935-2e9d-4d95-b5bd-78edd9d21658/volumes" Jul 02 21:41:24.867001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.866964 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz"] Jul 02 21:41:24.867392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.867258 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" Jul 02 21:41:24.867392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.867271 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" Jul 02 21:41:24.867392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.867285 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" Jul 02 21:41:24.867392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.867291 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" Jul 02 21:41:24.867392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.867340 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="28179935-2e9d-4d95-b5bd-78edd9d21658" containerName="sequence-graph-a3b0c" Jul 02 21:41:24.867392 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.867348 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="db3c41f3-789c-42c6-a01e-7e67366cb754" containerName="switch-graph-7615e" Jul 02 21:41:24.871585 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.871567 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:24.874785 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.874761 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q64dw\"" Jul 02 21:41:24.874906 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.874761 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 21:41:24.875053 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.875033 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-ee70d-serving-cert\"" Jul 02 21:41:24.875444 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.875428 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-ee70d-kube-rbac-proxy-sar-config\"" Jul 02 21:41:24.879890 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:24.879868 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz"] Jul 02 21:41:25.023897 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.023861 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/924eaf82-9435-478a-8080-cb22c6ce524e-proxy-tls\") pod \"ensemble-graph-ee70d-579c96c64c-pwwnz\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.023897 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.023902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924eaf82-9435-478a-8080-cb22c6ce524e-openshift-service-ca-bundle\") pod \"ensemble-graph-ee70d-579c96c64c-pwwnz\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.124531 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.124445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/924eaf82-9435-478a-8080-cb22c6ce524e-proxy-tls\") pod \"ensemble-graph-ee70d-579c96c64c-pwwnz\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.124531 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.124496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924eaf82-9435-478a-8080-cb22c6ce524e-openshift-service-ca-bundle\") pod \"ensemble-graph-ee70d-579c96c64c-pwwnz\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.125163 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.125137 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924eaf82-9435-478a-8080-cb22c6ce524e-openshift-service-ca-bundle\") pod \"ensemble-graph-ee70d-579c96c64c-pwwnz\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.126814 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.126795 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/924eaf82-9435-478a-8080-cb22c6ce524e-proxy-tls\") pod \"ensemble-graph-ee70d-579c96c64c-pwwnz\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.182830 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.182805 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.324756 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.324728 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz"] Jul 02 21:41:25.328633 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:41:25.328603 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924eaf82_9435_478a_8080_cb22c6ce524e.slice/crio-432edab51a77c708ea3c8abd68cf884026a50d0b1d697033e5623426a318b158 WatchSource:0}: Error finding container 432edab51a77c708ea3c8abd68cf884026a50d0b1d697033e5623426a318b158: Status 404 returned error can't find the container with id 432edab51a77c708ea3c8abd68cf884026a50d0b1d697033e5623426a318b158 Jul 02 21:41:25.725622 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.725535 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" event={"ID":"924eaf82-9435-478a-8080-cb22c6ce524e","Type":"ContainerStarted","Data":"29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669"} Jul 02 21:41:25.725622 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.725590 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" event={"ID":"924eaf82-9435-478a-8080-cb22c6ce524e","Type":"ContainerStarted","Data":"432edab51a77c708ea3c8abd68cf884026a50d0b1d697033e5623426a318b158"} Jul 02 21:41:25.725817 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.725662 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:25.742665 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:25.742615 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podStartSLOduration=1.7426009759999999 podStartE2EDuration="1.742600976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:41:25.740143391 +0000 UTC m=+1384.630066384" watchObservedRunningTime="2026-07-02 21:41:25.742600976 +0000 UTC m=+1384.632523966" Jul 02 21:41:31.734177 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:31.734144 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:34.934953 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:34.934921 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz"] Jul 02 21:41:34.935365 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:34.935096 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" containerID="cri-o://29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669" gracePeriod=30 Jul 02 21:41:36.734583 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:36.734539 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:41.734064 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:41.734008 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:46.733669 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:46.733625 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:46.734046 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:46.733724 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:41:50.733119 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.733088 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2"] Jul 02 21:41:50.737429 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.737395 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:50.739766 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.739743 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-1702f-kube-rbac-proxy-sar-config\"" Jul 02 21:41:50.739880 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.739746 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-1702f-serving-cert\"" Jul 02 21:41:50.744603 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.744583 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2"] Jul 02 21:41:50.802805 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.802778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35dcffdc-a454-4dfb-8900-70ce88aee475-openshift-service-ca-bundle\") pod \"sequence-graph-1702f-5b5fd878cd-fpbw2\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:50.802921 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.802830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls\") pod \"sequence-graph-1702f-5b5fd878cd-fpbw2\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:50.904166 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.904132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35dcffdc-a454-4dfb-8900-70ce88aee475-openshift-service-ca-bundle\") pod \"sequence-graph-1702f-5b5fd878cd-fpbw2\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:50.904314 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.904187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls\") pod \"sequence-graph-1702f-5b5fd878cd-fpbw2\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:50.904314 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:41:50.904268 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-1702f-serving-cert: secret "sequence-graph-1702f-serving-cert" not found Jul 02 21:41:50.904398 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:41:50.904318 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls podName:35dcffdc-a454-4dfb-8900-70ce88aee475 nodeName:}" failed. No retries permitted until 2026-07-02 21:41:51.404302657 +0000 UTC m=+1410.294225627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls") pod "sequence-graph-1702f-5b5fd878cd-fpbw2" (UID: "35dcffdc-a454-4dfb-8900-70ce88aee475") : secret "sequence-graph-1702f-serving-cert" not found Jul 02 21:41:50.904779 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:50.904759 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35dcffdc-a454-4dfb-8900-70ce88aee475-openshift-service-ca-bundle\") pod \"sequence-graph-1702f-5b5fd878cd-fpbw2\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:51.408806 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:51.408772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls\") pod \"sequence-graph-1702f-5b5fd878cd-fpbw2\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:51.411202 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:51.411177 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls\") pod \"sequence-graph-1702f-5b5fd878cd-fpbw2\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:51.647728 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:51.647697 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:51.733566 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:51.733532 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:51.775855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:51.775829 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2"] Jul 02 21:41:51.778184 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:41:51.778157 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35dcffdc_a454_4dfb_8900_70ce88aee475.slice/crio-fb8c6dcaf115f0e488e5e9b73b3104ea6502659f6256734e0d2d04d546182a03 WatchSource:0}: Error finding container fb8c6dcaf115f0e488e5e9b73b3104ea6502659f6256734e0d2d04d546182a03: Status 404 returned error can't find the container with id fb8c6dcaf115f0e488e5e9b73b3104ea6502659f6256734e0d2d04d546182a03 Jul 02 21:41:51.824614 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:51.824584 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" event={"ID":"35dcffdc-a454-4dfb-8900-70ce88aee475","Type":"ContainerStarted","Data":"fb8c6dcaf115f0e488e5e9b73b3104ea6502659f6256734e0d2d04d546182a03"} Jul 02 21:41:52.830038 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:52.830000 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" event={"ID":"35dcffdc-a454-4dfb-8900-70ce88aee475","Type":"ContainerStarted","Data":"1ec98a73c74c313d8c41841e1923e373aaaee5e85fa1f8b30e513d8b4c743a32"} Jul 02 21:41:52.830540 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:52.830127 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:41:52.848486 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:52.848440 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podStartSLOduration=2.848411488 podStartE2EDuration="2.848411488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:41:52.846800725 +0000 UTC m=+1411.736723717" watchObservedRunningTime="2026-07-02 21:41:52.848411488 +0000 UTC m=+1411.738334480" Jul 02 21:41:56.734370 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:56.734329 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:41:58.839223 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:41:58.839197 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:42:00.824831 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:00.824798 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2"] Jul 02 21:42:00.825195 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:00.825034 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" containerID="cri-o://1ec98a73c74c313d8c41841e1923e373aaaee5e85fa1f8b30e513d8b4c743a32" gracePeriod=30 Jul 02 21:42:01.734125 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:01.734080 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:42:03.837615 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:03.837576 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:42:05.075495 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.075464 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:42:05.105051 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.105021 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924eaf82-9435-478a-8080-cb22c6ce524e-openshift-service-ca-bundle\") pod \"924eaf82-9435-478a-8080-cb22c6ce524e\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " Jul 02 21:42:05.105225 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.105113 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/924eaf82-9435-478a-8080-cb22c6ce524e-proxy-tls\") pod \"924eaf82-9435-478a-8080-cb22c6ce524e\" (UID: \"924eaf82-9435-478a-8080-cb22c6ce524e\") " Jul 02 21:42:05.105390 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.105365 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/924eaf82-9435-478a-8080-cb22c6ce524e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "924eaf82-9435-478a-8080-cb22c6ce524e" (UID: "924eaf82-9435-478a-8080-cb22c6ce524e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:42:05.107262 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.107229 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/924eaf82-9435-478a-8080-cb22c6ce524e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "924eaf82-9435-478a-8080-cb22c6ce524e" (UID: "924eaf82-9435-478a-8080-cb22c6ce524e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:42:05.206066 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.205989 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/924eaf82-9435-478a-8080-cb22c6ce524e-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:42:05.206066 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.206014 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924eaf82-9435-478a-8080-cb22c6ce524e-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:42:05.877819 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.877782 2554 generic.go:356] "Generic (PLEG): container finished" podID="924eaf82-9435-478a-8080-cb22c6ce524e" containerID="29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669" exitCode=0 Jul 02 21:42:05.877995 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.877829 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" Jul 02 21:42:05.877995 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.877862 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" event={"ID":"924eaf82-9435-478a-8080-cb22c6ce524e","Type":"ContainerDied","Data":"29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669"} Jul 02 21:42:05.877995 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.877916 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz" event={"ID":"924eaf82-9435-478a-8080-cb22c6ce524e","Type":"ContainerDied","Data":"432edab51a77c708ea3c8abd68cf884026a50d0b1d697033e5623426a318b158"} Jul 02 21:42:05.877995 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.877937 2554 scope.go:117] "RemoveContainer" containerID="29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669" Jul 02 21:42:05.885958 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.885915 2554 scope.go:117] "RemoveContainer" containerID="29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669" Jul 02 21:42:05.886212 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:42:05.886191 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669\": container with ID starting with 29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669 not found: ID does not exist" containerID="29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669" Jul 02 21:42:05.886318 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.886224 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669"} err="failed to get container status \"29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669\": rpc error: code = NotFound desc = could not find container \"29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669\": container with ID starting with 29dcad628f916b0f2504f9b76224ec09b053a13e499ab934b574acd5cedba669 not found: ID does not exist" Jul 02 21:42:05.893635 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.893610 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz"] Jul 02 21:42:05.897896 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:05.897875 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ee70d-579c96c64c-pwwnz"] Jul 02 21:42:07.625950 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:07.625918 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" path="/var/lib/kubelet/pods/924eaf82-9435-478a-8080-cb22c6ce524e/volumes" Jul 02 21:42:08.837687 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:08.837643 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:42:13.837794 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:13.837751 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:42:13.838210 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:13.837882 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:42:18.837903 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:18.837856 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:42:23.837869 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:23.837831 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:42:28.837119 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:28.837077 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:42:30.969262 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:30.969226 2554 generic.go:356] "Generic (PLEG): container finished" podID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerID="1ec98a73c74c313d8c41841e1923e373aaaee5e85fa1f8b30e513d8b4c743a32" exitCode=0 Jul 02 21:42:30.969622 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:30.969299 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" event={"ID":"35dcffdc-a454-4dfb-8900-70ce88aee475","Type":"ContainerDied","Data":"1ec98a73c74c313d8c41841e1923e373aaaee5e85fa1f8b30e513d8b4c743a32"} Jul 02 21:42:31.468376 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.468350 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:42:31.600659 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.600580 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls\") pod \"35dcffdc-a454-4dfb-8900-70ce88aee475\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " Jul 02 21:42:31.600797 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.600676 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35dcffdc-a454-4dfb-8900-70ce88aee475-openshift-service-ca-bundle\") pod \"35dcffdc-a454-4dfb-8900-70ce88aee475\" (UID: \"35dcffdc-a454-4dfb-8900-70ce88aee475\") " Jul 02 21:42:31.601008 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.600987 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35dcffdc-a454-4dfb-8900-70ce88aee475-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "35dcffdc-a454-4dfb-8900-70ce88aee475" (UID: "35dcffdc-a454-4dfb-8900-70ce88aee475"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:42:31.602670 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.602638 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "35dcffdc-a454-4dfb-8900-70ce88aee475" (UID: "35dcffdc-a454-4dfb-8900-70ce88aee475"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:42:31.701990 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.701960 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35dcffdc-a454-4dfb-8900-70ce88aee475-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:42:31.701990 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.701985 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35dcffdc-a454-4dfb-8900-70ce88aee475-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:42:31.973279 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.973248 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" event={"ID":"35dcffdc-a454-4dfb-8900-70ce88aee475","Type":"ContainerDied","Data":"fb8c6dcaf115f0e488e5e9b73b3104ea6502659f6256734e0d2d04d546182a03"} Jul 02 21:42:31.973279 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.973273 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2" Jul 02 21:42:31.973833 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.973309 2554 scope.go:117] "RemoveContainer" containerID="1ec98a73c74c313d8c41841e1923e373aaaee5e85fa1f8b30e513d8b4c743a32" Jul 02 21:42:31.990006 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.989984 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2"] Jul 02 21:42:31.994124 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:31.994095 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1702f-5b5fd878cd-fpbw2"] Jul 02 21:42:33.626529 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:33.626500 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" path="/var/lib/kubelet/pods/35dcffdc-a454-4dfb-8900-70ce88aee475/volumes" Jul 02 21:42:35.175788 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.175759 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46"] Jul 02 21:42:35.176144 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.176020 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" Jul 02 21:42:35.176144 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.176030 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" Jul 02 21:42:35.176144 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.176051 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" Jul 02 21:42:35.176144 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.176057 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" Jul 02 21:42:35.176144 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.176100 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="35dcffdc-a454-4dfb-8900-70ce88aee475" containerName="sequence-graph-1702f" Jul 02 21:42:35.176144 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.176108 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="924eaf82-9435-478a-8080-cb22c6ce524e" containerName="ensemble-graph-ee70d" Jul 02 21:42:35.180537 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.180517 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.183824 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.183804 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-87dcc-serving-cert\"" Jul 02 21:42:35.183824 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.183812 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q64dw\"" Jul 02 21:42:35.184046 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.184033 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-87dcc-kube-rbac-proxy-sar-config\"" Jul 02 21:42:35.184540 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.184523 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 21:42:35.188984 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.188962 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46"] Jul 02 21:42:35.331148 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.331109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31644f98-10f7-469a-aec0-be065f15beaa-proxy-tls\") pod \"ensemble-graph-87dcc-698df6b5bc-tdg46\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.331325 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.331158 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31644f98-10f7-469a-aec0-be065f15beaa-openshift-service-ca-bundle\") pod \"ensemble-graph-87dcc-698df6b5bc-tdg46\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.432340 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.432245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31644f98-10f7-469a-aec0-be065f15beaa-openshift-service-ca-bundle\") pod \"ensemble-graph-87dcc-698df6b5bc-tdg46\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.432508 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.432360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31644f98-10f7-469a-aec0-be065f15beaa-proxy-tls\") pod \"ensemble-graph-87dcc-698df6b5bc-tdg46\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.432900 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.432880 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31644f98-10f7-469a-aec0-be065f15beaa-openshift-service-ca-bundle\") pod \"ensemble-graph-87dcc-698df6b5bc-tdg46\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.434692 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.434673 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31644f98-10f7-469a-aec0-be065f15beaa-proxy-tls\") pod \"ensemble-graph-87dcc-698df6b5bc-tdg46\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.492925 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.492900 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:35.616072 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.616044 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46"] Jul 02 21:42:35.619137 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:42:35.619110 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31644f98_10f7_469a_aec0_be065f15beaa.slice/crio-9173c79a687b6afea4ada137af82b987a176937909038b5b0af566eda1c4b771 WatchSource:0}: Error finding container 9173c79a687b6afea4ada137af82b987a176937909038b5b0af566eda1c4b771: Status 404 returned error can't find the container with id 9173c79a687b6afea4ada137af82b987a176937909038b5b0af566eda1c4b771 Jul 02 21:42:35.989886 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.989850 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" event={"ID":"31644f98-10f7-469a-aec0-be065f15beaa","Type":"ContainerStarted","Data":"b5d97b8ead13dd05b51b188c4515285624ad916bee7b003c15739ae80df5b6b8"} Jul 02 21:42:35.990046 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.989904 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" event={"ID":"31644f98-10f7-469a-aec0-be065f15beaa","Type":"ContainerStarted","Data":"9173c79a687b6afea4ada137af82b987a176937909038b5b0af566eda1c4b771"} Jul 02 21:42:35.990046 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:35.989970 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:42:36.004932 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:36.004887 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podStartSLOduration=1.004871459 podStartE2EDuration="1.004871459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:42:36.004170044 +0000 UTC m=+1454.894093039" watchObservedRunningTime="2026-07-02 21:42:36.004871459 +0000 UTC m=+1454.894794451" Jul 02 21:42:42.000351 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:42:42.000322 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:43:01.032236 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.032203 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2"] Jul 02 21:43:01.035289 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.035272 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.037575 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.037555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8bf58-serving-cert\"" Jul 02 21:43:01.037672 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.037609 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8bf58-kube-rbac-proxy-sar-config\"" Jul 02 21:43:01.043802 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.043777 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2"] Jul 02 21:43:01.126592 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.126560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2daee948-6dcb-4e95-8598-a66d01bbaea4-openshift-service-ca-bundle\") pod \"sequence-graph-8bf58-998d46b48-pwhn2\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.126748 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.126602 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2daee948-6dcb-4e95-8598-a66d01bbaea4-proxy-tls\") pod \"sequence-graph-8bf58-998d46b48-pwhn2\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.227563 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.227531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2daee948-6dcb-4e95-8598-a66d01bbaea4-openshift-service-ca-bundle\") pod \"sequence-graph-8bf58-998d46b48-pwhn2\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.227695 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.227574 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2daee948-6dcb-4e95-8598-a66d01bbaea4-proxy-tls\") pod \"sequence-graph-8bf58-998d46b48-pwhn2\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.228141 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.228112 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2daee948-6dcb-4e95-8598-a66d01bbaea4-openshift-service-ca-bundle\") pod \"sequence-graph-8bf58-998d46b48-pwhn2\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.229879 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.229858 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2daee948-6dcb-4e95-8598-a66d01bbaea4-proxy-tls\") pod \"sequence-graph-8bf58-998d46b48-pwhn2\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.346554 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.346482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:01.474855 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:01.474829 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2"] Jul 02 21:43:01.477103 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:43:01.477077 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daee948_6dcb_4e95_8598_a66d01bbaea4.slice/crio-69d82c3104f3cedf6f8179b9a98aa06928406b2f1aeb096d41bdfe3f45b3c3a1 WatchSource:0}: Error finding container 69d82c3104f3cedf6f8179b9a98aa06928406b2f1aeb096d41bdfe3f45b3c3a1: Status 404 returned error can't find the container with id 69d82c3104f3cedf6f8179b9a98aa06928406b2f1aeb096d41bdfe3f45b3c3a1 Jul 02 21:43:02.087868 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:02.087828 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" event={"ID":"2daee948-6dcb-4e95-8598-a66d01bbaea4","Type":"ContainerStarted","Data":"c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0"} Jul 02 21:43:02.088285 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:02.087886 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:02.088285 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:02.087903 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" event={"ID":"2daee948-6dcb-4e95-8598-a66d01bbaea4","Type":"ContainerStarted","Data":"69d82c3104f3cedf6f8179b9a98aa06928406b2f1aeb096d41bdfe3f45b3c3a1"} Jul 02 21:43:02.104101 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:02.104058 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podStartSLOduration=1.104045255 podStartE2EDuration="1.104045255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:43:02.103585677 +0000 UTC m=+1480.993508668" watchObservedRunningTime="2026-07-02 21:43:02.104045255 +0000 UTC m=+1480.993968245" Jul 02 21:43:08.097079 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:08.097048 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:43:21.621638 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:21.621614 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:43:21.622797 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:43:21.622776 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:48:21.644280 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:48:21.644249 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:48:21.645260 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:48:21.645234 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:50:49.821749 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:50:49.821719 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46"] Jul 02 21:50:49.822361 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:50:49.821919 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" containerID="cri-o://b5d97b8ead13dd05b51b188c4515285624ad916bee7b003c15739ae80df5b6b8" gracePeriod=30 Jul 02 21:50:51.999337 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:50:51.999292 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:50:56.998736 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:50:56.998683 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:01.999291 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:01.999252 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:01.999714 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:01.999350 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:51:06.998875 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:06.998836 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:11.998888 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:11.998847 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:15.738958 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:15.738870 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2"] Jul 02 21:51:15.739358 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:15.739073 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" containerID="cri-o://c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0" gracePeriod=30 Jul 02 21:51:16.999375 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:16.999337 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:18.095001 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:18.094963 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:19.907640 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:19.907608 2554 generic.go:356] "Generic (PLEG): container finished" podID="31644f98-10f7-469a-aec0-be065f15beaa" containerID="b5d97b8ead13dd05b51b188c4515285624ad916bee7b003c15739ae80df5b6b8" exitCode=0 Jul 02 21:51:19.907941 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:19.907638 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" event={"ID":"31644f98-10f7-469a-aec0-be065f15beaa","Type":"ContainerDied","Data":"b5d97b8ead13dd05b51b188c4515285624ad916bee7b003c15739ae80df5b6b8"} Jul 02 21:51:19.958716 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:19.958695 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:51:20.132234 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.132210 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31644f98-10f7-469a-aec0-be065f15beaa-proxy-tls\") pod \"31644f98-10f7-469a-aec0-be065f15beaa\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " Jul 02 21:51:20.132379 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.132264 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31644f98-10f7-469a-aec0-be065f15beaa-openshift-service-ca-bundle\") pod \"31644f98-10f7-469a-aec0-be065f15beaa\" (UID: \"31644f98-10f7-469a-aec0-be065f15beaa\") " Jul 02 21:51:20.132699 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.132668 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31644f98-10f7-469a-aec0-be065f15beaa-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "31644f98-10f7-469a-aec0-be065f15beaa" (UID: "31644f98-10f7-469a-aec0-be065f15beaa"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:51:20.134180 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.134159 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31644f98-10f7-469a-aec0-be065f15beaa-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "31644f98-10f7-469a-aec0-be065f15beaa" (UID: "31644f98-10f7-469a-aec0-be065f15beaa"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:51:20.232862 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.232827 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31644f98-10f7-469a-aec0-be065f15beaa-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:51:20.232862 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.232858 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31644f98-10f7-469a-aec0-be065f15beaa-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:51:20.912529 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.912501 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" Jul 02 21:51:20.912529 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.912517 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46" event={"ID":"31644f98-10f7-469a-aec0-be065f15beaa","Type":"ContainerDied","Data":"9173c79a687b6afea4ada137af82b987a176937909038b5b0af566eda1c4b771"} Jul 02 21:51:20.913068 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.912572 2554 scope.go:117] "RemoveContainer" containerID="b5d97b8ead13dd05b51b188c4515285624ad916bee7b003c15739ae80df5b6b8" Jul 02 21:51:20.932267 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.932245 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46"] Jul 02 21:51:20.935846 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:20.935824 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-87dcc-698df6b5bc-tdg46"] Jul 02 21:51:21.626122 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:21.626086 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31644f98-10f7-469a-aec0-be065f15beaa" path="/var/lib/kubelet/pods/31644f98-10f7-469a-aec0-be065f15beaa/volumes" Jul 02 21:51:23.094842 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:23.094804 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:28.094977 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:28.094938 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:28.095443 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:28.095047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:51:33.094837 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:33.094800 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:38.094927 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:38.094879 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:43.095568 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:43.095530 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:51:45.891926 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:45.891898 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:51:45.917681 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:45.917653 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2daee948-6dcb-4e95-8598-a66d01bbaea4-proxy-tls\") pod \"2daee948-6dcb-4e95-8598-a66d01bbaea4\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " Jul 02 21:51:45.917819 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:45.917696 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2daee948-6dcb-4e95-8598-a66d01bbaea4-openshift-service-ca-bundle\") pod \"2daee948-6dcb-4e95-8598-a66d01bbaea4\" (UID: \"2daee948-6dcb-4e95-8598-a66d01bbaea4\") " Jul 02 21:51:45.918067 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:45.918042 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2daee948-6dcb-4e95-8598-a66d01bbaea4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "2daee948-6dcb-4e95-8598-a66d01bbaea4" (UID: "2daee948-6dcb-4e95-8598-a66d01bbaea4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:51:45.919702 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:45.919678 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2daee948-6dcb-4e95-8598-a66d01bbaea4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2daee948-6dcb-4e95-8598-a66d01bbaea4" (UID: "2daee948-6dcb-4e95-8598-a66d01bbaea4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:51:46.007993 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.007924 2554 generic.go:356] "Generic (PLEG): container finished" podID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerID="c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0" exitCode=0 Jul 02 21:51:46.007993 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.007958 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" event={"ID":"2daee948-6dcb-4e95-8598-a66d01bbaea4","Type":"ContainerDied","Data":"c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0"} Jul 02 21:51:46.007993 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.007970 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" Jul 02 21:51:46.007993 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.007995 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2" event={"ID":"2daee948-6dcb-4e95-8598-a66d01bbaea4","Type":"ContainerDied","Data":"69d82c3104f3cedf6f8179b9a98aa06928406b2f1aeb096d41bdfe3f45b3c3a1"} Jul 02 21:51:46.008264 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.008016 2554 scope.go:117] "RemoveContainer" containerID="c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0" Jul 02 21:51:46.015796 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.015776 2554 scope.go:117] "RemoveContainer" containerID="c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0" Jul 02 21:51:46.016098 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:51:46.016075 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0\": container with ID starting with c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0 not found: ID does not exist" containerID="c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0" Jul 02 21:51:46.016149 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.016112 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0"} err="failed to get container status \"c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0\": rpc error: code = NotFound desc = could not find container \"c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0\": container with ID starting with c404fac524a18f9e0b58a151069cddcd6cfca113520c212e2ddfef69048152b0 not found: ID does not exist" Jul 02 21:51:46.018505 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.018487 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2daee948-6dcb-4e95-8598-a66d01bbaea4-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:51:46.018583 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.018508 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2daee948-6dcb-4e95-8598-a66d01bbaea4-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:51:46.029734 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.029706 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2"] Jul 02 21:51:46.033689 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:46.033669 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bf58-998d46b48-pwhn2"] Jul 02 21:51:47.626572 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:47.626538 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" path="/var/lib/kubelet/pods/2daee948-6dcb-4e95-8598-a66d01bbaea4/volumes" Jul 02 21:51:50.040009 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.039973 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr"] Jul 02 21:51:50.040399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.040278 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" Jul 02 21:51:50.040399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.040291 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" Jul 02 21:51:50.040399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.040307 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" Jul 02 21:51:50.040399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.040313 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" Jul 02 21:51:50.040399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.040363 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="31644f98-10f7-469a-aec0-be065f15beaa" containerName="ensemble-graph-87dcc" Jul 02 21:51:50.040399 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.040370 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2daee948-6dcb-4e95-8598-a66d01bbaea4" containerName="sequence-graph-8bf58" Jul 02 21:51:50.044532 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.044516 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.047057 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.047035 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-c9d16-kube-rbac-proxy-sar-config\"" Jul 02 21:51:50.047167 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.047039 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-c9d16-serving-cert\"" Jul 02 21:51:50.047167 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.047127 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 21:51:50.047167 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.047163 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q64dw\"" Jul 02 21:51:50.050340 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.050312 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr"] Jul 02 21:51:50.150324 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.150293 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls\") pod \"splitter-graph-c9d16-7bdf897478-wv2sr\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.150507 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.150376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-openshift-service-ca-bundle\") pod \"splitter-graph-c9d16-7bdf897478-wv2sr\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.251139 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.251101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-openshift-service-ca-bundle\") pod \"splitter-graph-c9d16-7bdf897478-wv2sr\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.251277 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.251164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls\") pod \"splitter-graph-c9d16-7bdf897478-wv2sr\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.251277 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:51:50.251253 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-c9d16-serving-cert: secret "splitter-graph-c9d16-serving-cert" not found Jul 02 21:51:50.251360 ip-10-0-131-12 kubenswrapper[2554]: E0702 21:51:50.251333 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls podName:4c08cdc4-cf12-4810-80cf-10e1cf34efbd nodeName:}" failed. No retries permitted until 2026-07-02 21:51:50.751315594 +0000 UTC m=+2009.641238563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls") pod "splitter-graph-c9d16-7bdf897478-wv2sr" (UID: "4c08cdc4-cf12-4810-80cf-10e1cf34efbd") : secret "splitter-graph-c9d16-serving-cert" not found Jul 02 21:51:50.251815 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.251798 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-openshift-service-ca-bundle\") pod \"splitter-graph-c9d16-7bdf897478-wv2sr\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.754745 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.754711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls\") pod \"splitter-graph-c9d16-7bdf897478-wv2sr\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.756983 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.756965 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls\") pod \"splitter-graph-c9d16-7bdf897478-wv2sr\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:50.955248 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:50.955214 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:51.080009 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:51.079968 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr"] Jul 02 21:51:51.082762 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:51:51.082734 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c08cdc4_cf12_4810_80cf_10e1cf34efbd.slice/crio-4d0dd327c711c311a9790ba3a222569809ee9df254713a0bea8a8eccd6bdbb1a WatchSource:0}: Error finding container 4d0dd327c711c311a9790ba3a222569809ee9df254713a0bea8a8eccd6bdbb1a: Status 404 returned error can't find the container with id 4d0dd327c711c311a9790ba3a222569809ee9df254713a0bea8a8eccd6bdbb1a Jul 02 21:51:52.031915 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:52.031874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" event={"ID":"4c08cdc4-cf12-4810-80cf-10e1cf34efbd","Type":"ContainerStarted","Data":"079625f2994198f18505169530218e3b17924c15c8ecba3d9a18dc7d777af1f5"} Jul 02 21:51:52.032207 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:52.031930 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:51:52.032207 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:52.031945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" event={"ID":"4c08cdc4-cf12-4810-80cf-10e1cf34efbd","Type":"ContainerStarted","Data":"4d0dd327c711c311a9790ba3a222569809ee9df254713a0bea8a8eccd6bdbb1a"} Jul 02 21:51:52.049090 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:52.049043 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podStartSLOduration=2.049029811 podStartE2EDuration="2.049029811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:51:52.047619476 +0000 UTC m=+2010.937542467" watchObservedRunningTime="2026-07-02 21:51:52.049029811 +0000 UTC m=+2010.938952804" Jul 02 21:51:58.041809 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:51:58.041776 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:52:00.115006 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:00.114975 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr"] Jul 02 21:52:00.115464 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:00.115151 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" containerID="cri-o://079625f2994198f18505169530218e3b17924c15c8ecba3d9a18dc7d777af1f5" gracePeriod=30 Jul 02 21:52:03.040273 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:03.040228 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:52:08.040385 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:08.040351 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:52:13.039799 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:13.039761 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:52:13.040162 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:13.039866 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:52:15.960689 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:15.960652 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c"] Jul 02 21:52:15.963768 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:15.963752 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:15.966474 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:15.966458 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-76a5f-serving-cert\"" Jul 02 21:52:15.966705 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:15.966690 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-76a5f-kube-rbac-proxy-sar-config\"" Jul 02 21:52:15.974610 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:15.974584 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c"] Jul 02 21:52:16.061055 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.061008 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f04fadc-4d0a-4c57-a044-5433343392a0-proxy-tls\") pod \"switch-graph-76a5f-6849bc4b8-95t9c\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:16.061215 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.061114 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f04fadc-4d0a-4c57-a044-5433343392a0-openshift-service-ca-bundle\") pod \"switch-graph-76a5f-6849bc4b8-95t9c\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:16.162222 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.162193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f04fadc-4d0a-4c57-a044-5433343392a0-openshift-service-ca-bundle\") pod \"switch-graph-76a5f-6849bc4b8-95t9c\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:16.162393 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.162241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f04fadc-4d0a-4c57-a044-5433343392a0-proxy-tls\") pod \"switch-graph-76a5f-6849bc4b8-95t9c\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:16.162909 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.162884 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f04fadc-4d0a-4c57-a044-5433343392a0-openshift-service-ca-bundle\") pod \"switch-graph-76a5f-6849bc4b8-95t9c\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:16.164640 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.164622 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f04fadc-4d0a-4c57-a044-5433343392a0-proxy-tls\") pod \"switch-graph-76a5f-6849bc4b8-95t9c\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:16.273857 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.273791 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:16.399040 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:16.399014 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c"] Jul 02 21:52:16.401026 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:52:16.400990 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f04fadc_4d0a_4c57_a044_5433343392a0.slice/crio-bbd3e559767d81837e8f0631e9588dbbeddcd90ecea28018c3aedce0932a8e65 WatchSource:0}: Error finding container bbd3e559767d81837e8f0631e9588dbbeddcd90ecea28018c3aedce0932a8e65: Status 404 returned error can't find the container with id bbd3e559767d81837e8f0631e9588dbbeddcd90ecea28018c3aedce0932a8e65 Jul 02 21:52:17.125023 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:17.124989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" event={"ID":"9f04fadc-4d0a-4c57-a044-5433343392a0","Type":"ContainerStarted","Data":"5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3"} Jul 02 21:52:17.125408 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:17.125045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" event={"ID":"9f04fadc-4d0a-4c57-a044-5433343392a0","Type":"ContainerStarted","Data":"bbd3e559767d81837e8f0631e9588dbbeddcd90ecea28018c3aedce0932a8e65"} Jul 02 21:52:17.125408 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:17.125117 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:17.143696 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:17.143651 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podStartSLOduration=2.143635968 podStartE2EDuration="2.143635968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:52:17.141444152 +0000 UTC m=+2036.031367140" watchObservedRunningTime="2026-07-02 21:52:17.143635968 +0000 UTC m=+2036.033558959" Jul 02 21:52:18.039938 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:18.039905 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:52:23.039518 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:23.039474 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:52:23.134517 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:23.134483 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 21:52:28.040047 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:28.040004 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:52:30.174782 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.174751 2554 generic.go:356] "Generic (PLEG): container finished" podID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerID="079625f2994198f18505169530218e3b17924c15c8ecba3d9a18dc7d777af1f5" exitCode=0 Jul 02 21:52:30.175147 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.174823 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" event={"ID":"4c08cdc4-cf12-4810-80cf-10e1cf34efbd","Type":"ContainerDied","Data":"079625f2994198f18505169530218e3b17924c15c8ecba3d9a18dc7d777af1f5"} Jul 02 21:52:30.259960 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.259938 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:52:30.380165 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.380090 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-openshift-service-ca-bundle\") pod \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " Jul 02 21:52:30.380165 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.380164 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls\") pod \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\" (UID: \"4c08cdc4-cf12-4810-80cf-10e1cf34efbd\") " Jul 02 21:52:30.380490 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.380465 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4c08cdc4-cf12-4810-80cf-10e1cf34efbd" (UID: "4c08cdc4-cf12-4810-80cf-10e1cf34efbd"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:52:30.382134 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.382104 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4c08cdc4-cf12-4810-80cf-10e1cf34efbd" (UID: "4c08cdc4-cf12-4810-80cf-10e1cf34efbd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:52:30.481256 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.481231 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:52:30.481256 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:30.481252 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c08cdc4-cf12-4810-80cf-10e1cf34efbd-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 21:52:31.179650 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:31.179621 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" Jul 02 21:52:31.179650 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:31.179642 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr" event={"ID":"4c08cdc4-cf12-4810-80cf-10e1cf34efbd","Type":"ContainerDied","Data":"4d0dd327c711c311a9790ba3a222569809ee9df254713a0bea8a8eccd6bdbb1a"} Jul 02 21:52:31.180091 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:31.179706 2554 scope.go:117] "RemoveContainer" containerID="079625f2994198f18505169530218e3b17924c15c8ecba3d9a18dc7d777af1f5" Jul 02 21:52:31.199794 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:31.199764 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr"] Jul 02 21:52:31.201356 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:31.201335 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-c9d16-7bdf897478-wv2sr"] Jul 02 21:52:31.626171 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:52:31.626139 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" path="/var/lib/kubelet/pods/4c08cdc4-cf12-4810-80cf-10e1cf34efbd/volumes" Jul 02 21:53:00.333825 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.333789 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc"] Jul 02 21:53:00.334312 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.334074 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" Jul 02 21:53:00.334312 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.334085 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" Jul 02 21:53:00.334312 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.334141 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c08cdc4-cf12-4810-80cf-10e1cf34efbd" containerName="splitter-graph-c9d16" Jul 02 21:53:00.337009 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.336993 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.338941 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.338912 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-67ac0-kube-rbac-proxy-sar-config\"" Jul 02 21:53:00.339054 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.338944 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-67ac0-serving-cert\"" Jul 02 21:53:00.343633 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.343610 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc"] Jul 02 21:53:00.404576 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.404540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7485bd-3a1b-4d01-a7fb-4645671780f1-openshift-service-ca-bundle\") pod \"splitter-graph-67ac0-5f65757465-2w9sc\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.404719 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.404595 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff7485bd-3a1b-4d01-a7fb-4645671780f1-proxy-tls\") pod \"splitter-graph-67ac0-5f65757465-2w9sc\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.505289 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.505249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7485bd-3a1b-4d01-a7fb-4645671780f1-openshift-service-ca-bundle\") pod \"splitter-graph-67ac0-5f65757465-2w9sc\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.505491 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.505300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff7485bd-3a1b-4d01-a7fb-4645671780f1-proxy-tls\") pod \"splitter-graph-67ac0-5f65757465-2w9sc\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.505905 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.505883 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7485bd-3a1b-4d01-a7fb-4645671780f1-openshift-service-ca-bundle\") pod \"splitter-graph-67ac0-5f65757465-2w9sc\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.507611 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.507591 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff7485bd-3a1b-4d01-a7fb-4645671780f1-proxy-tls\") pod \"splitter-graph-67ac0-5f65757465-2w9sc\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.647992 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.647955 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:00.773303 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:00.773178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc"] Jul 02 21:53:00.775893 ip-10-0-131-12 kubenswrapper[2554]: W0702 21:53:00.775864 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7485bd_3a1b_4d01_a7fb_4645671780f1.slice/crio-3a24a09178642819ce07dea0b0c9ea4e15f8cdb4c8982a88813037ac6391625e WatchSource:0}: Error finding container 3a24a09178642819ce07dea0b0c9ea4e15f8cdb4c8982a88813037ac6391625e: Status 404 returned error can't find the container with id 3a24a09178642819ce07dea0b0c9ea4e15f8cdb4c8982a88813037ac6391625e Jul 02 21:53:01.294021 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:01.293989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" event={"ID":"ff7485bd-3a1b-4d01-a7fb-4645671780f1","Type":"ContainerStarted","Data":"0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f"} Jul 02 21:53:01.294205 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:01.294037 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" event={"ID":"ff7485bd-3a1b-4d01-a7fb-4645671780f1","Type":"ContainerStarted","Data":"3a24a09178642819ce07dea0b0c9ea4e15f8cdb4c8982a88813037ac6391625e"} Jul 02 21:53:01.294205 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:01.294127 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:01.311697 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:01.311625 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podStartSLOduration=1.3116105980000001 podStartE2EDuration="1.311610598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:53:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:53:01.310476372 +0000 UTC m=+2080.200399363" watchObservedRunningTime="2026-07-02 21:53:01.311610598 +0000 UTC m=+2080.201533589" Jul 02 21:53:07.302742 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:07.302716 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 21:53:21.666637 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:21.666607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:53:21.667860 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:53:21.667834 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:58:21.687757 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:58:21.687730 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 21:58:21.689539 ip-10-0-131-12 kubenswrapper[2554]: I0702 21:58:21.689518 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 22:01:14.942615 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:14.942584 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc"] Jul 02 22:01:14.943170 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:14.942787 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" containerID="cri-o://0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f" gracePeriod=30 Jul 02 22:01:17.301975 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:17.301938 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:01:22.302392 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:22.302354 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:01:27.301885 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:27.301838 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:01:27.302301 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:27.301978 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 22:01:32.301603 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:32.301565 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:01:37.301597 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:37.301557 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:01:42.301363 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:42.301320 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:01:45.084275 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.084248 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 22:01:45.101953 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.101929 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7485bd-3a1b-4d01-a7fb-4645671780f1-openshift-service-ca-bundle\") pod \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " Jul 02 22:01:45.102098 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.102008 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff7485bd-3a1b-4d01-a7fb-4645671780f1-proxy-tls\") pod \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\" (UID: \"ff7485bd-3a1b-4d01-a7fb-4645671780f1\") " Jul 02 22:01:45.102303 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.102281 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7485bd-3a1b-4d01-a7fb-4645671780f1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ff7485bd-3a1b-4d01-a7fb-4645671780f1" (UID: "ff7485bd-3a1b-4d01-a7fb-4645671780f1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 22:01:45.104380 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.104329 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7485bd-3a1b-4d01-a7fb-4645671780f1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ff7485bd-3a1b-4d01-a7fb-4645671780f1" (UID: "ff7485bd-3a1b-4d01-a7fb-4645671780f1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 22:01:45.178451 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.178399 2554 generic.go:356] "Generic (PLEG): container finished" podID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerID="0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f" exitCode=0 Jul 02 22:01:45.178610 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.178464 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" Jul 02 22:01:45.178610 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.178453 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" event={"ID":"ff7485bd-3a1b-4d01-a7fb-4645671780f1","Type":"ContainerDied","Data":"0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f"} Jul 02 22:01:45.178610 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.178578 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc" event={"ID":"ff7485bd-3a1b-4d01-a7fb-4645671780f1","Type":"ContainerDied","Data":"3a24a09178642819ce07dea0b0c9ea4e15f8cdb4c8982a88813037ac6391625e"} Jul 02 22:01:45.178610 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.178600 2554 scope.go:117] "RemoveContainer" containerID="0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f" Jul 02 22:01:45.186539 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.186519 2554 scope.go:117] "RemoveContainer" containerID="0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f" Jul 02 22:01:45.186793 ip-10-0-131-12 kubenswrapper[2554]: E0702 22:01:45.186775 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f\": container with ID starting with 0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f not found: ID does not exist" containerID="0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f" Jul 02 22:01:45.186861 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.186805 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f"} err="failed to get container status \"0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f\": rpc error: code = NotFound desc = could not find container \"0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f\": container with ID starting with 0242bc66c7be7a96930368b07c80596c48cdfffef2aa69c31657705164835b7f not found: ID does not exist" Jul 02 22:01:45.202807 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.202755 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff7485bd-3a1b-4d01-a7fb-4645671780f1-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 22:01:45.202807 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.202778 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7485bd-3a1b-4d01-a7fb-4645671780f1-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 22:01:45.216880 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.216858 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc"] Jul 02 22:01:45.221288 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.221264 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-67ac0-5f65757465-2w9sc"] Jul 02 22:01:45.626306 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:01:45.626275 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" path="/var/lib/kubelet/pods/ff7485bd-3a1b-4d01-a7fb-4645671780f1/volumes" Jul 02 22:03:21.711573 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:03:21.711500 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 22:03:21.714029 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:03:21.713997 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 22:08:21.732760 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:21.732681 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 22:08:21.736988 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:21.736971 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 22:08:35.235715 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:35.235679 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c"] Jul 02 22:08:35.236208 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:35.235893 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" containerID="cri-o://5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3" gracePeriod=30 Jul 02 22:08:38.133591 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:38.133549 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:08:43.133197 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:43.133151 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:08:48.132725 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:48.132681 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:08:48.133084 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:48.132790 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 22:08:51.928164 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:51.928133 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:52.757966 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:52.757939 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:53.133636 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:53.133604 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:08:53.563630 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:53.563529 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:54.387061 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:54.387021 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:55.207618 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:55.207577 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:56.013736 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:56.013708 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:56.859481 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:56.859447 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:57.672463 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:57.672402 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:58.132949 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:58.132916 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:08:58.485489 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:58.485367 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:08:59.274604 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:08:59.274557 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:09:00.070220 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:00.070187 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:09:00.877981 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:00.877944 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:09:01.683468 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:01.683383 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:09:02.547504 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:02.547474 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-76a5f-6849bc4b8-95t9c_9f04fadc-4d0a-4c57-a044-5433343392a0/switch-graph-76a5f/0.log" Jul 02 22:09:03.132954 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:03.132907 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 22:09:05.381333 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.381311 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 22:09:05.438003 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.437975 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f04fadc-4d0a-4c57-a044-5433343392a0-openshift-service-ca-bundle\") pod \"9f04fadc-4d0a-4c57-a044-5433343392a0\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " Jul 02 22:09:05.438226 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.438053 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f04fadc-4d0a-4c57-a044-5433343392a0-proxy-tls\") pod \"9f04fadc-4d0a-4c57-a044-5433343392a0\" (UID: \"9f04fadc-4d0a-4c57-a044-5433343392a0\") " Jul 02 22:09:05.438449 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.438398 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f04fadc-4d0a-4c57-a044-5433343392a0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9f04fadc-4d0a-4c57-a044-5433343392a0" (UID: "9f04fadc-4d0a-4c57-a044-5433343392a0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 22:09:05.440107 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.440077 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f04fadc-4d0a-4c57-a044-5433343392a0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9f04fadc-4d0a-4c57-a044-5433343392a0" (UID: "9f04fadc-4d0a-4c57-a044-5433343392a0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 22:09:05.538745 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.538660 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f04fadc-4d0a-4c57-a044-5433343392a0-proxy-tls\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 22:09:05.538745 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.538691 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f04fadc-4d0a-4c57-a044-5433343392a0-openshift-service-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 02 22:09:05.785100 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.785064 2554 generic.go:356] "Generic (PLEG): container finished" podID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerID="5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3" exitCode=0 Jul 02 22:09:05.785279 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.785130 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" Jul 02 22:09:05.785279 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.785172 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" event={"ID":"9f04fadc-4d0a-4c57-a044-5433343392a0","Type":"ContainerDied","Data":"5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3"} Jul 02 22:09:05.785279 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.785228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c" event={"ID":"9f04fadc-4d0a-4c57-a044-5433343392a0","Type":"ContainerDied","Data":"bbd3e559767d81837e8f0631e9588dbbeddcd90ecea28018c3aedce0932a8e65"} Jul 02 22:09:05.785279 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.785259 2554 scope.go:117] "RemoveContainer" containerID="5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3" Jul 02 22:09:05.793216 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.793171 2554 scope.go:117] "RemoveContainer" containerID="5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3" Jul 02 22:09:05.793453 ip-10-0-131-12 kubenswrapper[2554]: E0702 22:09:05.793431 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3\": container with ID starting with 5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3 not found: ID does not exist" containerID="5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3" Jul 02 22:09:05.793529 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.793468 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3"} err="failed to get container status \"5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3\": rpc error: code = NotFound desc = could not find container \"5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3\": container with ID starting with 5d6807bced4aa6b39571c3447dd392028300280b16e3307143f0cc6eae38cbc3 not found: ID does not exist" Jul 02 22:09:05.802270 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.802234 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c"] Jul 02 22:09:05.805218 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:05.805188 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-76a5f-6849bc4b8-95t9c"] Jul 02 22:09:07.626330 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:07.626298 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" path="/var/lib/kubelet/pods/9f04fadc-4d0a-4c57-a044-5433343392a0/volumes" Jul 02 22:09:09.173904 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:09.173874 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gn5q7_abfce80c-bd3a-4ec8-b24c-a04cafa23131/global-pull-secret-syncer/0.log" Jul 02 22:09:09.298377 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:09.298346 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w5d26_9fd8d29f-08ab-420f-9b76-8e897399db15/konnectivity-agent/0.log" Jul 02 22:09:09.403007 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:09.402975 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-12.ec2.internal_f8cc86d8d444839b73f1e1fa89fc9a35/haproxy/0.log" Jul 02 22:09:14.102097 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:14.102024 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-df2pm_d6cac955-3771-4c7e-bc77-efc16830d84c/cluster-monitoring-operator/0.log" Jul 02 22:09:14.281390 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:14.281357 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2ww_69b9ba0b-9074-495f-9437-af0d3760114a/node-exporter/0.log" Jul 02 22:09:14.305268 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:14.305243 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2ww_69b9ba0b-9074-495f-9437-af0d3760114a/kube-rbac-proxy/0.log" Jul 02 22:09:14.330209 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:14.330183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c2ww_69b9ba0b-9074-495f-9437-af0d3760114a/init-textfile/0.log" Jul 02 22:09:16.902102 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:16.902070 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/2.log" Jul 02 22:09:16.905558 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:16.905538 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nmd6f_e2d307a8-10e4-49b0-9afc-6aff6d0497e2/console-operator/3.log" Jul 02 22:09:17.323476 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.323371 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w"] Jul 02 22:09:17.323767 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.323749 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" Jul 02 22:09:17.323843 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.323771 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" Jul 02 22:09:17.323843 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.323793 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" Jul 02 22:09:17.323843 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.323801 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" Jul 02 22:09:17.323996 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.323882 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f04fadc-4d0a-4c57-a044-5433343392a0" containerName="switch-graph-76a5f" Jul 02 22:09:17.323996 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.323895 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7485bd-3a1b-4d01-a7fb-4645671780f1" containerName="splitter-graph-67ac0" Jul 02 22:09:17.328319 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.328296 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.331020 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.331002 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-28brx\"/\"kube-root-ca.crt\"" Jul 02 22:09:17.331248 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.331235 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-28brx\"/\"openshift-service-ca.crt\"" Jul 02 22:09:17.331826 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.331811 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-28brx\"/\"default-dockercfg-4gx7c\"" Jul 02 22:09:17.345110 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.345083 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w"] Jul 02 22:09:17.421551 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.421501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-podres\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.421551 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.421551 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2d82\" (UniqueName: \"kubernetes.io/projected/962c7b28-d61f-42bb-8a1e-b3288752ece4-kube-api-access-d2d82\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.421765 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.421597 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-sys\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.421765 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.421614 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-lib-modules\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.421765 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.421632 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-proc\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522399 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522355 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-sys\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522399 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-lib-modules\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-proc\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-podres\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522507 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-sys\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522526 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2d82\" (UniqueName: \"kubernetes.io/projected/962c7b28-d61f-42bb-8a1e-b3288752ece4-kube-api-access-d2d82\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522573 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-lib-modules\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522589 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-proc\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.522669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.522653 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/962c7b28-d61f-42bb-8a1e-b3288752ece4-podres\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.530252 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.530231 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2d82\" (UniqueName: \"kubernetes.io/projected/962c7b28-d61f-42bb-8a1e-b3288752ece4-kube-api-access-d2d82\") pod \"perf-node-gather-daemonset-hfj7w\" (UID: \"962c7b28-d61f-42bb-8a1e-b3288752ece4\") " pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.637935 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.637904 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:17.762669 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.762648 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w"] Jul 02 22:09:17.765337 ip-10-0-131-12 kubenswrapper[2554]: W0702 22:09:17.765310 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod962c7b28_d61f_42bb_8a1e_b3288752ece4.slice/crio-0809f0bdab1b3038ba973eb7def558e38c1c98218e93ce5a65362cc07139028a WatchSource:0}: Error finding container 0809f0bdab1b3038ba973eb7def558e38c1c98218e93ce5a65362cc07139028a: Status 404 returned error can't find the container with id 0809f0bdab1b3038ba973eb7def558e38c1c98218e93ce5a65362cc07139028a Jul 02 22:09:17.829332 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.829300 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" event={"ID":"962c7b28-d61f-42bb-8a1e-b3288752ece4","Type":"ContainerStarted","Data":"0809f0bdab1b3038ba973eb7def558e38c1c98218e93ce5a65362cc07139028a"} Jul 02 22:09:17.968456 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:17.968335 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-vl4cc_3a72569c-8e3f-4837-bf0c-0806319a9866/volume-data-source-validator/0.log" Jul 02 22:09:18.834764 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:18.834728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" event={"ID":"962c7b28-d61f-42bb-8a1e-b3288752ece4","Type":"ContainerStarted","Data":"f87363735efeffa8b39f05e6c72b67c14e4fc2e8c5b632bea412982b23c85359"} Jul 02 22:09:18.834935 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:18.834804 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:18.851200 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:18.851155 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" podStartSLOduration=1.851137104 podStartE2EDuration="1.851137104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 22:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:09:18.850052439 +0000 UTC m=+3057.739975419" watchObservedRunningTime="2026-07-02 22:09:18.851137104 +0000 UTC m=+3057.741060096" Jul 02 22:09:18.969204 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:18.969177 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v6f7m_1049fda3-73e0-488b-9235-a9ad8ecd0f35/dns/0.log" Jul 02 22:09:18.991715 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:18.991688 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v6f7m_1049fda3-73e0-488b-9235-a9ad8ecd0f35/kube-rbac-proxy/0.log" Jul 02 22:09:19.073060 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:19.073032 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gfztc_60156939-3d05-4b01-8292-3718ccd6ccf9/dns-node-resolver/0.log" Jul 02 22:09:19.629906 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:19.629882 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqgrw_804dd64c-2c91-45a9-9a35-5b7914d881e9/node-ca/0.log" Jul 02 22:09:20.431350 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:20.431319 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bf9b5bf9-wx657_4e89b856-d514-4d3c-9598-a717ee9980d2/router/0.log" Jul 02 22:09:20.836249 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:20.836179 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wllr6_a8309612-c115-4433-80fb-25fb0708c372/serve-healthcheck-canary/0.log" Jul 02 22:09:21.177289 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:21.177261 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-w4x6d_481a79ac-3ca8-4ae3-aec9-96837247eafd/insights-operator/0.log" Jul 02 22:09:21.179292 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:21.179266 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-w4x6d_481a79ac-3ca8-4ae3-aec9-96837247eafd/insights-operator/1.log" Jul 02 22:09:21.345339 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:21.345307 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nfvss_b88d1857-f7b5-4e0f-95b6-c450af8df5ee/kube-rbac-proxy/0.log" Jul 02 22:09:21.369689 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:21.369663 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nfvss_b88d1857-f7b5-4e0f-95b6-c450af8df5ee/exporter/0.log" Jul 02 22:09:21.391605 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:21.391576 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nfvss_b88d1857-f7b5-4e0f-95b6-c450af8df5ee/extractor/0.log" Jul 02 22:09:24.848399 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:24.848370 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-28brx/perf-node-gather-daemonset-hfj7w" Jul 02 22:09:28.006533 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:28.006492 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vkljd_4268d712-f549-493d-ae05-61419b4280ba/migrator/0.log" Jul 02 22:09:28.036868 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:28.036842 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vkljd_4268d712-f549-493d-ae05-61419b4280ba/graceful-termination/0.log" Jul 02 22:09:28.396744 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:28.396707 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ggmhq_8f2313b7-516a-4e4e-ba0d-47c39826ff22/kube-storage-version-migrator-operator/1.log" Jul 02 22:09:28.397733 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:28.397706 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ggmhq_8f2313b7-516a-4e4e-ba0d-47c39826ff22/kube-storage-version-migrator-operator/0.log" Jul 02 22:09:29.326895 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.326867 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rww5_26354f55-ef32-4074-9b09-208f03cc5b18/kube-multus-additional-cni-plugins/0.log" Jul 02 22:09:29.348470 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.348447 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rww5_26354f55-ef32-4074-9b09-208f03cc5b18/egress-router-binary-copy/0.log" Jul 02 22:09:29.370951 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.370931 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rww5_26354f55-ef32-4074-9b09-208f03cc5b18/cni-plugins/0.log" Jul 02 22:09:29.394201 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.394178 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rww5_26354f55-ef32-4074-9b09-208f03cc5b18/bond-cni-plugin/0.log" Jul 02 22:09:29.414929 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.414910 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rww5_26354f55-ef32-4074-9b09-208f03cc5b18/routeoverride-cni/0.log" Jul 02 22:09:29.435859 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.435839 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rww5_26354f55-ef32-4074-9b09-208f03cc5b18/whereabouts-cni-bincopy/0.log" Jul 02 22:09:29.459174 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.459139 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rww5_26354f55-ef32-4074-9b09-208f03cc5b18/whereabouts-cni/0.log" Jul 02 22:09:29.897939 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:29.897913 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wv6fc_d9718ee7-0618-4091-a314-4a734bf90c03/kube-multus/0.log" Jul 02 22:09:30.015794 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:30.015765 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p2gmk_46b40c26-be7b-49dc-af65-7067d02f205e/network-metrics-daemon/0.log" Jul 02 22:09:30.035989 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:30.035959 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p2gmk_46b40c26-be7b-49dc-af65-7067d02f205e/kube-rbac-proxy/0.log" Jul 02 22:09:31.285479 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.285450 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/ovn-controller/0.log" Jul 02 22:09:31.306214 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.306187 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/ovn-acl-logging/0.log" Jul 02 22:09:31.330168 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.330140 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/kube-rbac-proxy-node/0.log" Jul 02 22:09:31.359865 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.359836 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 22:09:31.380826 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.380802 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/northd/0.log" Jul 02 22:09:31.402915 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.402893 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/nbdb/0.log" Jul 02 22:09:31.424788 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.424763 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/sbdb/0.log" Jul 02 22:09:31.473171 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:31.473141 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pfkb2_a05ebb61-0f41-416f-b32d-6f8aeaf990c8/ovnkube-controller/0.log" Jul 02 22:09:32.468514 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:32.468481 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-7b4gq_0e40aa46-9b65-4162-835d-29cd892aec65/check-endpoints/0.log" Jul 02 22:09:32.523792 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:32.523763 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-87w6b_c7d35c0e-96e5-4391-aea6-0a6875785994/network-check-target-container/0.log" Jul 02 22:09:33.540407 ip-10-0-131-12 kubenswrapper[2554]: I0702 22:09:33.540380 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8wh8r_f9f1b4d3-efb8-4a53-b441-60280928d211/iptables-alerter/0.log"