Jul 06 23:55:59.977363 ip-10-0-131-246 systemd[1]: Starting Kubernetes Kubelet... Jul 06 23:56:00.405851 ip-10-0-131-246 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:56:00.405851 ip-10-0-131-246 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 23:56:00.405851 ip-10-0-131-246 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:56:00.405851 ip-10-0-131-246 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 23:56:00.405851 ip-10-0-131-246 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:56:00.406701 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.405928 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 23:56:00.410825 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410793 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:56:00.410825 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410819 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:56:00.410825 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410824 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:56:00.410825 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410828 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:56:00.410825 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410833 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410839 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410843 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410847 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410851 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410855 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410858 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410862 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410866 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410869 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410873 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410877 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410881 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410895 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410899 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410903 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410907 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410911 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410915 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410919 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:56:00.411168 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410923 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410927 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410931 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410935 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410939 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410943 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410947 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410952 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410955 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410959 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410962 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410966 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410970 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410974 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410979 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410983 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410987 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410992 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.410999 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:56:00.411942 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411005 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411030 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411036 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411041 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411045 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411050 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411054 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411063 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411067 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411072 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411076 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411080 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411084 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411088 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411094 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411098 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411102 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411106 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411110 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411115 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:56:00.412670 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411119 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411123 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411129 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411133 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411140 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411146 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411154 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411159 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411164 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411169 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411173 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411176 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411181 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411185 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411189 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411192 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411197 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411201 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411204 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:56:00.413334 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411212 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411217 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411221 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411225 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411229 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411233 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411237 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411242 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411246 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411250 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411254 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411260 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411264 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411268 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411272 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411277 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:56:00.414147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.411281 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414388 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414405 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414410 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414420 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414426 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414431 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414435 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414439 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414444 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414449 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414453 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414457 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414461 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414465 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414470 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414479 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414483 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414489 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414493 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:56:00.414895 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414498 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414502 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414507 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414511 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414516 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414520 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414524 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414529 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414533 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414542 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414546 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414550 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414555 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414558 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414564 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414568 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414572 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414577 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414581 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414585 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:56:00.415788 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414589 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414597 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414602 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414606 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414610 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414614 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414618 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414625 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414635 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414642 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414648 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414653 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414658 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414667 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414672 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414677 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414681 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414685 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414690 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:56:00.416696 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414695 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414699 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414703 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414707 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414712 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414717 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414726 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414731 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414735 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414740 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414744 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414748 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414753 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414757 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414761 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414767 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414773 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414777 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414781 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:56:00.417400 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414790 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414797 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414801 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414806 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414810 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414814 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414820 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414824 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414829 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414833 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414837 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414842 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414850 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414855 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414859 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414864 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414869 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414874 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414881 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414887 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:56:00.418080 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414893 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.414897 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416540 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416553 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416558 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416563 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416567 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416571 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416576 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416583 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416590 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416595 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416604 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416609 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416613 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416618 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416622 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416627 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416632 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416637 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:56:00.418567 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416641 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416647 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416651 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416656 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416665 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416670 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416674 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416678 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416683 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416688 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416692 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416696 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416700 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416704 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416708 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416713 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416721 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416726 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416731 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:56:00.419084 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416735 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416740 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416744 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416748 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416753 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416759 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416763 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416767 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416772 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416778 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416788 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416793 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416799 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416804 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416808 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416812 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416817 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416821 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416825 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:56:00.419544 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416829 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416834 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416838 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416847 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416852 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416857 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416862 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416867 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416871 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416875 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416880 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416884 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416888 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416892 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416897 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416901 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416909 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416914 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416918 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416923 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:56:00.420064 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416927 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416932 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416936 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416941 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416945 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416949 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416954 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416959 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416969 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416974 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416978 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416982 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416987 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416991 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.416996 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417001 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417005 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417030 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417035 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:56:00.420559 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417039 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417051 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417057 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.417061 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417310 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417331 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417340 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417345 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417350 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417355 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417371 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417377 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417538 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417542 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417553 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417556 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417559 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417562 2559 flags.go:64] FLAG: --cgroup-root="" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417565 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417568 2559 flags.go:64] FLAG: --client-ca-file="" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417571 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417574 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417579 2559 flags.go:64] FLAG: --cluster-domain="" Jul 06 23:56:00.421033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417582 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417585 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417588 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417591 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417595 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417600 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417603 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417606 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417609 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417612 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417615 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417618 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417621 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417635 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417638 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417641 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417644 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417647 2559 flags.go:64] FLAG: --enable-server="true" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417650 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417655 2559 flags.go:64] FLAG: --event-burst="100" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417657 2559 flags.go:64] FLAG: --event-qps="50" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417660 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417663 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417666 2559 flags.go:64] FLAG: --eviction-hard="" Jul 06 23:56:00.421638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417670 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417673 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417676 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417679 2559 flags.go:64] FLAG: --eviction-soft="" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417681 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417684 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417687 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417690 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417693 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417696 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417699 2559 flags.go:64] FLAG: --feature-gates="" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417703 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417706 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417710 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417714 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417717 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417720 2559 flags.go:64] FLAG: --help="false" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417725 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417728 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417730 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417735 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417739 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417746 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417750 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 23:56:00.422267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417753 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417756 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417759 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417762 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417765 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417768 2559 flags.go:64] FLAG: --kube-reserved="" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417771 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417775 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417781 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417784 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417787 2559 flags.go:64] FLAG: --lock-file="" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417791 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417794 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417797 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417816 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417819 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417823 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417826 2559 flags.go:64] FLAG: --logging-format="text" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417829 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417833 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417835 2559 flags.go:64] FLAG: --manifest-url="" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417839 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417844 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417847 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417851 2559 flags.go:64] FLAG: --max-pods="110" Jul 06 23:56:00.422904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417854 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417857 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417860 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417864 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417867 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417870 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417872 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417881 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417884 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417887 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417890 2559 flags.go:64] FLAG: --pod-cidr="" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417893 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417898 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417902 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417905 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417907 2559 flags.go:64] FLAG: --port="10250" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417910 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417913 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b406b369fc1d712" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417917 2559 flags.go:64] FLAG: --qos-reserved="" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417920 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417922 2559 flags.go:64] FLAG: --register-node="true" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417925 2559 flags.go:64] FLAG: --register-with-taints="" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417929 2559 flags.go:64] FLAG: --registry-burst="10" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417932 2559 flags.go:64] FLAG: --registry-qps="5" Jul 06 23:56:00.423541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417935 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417938 2559 flags.go:64] FLAG: --reserved-memory="" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417941 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417944 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417948 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417950 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417953 2559 flags.go:64] FLAG: --runonce="false" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417956 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417959 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417962 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417965 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417967 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417971 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417974 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417977 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417980 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417983 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417986 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417989 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417992 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417995 2559 flags.go:64] FLAG: --system-cgroups="" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.417998 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418004 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418007 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418023 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 23:56:00.424145 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418028 2559 flags.go:64] FLAG: --tls-min-version="" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418030 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418033 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418036 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418039 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418042 2559 flags.go:64] FLAG: --v="2" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418046 2559 flags.go:64] FLAG: --version="false" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418052 2559 flags.go:64] FLAG: --vmodule="" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418056 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418059 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418189 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418197 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418200 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418203 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418206 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418208 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418211 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418213 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418216 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418218 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418221 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:56:00.424789 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418223 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418226 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418229 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418231 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418234 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418236 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418240 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418244 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418247 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418250 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418252 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418255 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418258 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418260 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418262 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418265 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418268 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418270 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418273 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418276 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:56:00.425352 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418279 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418281 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418285 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418287 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418290 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418293 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418295 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418298 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418301 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418303 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418306 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418308 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418311 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418313 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418316 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418319 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418322 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418324 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418327 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418329 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:56:00.425842 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418332 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418334 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418337 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418339 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418342 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418344 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418347 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418349 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418352 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418354 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418357 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418360 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418362 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418365 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418369 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418371 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418374 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418376 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418379 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418383 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:56:00.426427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418386 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418389 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418392 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418395 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418398 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418401 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418403 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418406 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418408 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418411 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418413 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418416 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418418 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418421 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418423 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418425 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418428 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418430 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418433 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418435 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:56:00.426922 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418439 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418442 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418445 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418448 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418451 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418454 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418458 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.418461 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.418466 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.425860 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.425880 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.426727 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.426734 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426795 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426801 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:56:00.427427 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426804 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426807 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426810 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426813 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426815 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426818 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426821 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426823 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426826 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426828 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426831 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426833 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426836 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426838 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426841 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426844 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426847 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426852 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426855 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426857 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:56:00.427807 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426860 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426863 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426866 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426870 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426874 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426876 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426879 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426882 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426884 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426887 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426890 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426893 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426895 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426898 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426900 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426903 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426906 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426909 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426911 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:56:00.428302 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426914 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426916 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426919 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426921 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426924 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426926 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426929 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426931 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426934 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426936 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426939 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426941 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426944 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426947 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426949 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426952 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426955 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426959 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426962 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426966 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:56:00.428764 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426969 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426972 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426974 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426977 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426980 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426982 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426984 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426987 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426989 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426992 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426994 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426997 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.426999 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427002 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427005 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427022 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427025 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427027 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427030 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:56:00.429258 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427033 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427035 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427038 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427040 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427043 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427046 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427049 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427051 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427054 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427056 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427060 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427063 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427066 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427068 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427071 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427073 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427076 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427079 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:56:00.429729 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427082 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.427087 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427241 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427245 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427248 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427251 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427254 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427257 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427259 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427262 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427264 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427267 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427270 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427272 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427274 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:56:00.430238 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427277 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427279 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427282 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427285 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427288 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427291 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427293 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427296 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427299 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427303 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427307 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427309 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427312 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427315 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427317 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427320 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427322 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427325 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427327 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:56:00.430603 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427329 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427332 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427334 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427336 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427339 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427341 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427344 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427346 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427349 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427351 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427354 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427356 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427359 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427361 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427363 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427366 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427370 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427373 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427376 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:56:00.431147 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427379 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427382 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427385 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427388 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427391 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427394 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427396 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427399 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427401 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427403 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427406 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427408 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427411 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427413 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427416 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427418 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427421 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427423 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427426 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427428 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:56:00.431701 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427431 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427434 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427436 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427439 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427441 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427444 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427446 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427448 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427451 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427453 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427456 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427458 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427460 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427463 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427466 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427468 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427471 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427474 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427477 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427479 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:56:00.432213 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427482 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427484 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427487 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427489 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427492 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427495 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427499 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:00.427501 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.427506 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.427638 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.429796 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.431402 2559 server.go:1019] "Starting client certificate rotation" Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.431522 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:56:00.432704 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.431571 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:56:00.434411 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.434393 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:56:00.435632 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.435600 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:56:00.455675 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.455653 2559 log.go:25] "Validated CRI v1 runtime API" Jul 06 23:56:00.457918 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.457902 2559 log.go:25] "Validated CRI v1 image API" Jul 06 23:56:00.458700 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.458683 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 23:56:00.461296 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.461274 2559 fs.go:135] Filesystem UUIDs: map[4b6e6741-2ba6-49b0-b4fa-7b95924308ca:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9d20f76c-7baa-4c4a-a765-cda3c226a0ba:/dev/nvme0n1p3] Jul 06 23:56:00.461365 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.461293 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 23:56:00.467571 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.467445 2559 manager.go:216] Machine: {Timestamp:2026-07-06 23:56:00.466071358 +0000 UTC m=+0.368882006 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2952112 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dcca0e3dfed130387e022d5e4074b SystemUUID:ec2dcca0-e3df-ed13-0387-e022d5e4074b BootID:6c6ff1e3-0a4d-4d5b-b37d-9eb736a288cf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:35:06:14:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:35:06:14:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:28:28:39:61:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 23:56:00.467571 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.467556 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 23:56:00.467732 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.467649 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 23:56:00.467732 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.467701 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:56:00.471463 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.471434 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 23:56:00.471609 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.471467 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-246.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 23:56:00.472299 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.472288 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 23:56:00.472338 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.472303 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 23:56:00.472338 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.472310 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:56:00.473153 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.473140 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:56:00.474911 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.474898 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 23:56:00.479425 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.479410 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:56:00.479550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.479541 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 23:56:00.479580 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.479575 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 06 23:56:00.479612 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.479596 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 23:56:00.479640 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.479617 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 23:56:00.479640 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.479630 2559 kubelet.go:398] "Adding apiserver pod source" Jul 06 23:56:00.479693 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.479643 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 23:56:00.480051 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.480006 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:56:00.480095 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.480060 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:56:00.483172 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.483155 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 23:56:00.484771 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.484757 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 23:56:00.484817 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.484788 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 23:56:00.486963 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.486950 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 23:56:00.486963 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.486967 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.486973 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.486980 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.486988 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.486994 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.487002 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.487021 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.487028 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.487033 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.487047 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 23:56:00.487075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.487053 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 23:56:00.488846 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.488834 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 23:56:00.488846 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.488845 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 23:56:00.491206 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.491182 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 23:56:00.491283 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.491220 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-246.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 23:56:00.491283 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.491234 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 23:56:00.492200 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.492188 2559 server.go:1268] "Started kubelet" Jul 06 23:56:00.492281 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.492251 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 23:56:00.492470 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.492270 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 23:56:00.492563 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.492513 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 23:56:00.493186 ip-10-0-131-246 systemd[1]: Started Kubernetes Kubelet. Jul 06 23:56:00.494135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.493973 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 23:56:00.494530 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.494515 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 06 23:56:00.498056 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.498030 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 23:56:00.502423 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.502398 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 23:56:00.502423 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.502416 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 23:56:00.502593 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.502555 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:00.503182 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.501478 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-246.ec2.internal.18bfd8a04ee7633c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-246.ec2.internal,UID:ip-10-0-131-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-246.ec2.internal,},FirstTimestamp:2026-07-06 23:56:00.492159804 +0000 UTC m=+0.394970453,LastTimestamp:2026-07-06 23:56:00.492159804 +0000 UTC m=+0.394970453,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-246.ec2.internal,}" Jul 06 23:56:00.503313 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503296 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 23:56:00.503391 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503368 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 23:56:00.503391 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503382 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 23:56:00.503588 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503568 2559 factory.go:55] Registering systemd factory Jul 06 23:56:00.503656 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503594 2559 factory.go:223] Registration of the systemd container factory successfully Jul 06 23:56:00.503656 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503637 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 06 23:56:00.503656 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503648 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 06 23:56:00.503834 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503819 2559 factory.go:153] Registering CRI-O factory Jul 06 23:56:00.503892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503847 2559 factory.go:223] Registration of the crio container factory successfully Jul 06 23:56:00.503941 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503903 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 23:56:00.503941 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503928 2559 factory.go:103] Registering Raw factory Jul 06 23:56:00.504043 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.503943 2559 manager.go:1196] Started watching for new ooms in manager Jul 06 23:56:00.504808 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.504790 2559 manager.go:349] Starting recovery of all containers Jul 06 23:56:00.507774 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.507741 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 23:56:00.507881 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.507827 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 23:56:00.516437 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.516274 2559 manager.go:354] Recovery completed Jul 06 23:56:00.520898 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.520879 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:56:00.522450 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.522427 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-blnzv" Jul 06 23:56:00.522994 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.522978 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:56:00.523072 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.523023 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:56:00.523072 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.523036 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:56:00.523567 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.523552 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 23:56:00.523608 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.523568 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 23:56:00.523608 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.523573 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:56:00.523608 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.523588 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:56:00.524288 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.524272 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:56:00.524357 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.524303 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:56:00.524357 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.524313 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:56:00.525092 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.525001 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-246.ec2.internal.18bfd8a050bde4c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-246.ec2.internal,UID:ip-10-0-131-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-246.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-246.ec2.internal,},FirstTimestamp:2026-07-06 23:56:00.522994884 +0000 UTC m=+0.425805533,LastTimestamp:2026-07-06 23:56:00.522994884 +0000 UTC m=+0.425805533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-246.ec2.internal,}" Jul 06 23:56:00.525803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.525791 2559 policy_none.go:49] "None policy: Start" Jul 06 23:56:00.525842 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.525808 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 23:56:00.525842 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.525819 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 23:56:00.527889 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.527877 2559 policy_none.go:47] "Start" Jul 06 23:56:00.528160 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.528143 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-blnzv" Jul 06 23:56:00.568710 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.568690 2559 manager.go:337] "Starting Device Plugin manager" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.568729 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.568764 2559 server.go:87] "Starting device plugin registration server" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.569079 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.569132 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.569202 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.569300 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.569310 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.569999 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 23:56:00.587461 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.570066 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:00.615584 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.615549 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 23:56:00.616871 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.616857 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 23:56:00.616938 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.616900 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 23:56:00.616938 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.616927 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 23:56:00.617027 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.616966 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 23:56:00.618991 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.618967 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:56:00.670271 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.670176 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:56:00.671796 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.671776 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:56:00.671887 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.671808 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:56:00.671887 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.671819 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:56:00.671887 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.671855 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.681199 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.681175 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.681258 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.681203 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-246.ec2.internal\": node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:00.716922 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.716890 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:00.717473 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.717450 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal"] Jul 06 23:56:00.717533 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.717523 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:56:00.719237 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.719215 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:56:00.719365 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.719248 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:56:00.719365 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.719273 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:56:00.721554 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.721531 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:56:00.721685 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.721669 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.721729 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.721702 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:56:00.722463 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.722446 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:56:00.722569 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.722469 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:56:00.722569 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.722477 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:56:00.722569 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.722516 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:56:00.722569 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.722551 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:56:00.722569 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.722565 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:56:00.724885 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.724865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.724980 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.724901 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:56:00.726305 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.726284 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:56:00.726380 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.726318 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:56:00.726380 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.726332 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:56:00.744927 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.744903 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-246.ec2.internal\" not found" node="ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.749689 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.749671 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-246.ec2.internal\" not found" node="ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.806184 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.806132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/801aa8895e9784a4eed97a3e63d28124-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal\" (UID: \"801aa8895e9784a4eed97a3e63d28124\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.806184 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.806186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/801aa8895e9784a4eed97a3e63d28124-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal\" (UID: \"801aa8895e9784a4eed97a3e63d28124\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.806394 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.806238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61b063d09864a821f799a2f4e68ab1a6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-246.ec2.internal\" (UID: \"61b063d09864a821f799a2f4e68ab1a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.817264 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.817236 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:00.907020 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.906976 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/801aa8895e9784a4eed97a3e63d28124-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal\" (UID: \"801aa8895e9784a4eed97a3e63d28124\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.907154 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.907003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/801aa8895e9784a4eed97a3e63d28124-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal\" (UID: \"801aa8895e9784a4eed97a3e63d28124\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.907154 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.907091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/801aa8895e9784a4eed97a3e63d28124-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal\" (UID: \"801aa8895e9784a4eed97a3e63d28124\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.907154 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.907123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61b063d09864a821f799a2f4e68ab1a6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-246.ec2.internal\" (UID: \"61b063d09864a821f799a2f4e68ab1a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.907253 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.907148 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61b063d09864a821f799a2f4e68ab1a6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-246.ec2.internal\" (UID: \"61b063d09864a821f799a2f4e68ab1a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.907253 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:00.907140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/801aa8895e9784a4eed97a3e63d28124-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal\" (UID: \"801aa8895e9784a4eed97a3e63d28124\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:00.918101 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:00.918062 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.018963 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.018884 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.048087 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.048061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:01.053204 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.053167 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" Jul 06 23:56:01.119435 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.119381 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.219893 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.219856 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.320556 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.320479 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.419549 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.419521 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:56:01.421194 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.421161 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.431354 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.431317 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 23:56:01.431489 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.431471 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:56:01.431533 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.431483 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:56:01.522314 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.522278 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.531476 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.531436 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:51:01 +0000 UTC" deadline="2028-02-02 19:47:36.844300651 +0000 UTC" Jul 06 23:56:01.531476 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.531471 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13819h51m35.312832999s" Jul 06 23:56:01.622641 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.622607 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.630192 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:01.630151 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801aa8895e9784a4eed97a3e63d28124.slice/crio-6e1212dc806de8b3f0384c1ad45b39426691e0adaaafa1e6ea97181c20b2c30f WatchSource:0}: Error finding container 6e1212dc806de8b3f0384c1ad45b39426691e0adaaafa1e6ea97181c20b2c30f: Status 404 returned error can't find the container with id 6e1212dc806de8b3f0384c1ad45b39426691e0adaaafa1e6ea97181c20b2c30f Jul 06 23:56:01.630552 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:01.630532 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b063d09864a821f799a2f4e68ab1a6.slice/crio-b0d2a12ec4f92b04b7937ba4136c3aed8ba9deed4e514c9b0d6d5b86e00ce7df WatchSource:0}: Error finding container b0d2a12ec4f92b04b7937ba4136c3aed8ba9deed4e514c9b0d6d5b86e00ce7df: Status 404 returned error can't find the container with id b0d2a12ec4f92b04b7937ba4136c3aed8ba9deed4e514c9b0d6d5b86e00ce7df Jul 06 23:56:01.635624 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.635600 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:56:01.723532 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.723490 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.823757 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:01.823733 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-246.ec2.internal\" not found" Jul 06 23:56:01.825904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:01.825885 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:56:02.937957 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:02.937931 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:56:02.944994 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:02.944969 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" Jul 06 23:56:02.956864 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:02.956840 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:56:02.957941 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:02.957924 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" Jul 06 23:56:02.979209 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:02.979173 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:56:03.522901 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.522870 2559 apiserver.go:52] "Watching apiserver" Jul 06 23:56:03.533685 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.533642 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 23:56:03.534115 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.534082 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5","openshift-multus/multus-9gcsl","openshift-multus/network-metrics-daemon-v7zbh","openshift-network-operator/iptables-alerter-bb852","openshift-ovn-kubernetes/ovnkube-node-8h5th","kube-system/global-pull-secret-syncer-kgzw2","openshift-cluster-node-tuning-operator/tuned-q9jhh","openshift-dns/node-resolver-4fb8x","openshift-image-registry/node-ca-m58pd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal","openshift-multus/multus-additional-cni-plugins-ftpxs","openshift-network-diagnostics/network-check-target-zxd8t","kube-system/konnectivity-agent-r66zn"] Jul 06 23:56:03.537093 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.536723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.539388 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.538965 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.539745 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.539728 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 23:56:03.539840 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.539728 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-llfkr\"" Jul 06 23:56:03.540059 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.540021 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 23:56:03.540059 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.540042 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 23:56:03.541265 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.541244 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.541402 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.541244 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 23:56:03.542050 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.542031 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 23:56:03.542444 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.542426 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vjxhh\"" Jul 06 23:56:03.542701 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.542684 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 23:56:03.542898 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.542879 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 23:56:03.543049 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.543032 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 23:56:03.543349 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.543334 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 23:56:03.543519 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.543498 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:03.543642 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.543588 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:03.543777 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.543758 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bsc6f\"" Jul 06 23:56:03.544775 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.544488 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 23:56:03.545668 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.545634 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.547985 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.547963 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 23:56:03.548073 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.547984 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.549055 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.549019 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 23:56:03.549367 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.549350 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xxfhz\"" Jul 06 23:56:03.551832 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.551673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.554661 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.553849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:03.554661 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.553946 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:03.555129 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.554789 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dsjpt\"" Jul 06 23:56:03.555129 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.554820 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:56:03.555623 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.555601 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 23:56:03.555737 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.555665 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 23:56:03.556002 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.555974 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bz4s5\"" Jul 06 23:56:03.556089 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.556051 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 23:56:03.556488 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.556474 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.558342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfvcc\" (UniqueName: \"kubernetes.io/projected/cfb5c705-430c-47cb-956f-42a94a8fba69-kube-api-access-wfvcc\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:03.558434 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa-agent-certs\") pod \"konnectivity-agent-r66zn\" (UID: \"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa\") " pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.558434 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558373 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/162adc1c-09fc-41a5-8405-27851cc2aa30-host\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.558434 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-kubelet\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-conf-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2963e01f-2fdf-4f82-9b28-bece51715897-multus-daemon-config\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:03.558589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/162adc1c-09fc-41a5-8405-27851cc2aa30-serviceca\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.558589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-cnibin\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-socket-dir-parent\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-cni-multus\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-cni-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-k8s-cni-cncf-io\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-netns\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558752 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxvf2\" (UniqueName: \"kubernetes.io/projected/2963e01f-2fdf-4f82-9b28-bece51715897-kube-api-access-gxvf2\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-os-release\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558801 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnk29\" (UniqueName: \"kubernetes.io/projected/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-kube-api-access-xnk29\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-os-release\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-cni-bin\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.558892 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpzqw\" (UniqueName: \"kubernetes.io/projected/162adc1c-09fc-41a5-8405-27851cc2aa30-kube-api-access-gpzqw\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cnibin\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558961 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-hostroot\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.558997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa-konnectivity-ca\") pod \"konnectivity-agent-r66zn\" (UID: \"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa\") " pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-system-cni-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-system-cni-dir\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-multus-certs\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2963e01f-2fdf-4f82-9b28-bece51715897-cni-binary-copy\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-etc-kubernetes\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.559364 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559306 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gkwdr\"" Jul 06 23:56:03.559900 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 23:56:03.559900 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559537 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 23:56:03.559900 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559573 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:56:03.559900 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.559719 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.559900 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.559791 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:03.561335 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.561316 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.563974 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.563951 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.566368 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.566099 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 23:56:03.566368 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.566123 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 23:56:03.566368 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.566122 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dwxvx\"" Jul 06 23:56:03.566368 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.566181 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 23:56:03.566368 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.566106 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 23:56:03.566368 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.566369 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 23:56:03.567390 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.567373 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 23:56:03.567853 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.567831 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 23:56:03.567853 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.567846 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:56:03.567987 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.567917 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 23:56:03.568264 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.568243 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hcl9l\"" Jul 06 23:56:03.580060 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.580043 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nt6fc" Jul 06 23:56:03.589243 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.589212 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nt6fc" Jul 06 23:56:03.645865 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.645841 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 23:56:03.660333 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-modprobe-d\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.660333 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.660543 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-device-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.660543 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpzqw\" (UniqueName: \"kubernetes.io/projected/162adc1c-09fc-41a5-8405-27851cc2aa30-kube-api-access-gpzqw\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.660543 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.660690 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa-konnectivity-ca\") pod \"konnectivity-agent-r66zn\" (UID: \"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa\") " pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.660751 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9712533-d321-4629-a580-506946b47bc0-host-slash\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.660802 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-system-cni-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.660850 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-host\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.660850 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-socket-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.660977 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-system-cni-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.660977 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.660977 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-systemd\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.660977 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.660977 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.660961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.661191 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661174 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.661241 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa-konnectivity-ca\") pod \"konnectivity-agent-r66zn\" (UID: \"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa\") " pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.661451 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-multus-certs\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.661518 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-var-lib-kubelet\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.661518 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661507 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-multus-certs\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.661618 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-systemd-units\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.661618 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-etc-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.661724 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661609 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2963e01f-2fdf-4f82-9b28-bece51715897-cni-binary-copy\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.661724 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa-agent-certs\") pod \"konnectivity-agent-r66zn\" (UID: \"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa\") " pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.661724 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-var-lib-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.661724 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovnkube-script-lib\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-conf-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2963e01f-2fdf-4f82-9b28-bece51715897-multus-daemon-config\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9712533-d321-4629-a580-506946b47bc0-iptables-alerter-script\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-socket-dir-parent\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysctl-d\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/308c73b8-ba95-43ce-8ea5-1e412bc6317e-tmp\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661945 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e9be49f-c961-4384-895b-40317cc397f2-hosts-file\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.661973 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovn-node-metrics-cert\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.661995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-netns\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662020 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxvf2\" (UniqueName: \"kubernetes.io/projected/2963e01f-2fdf-4f82-9b28-bece51715897-kube-api-access-gxvf2\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-slash\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bhqc\" (UniqueName: \"kubernetes.io/projected/a9712533-d321-4629-a580-506946b47bc0-kube-api-access-6bhqc\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-conf-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnk29\" (UniqueName: \"kubernetes.io/projected/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-kube-api-access-xnk29\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2963e01f-2fdf-4f82-9b28-bece51715897-cni-binary-copy\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cnibin\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-hostroot\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cnibin\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b63f8f2-0579-4181-bdea-f9934aa9c91c-kubelet-config\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662263 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-socket-dir-parent\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.662310 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-cni-bin\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.662828 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2963e01f-2fdf-4f82-9b28-bece51715897-multus-daemon-config\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.662943 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.662922 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 23:56:03.663022 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-hostroot\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.663089 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7rt\" (UniqueName: \"kubernetes.io/projected/308c73b8-ba95-43ce-8ea5-1e412bc6317e-kube-api-access-xr7rt\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.663141 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e9be49f-c961-4384-895b-40317cc397f2-tmp-dir\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.663200 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663173 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-registration-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.663396 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-system-cni-dir\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.663507 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663411 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.663507 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.663610 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysctl-conf\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.663610 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-lib-modules\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.663610 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-tuned\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.663813 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-system-cni-dir\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.663961 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.664027 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.663995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8wmb\" (UniqueName: \"kubernetes.io/projected/4e9be49f-c961-4384-895b-40317cc397f2-kube-api-access-j8wmb\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.664202 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-netns\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.664271 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.664424 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-etc-kubernetes\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.664424 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfvcc\" (UniqueName: \"kubernetes.io/projected/cfb5c705-430c-47cb-956f-42a94a8fba69-kube-api-access-wfvcc\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:03.664587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-systemd\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.664587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-sys\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.664587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbf4w\" (UniqueName: \"kubernetes.io/projected/34cc011d-9d00-462f-94bf-0a15148a8d63-kube-api-access-dbf4w\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.664587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-log-socket\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.664795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-env-overrides\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.664795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-etc-kubernetes\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.664795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/162adc1c-09fc-41a5-8405-27851cc2aa30-host\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.664795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-kubelet\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.664795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-kubelet\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-run-netns\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/162adc1c-09fc-41a5-8405-27851cc2aa30-serviceca\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-cnibin\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-cni-multus\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysconfig\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.664978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:03.665028 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b63f8f2-0579-4181-bdea-f9934aa9c91c-dbus\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.665345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-node-log\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.665345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665112 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.665345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665197 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-cni-netd\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.665345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-cni-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.665345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-k8s-cni-cncf-io\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.665345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-kubernetes\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.665345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-run\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.665702 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-sys-fs\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.665702 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-ovn\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.665702 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovnkube-config\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.665702 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wfcq\" (UniqueName: \"kubernetes.io/projected/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-kube-api-access-8wfcq\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.665702 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-os-release\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.665702 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-os-release\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.665702 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-cni-bin\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.666018 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.665707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-cni-bin\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.666018 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.665799 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:03.666018 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.665871 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs podName:cfb5c705-430c-47cb-956f-42a94a8fba69 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:04.1658493 +0000 UTC m=+3.027021038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs") pod "network-metrics-daemon-v7zbh" (UID: "cfb5c705-430c-47cb-956f-42a94a8fba69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:03.666178 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.666144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/162adc1c-09fc-41a5-8405-27851cc2aa30-host\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.666259 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.666198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-kubelet\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.666622 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.666601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/162adc1c-09fc-41a5-8405-27851cc2aa30-serviceca\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.666755 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.666701 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-cnibin\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.666833 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.666749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-var-lib-cni-multus\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.666989 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.666968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-os-release\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.667064 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.666968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-os-release\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.667064 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.667008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.667177 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.667109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-multus-cni-dir\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.667177 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.667133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2963e01f-2fdf-4f82-9b28-bece51715897-host-run-k8s-cni-cncf-io\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.667728 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.667673 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" event={"ID":"801aa8895e9784a4eed97a3e63d28124","Type":"ContainerStarted","Data":"6e1212dc806de8b3f0384c1ad45b39426691e0adaaafa1e6ea97181c20b2c30f"} Jul 06 23:56:03.668846 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.668811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa-agent-certs\") pod \"konnectivity-agent-r66zn\" (UID: \"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa\") " pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.669783 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.669760 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" event={"ID":"61b063d09864a821f799a2f4e68ab1a6","Type":"ContainerStarted","Data":"b0d2a12ec4f92b04b7937ba4136c3aed8ba9deed4e514c9b0d6d5b86e00ce7df"} Jul 06 23:56:03.680069 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.679989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpzqw\" (UniqueName: \"kubernetes.io/projected/162adc1c-09fc-41a5-8405-27851cc2aa30-kube-api-access-gpzqw\") pod \"node-ca-m58pd\" (UID: \"162adc1c-09fc-41a5-8405-27851cc2aa30\") " pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.680069 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.680004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxvf2\" (UniqueName: \"kubernetes.io/projected/2963e01f-2fdf-4f82-9b28-bece51715897-kube-api-access-gxvf2\") pod \"multus-9gcsl\" (UID: \"2963e01f-2fdf-4f82-9b28-bece51715897\") " pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.680323 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.680299 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnk29\" (UniqueName: \"kubernetes.io/projected/24dd8dac-b62a-44a4-92d1-4dd8b0bd882f-kube-api-access-xnk29\") pod \"multus-additional-cni-plugins-ftpxs\" (UID: \"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f\") " pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.681875 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.681851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfvcc\" (UniqueName: \"kubernetes.io/projected/cfb5c705-430c-47cb-956f-42a94a8fba69-kube-api-access-wfvcc\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:03.766559 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.766559 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b63f8f2-0579-4181-bdea-f9934aa9c91c-kubelet-config\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-cni-bin\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7rt\" (UniqueName: \"kubernetes.io/projected/308c73b8-ba95-43ce-8ea5-1e412bc6317e-kube-api-access-xr7rt\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e9be49f-c961-4384-895b-40317cc397f2-tmp-dir\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-registration-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-cni-bin\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysctl-conf\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-lib-modules\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766748 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-registration-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-tuned\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.766820 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766802 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8wmb\" (UniqueName: \"kubernetes.io/projected/4e9be49f-c961-4384-895b-40317cc397f2-kube-api-access-j8wmb\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-systemd\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-sys\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysctl-conf\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbf4w\" (UniqueName: \"kubernetes.io/projected/34cc011d-9d00-462f-94bf-0a15148a8d63-kube-api-access-dbf4w\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-systemd\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-log-socket\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-env-overrides\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-kubelet\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-sys\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.766694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b63f8f2-0579-4181-bdea-f9934aa9c91c-kubelet-config\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e9be49f-c961-4384-895b-40317cc397f2-tmp-dir\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-run-netns\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-log-socket\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysconfig\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-kubelet\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b63f8f2-0579-4181-bdea-f9934aa9c91c-dbus\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.767342 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-node-log\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-lib-modules\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-cni-netd\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysconfig\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-run-netns\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-kubernetes\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-node-log\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767249 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-cni-netd\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-run\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b63f8f2-0579-4181-bdea-f9934aa9c91c-dbus\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-sys-fs\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-run\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-ovn\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767343 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovnkube-config\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-sys-fs\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wfcq\" (UniqueName: \"kubernetes.io/projected/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-kube-api-access-8wfcq\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-ovn\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-modprobe-d\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-device-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767483 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9712533-d321-4629-a580-506946b47bc0-host-slash\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-host\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767530 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-socket-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767580 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-systemd\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-env-overrides\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-systemd\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-host\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-device-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-kubernetes\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-modprobe-d\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-var-lib-kubelet\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.767756 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767755 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-socket-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.768854 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34cc011d-9d00-462f-94bf-0a15148a8d63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-systemd-units\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-run-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-systemd-units\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.767833 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret podName:6b63f8f2-0579-4181-bdea-f9934aa9c91c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:04.26779151 +0000 UTC m=+3.128963230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret") pod "global-pull-secret-syncer-kgzw2" (UID: "6b63f8f2-0579-4181-bdea-f9934aa9c91c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767839 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9712533-d321-4629-a580-506946b47bc0-host-slash\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767859 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-etc-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-var-lib-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovnkube-script-lib\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-etc-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-var-lib-openvswitch\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-var-lib-kubelet\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.767965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9712533-d321-4629-a580-506946b47bc0-iptables-alerter-script\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysctl-d\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.769400 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/308c73b8-ba95-43ce-8ea5-1e412bc6317e-tmp\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovnkube-config\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e9be49f-c961-4384-895b-40317cc397f2-hosts-file\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovn-node-metrics-cert\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-slash\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-sysctl-d\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768179 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bhqc\" (UniqueName: \"kubernetes.io/projected/a9712533-d321-4629-a580-506946b47bc0-kube-api-access-6bhqc\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768211 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-host-slash\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768262 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e9be49f-c961-4384-895b-40317cc397f2-hosts-file\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9712533-d321-4629-a580-506946b47bc0-iptables-alerter-script\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.768713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovnkube-script-lib\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.769962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.769924 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/308c73b8-ba95-43ce-8ea5-1e412bc6317e-etc-tuned\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.770389 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.770371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-ovn-node-metrics-cert\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.770530 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.770513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/308c73b8-ba95-43ce-8ea5-1e412bc6317e-tmp\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.775682 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.775594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8wmb\" (UniqueName: \"kubernetes.io/projected/4e9be49f-c961-4384-895b-40317cc397f2-kube-api-access-j8wmb\") pod \"node-resolver-4fb8x\" (UID: \"4e9be49f-c961-4384-895b-40317cc397f2\") " pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.776016 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.775994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7rt\" (UniqueName: \"kubernetes.io/projected/308c73b8-ba95-43ce-8ea5-1e412bc6317e-kube-api-access-xr7rt\") pod \"tuned-q9jhh\" (UID: \"308c73b8-ba95-43ce-8ea5-1e412bc6317e\") " pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.777495 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.777472 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:56:03.777495 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.777496 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:56:03.777674 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.777511 2559 projected.go:196] Error preparing data for projected volume kube-api-access-ss9wl for pod openshift-network-diagnostics/network-check-target-zxd8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:03.777674 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:03.777580 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl podName:2479bb42-8207-49a7-af59-5ede1b14fed2 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:04.277561677 +0000 UTC m=+3.138733395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ss9wl" (UniqueName: "kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl") pod "network-check-target-zxd8t" (UID: "2479bb42-8207-49a7-af59-5ede1b14fed2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:03.779315 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.779296 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbf4w\" (UniqueName: \"kubernetes.io/projected/34cc011d-9d00-462f-94bf-0a15148a8d63-kube-api-access-dbf4w\") pod \"aws-ebs-csi-driver-node-h8jn5\" (UID: \"34cc011d-9d00-462f-94bf-0a15148a8d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.779829 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.779808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bhqc\" (UniqueName: \"kubernetes.io/projected/a9712533-d321-4629-a580-506946b47bc0-kube-api-access-6bhqc\") pod \"iptables-alerter-bb852\" (UID: \"a9712533-d321-4629-a580-506946b47bc0\") " pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:03.779829 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.779826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wfcq\" (UniqueName: \"kubernetes.io/projected/c92a0ae4-ec16-4c68-9a07-3c4f4a86966d-kube-api-access-8wfcq\") pod \"ovnkube-node-8h5th\" (UID: \"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.848906 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.848868 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m58pd" Jul 06 23:56:03.862264 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.862235 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" Jul 06 23:56:03.872178 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.872156 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9gcsl" Jul 06 23:56:03.876944 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.876923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:03.882640 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.882620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" Jul 06 23:56:03.890367 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.890349 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fb8x" Jul 06 23:56:03.899072 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.899051 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" Jul 06 23:56:03.906791 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.906774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:03.914402 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:03.914383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb852" Jul 06 23:56:04.045766 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:04.045678 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:56:04.172226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:04.172185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:04.172375 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.172335 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:04.172409 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.172403 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs podName:cfb5c705-430c-47cb-956f-42a94a8fba69 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:05.172387522 +0000 UTC m=+4.033559240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs") pod "network-metrics-daemon-v7zbh" (UID: "cfb5c705-430c-47cb-956f-42a94a8fba69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:04.272940 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:04.272899 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:04.273128 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.273024 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:04.273128 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.273092 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret podName:6b63f8f2-0579-4181-bdea-f9934aa9c91c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:05.273070663 +0000 UTC m=+4.134242382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret") pod "global-pull-secret-syncer-kgzw2" (UID: "6b63f8f2-0579-4181-bdea-f9934aa9c91c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:04.374321 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:04.374229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:04.374486 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.374365 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:56:04.374486 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.374385 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:56:04.374486 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.374398 2559 projected.go:196] Error preparing data for projected volume kube-api-access-ss9wl for pod openshift-network-diagnostics/network-check-target-zxd8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:04.374486 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.374467 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl podName:2479bb42-8207-49a7-af59-5ede1b14fed2 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:05.374451226 +0000 UTC m=+4.235622952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ss9wl" (UniqueName: "kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl") pod "network-check-target-zxd8t" (UID: "2479bb42-8207-49a7-af59-5ede1b14fed2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:04.592697 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:04.592639 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:51:03 +0000 UTC" deadline="2028-02-03 03:37:50.306965788 +0000 UTC" Jul 06 23:56:04.592697 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:04.592691 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13827h41m45.714280042s" Jul 06 23:56:04.659774 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:04.659700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:04.659906 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:04.659808 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:04.713191 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.713159 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24dd8dac_b62a_44a4_92d1_4dd8b0bd882f.slice/crio-1aad78e35ffe3fd6f059f9b26c610db3907b27cd47297a2769a8db03d2b1c763 WatchSource:0}: Error finding container 1aad78e35ffe3fd6f059f9b26c610db3907b27cd47297a2769a8db03d2b1c763: Status 404 returned error can't find the container with id 1aad78e35ffe3fd6f059f9b26c610db3907b27cd47297a2769a8db03d2b1c763 Jul 06 23:56:04.716186 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.716153 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9be49f_c961_4384_895b_40317cc397f2.slice/crio-aa596668368fbe71503e7e2a590eafb55029ece8f918a0aebc6ae966ec64ee24 WatchSource:0}: Error finding container aa596668368fbe71503e7e2a590eafb55029ece8f918a0aebc6ae966ec64ee24: Status 404 returned error can't find the container with id aa596668368fbe71503e7e2a590eafb55029ece8f918a0aebc6ae966ec64ee24 Jul 06 23:56:04.718277 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.718259 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308c73b8_ba95_43ce_8ea5_1e412bc6317e.slice/crio-718eeecae665d42c4f259c6de418ece631d986bbaa8ff0e22d06d853061c1c69 WatchSource:0}: Error finding container 718eeecae665d42c4f259c6de418ece631d986bbaa8ff0e22d06d853061c1c69: Status 404 returned error can't find the container with id 718eeecae665d42c4f259c6de418ece631d986bbaa8ff0e22d06d853061c1c69 Jul 06 23:56:04.719661 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.719614 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162adc1c_09fc_41a5_8405_27851cc2aa30.slice/crio-6a358b3416a4d9770f97b799fe83e37d185f61a6574ad404ee4aec8a9bd79ada WatchSource:0}: Error finding container 6a358b3416a4d9770f97b799fe83e37d185f61a6574ad404ee4aec8a9bd79ada: Status 404 returned error can't find the container with id 6a358b3416a4d9770f97b799fe83e37d185f61a6574ad404ee4aec8a9bd79ada Jul 06 23:56:04.721163 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.721144 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92a0ae4_ec16_4c68_9a07_3c4f4a86966d.slice/crio-f4a8ef597a0c03009f88011dd7839ab1864be38c93388a10362adcb257356fad WatchSource:0}: Error finding container f4a8ef597a0c03009f88011dd7839ab1864be38c93388a10362adcb257356fad: Status 404 returned error can't find the container with id f4a8ef597a0c03009f88011dd7839ab1864be38c93388a10362adcb257356fad Jul 06 23:56:04.728663 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.728629 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2963e01f_2fdf_4f82_9b28_bece51715897.slice/crio-daa38ee3f4a14bf5c85d2fa76b3bbc74dc53766d66b7579010bcde73e744cdf3 WatchSource:0}: Error finding container daa38ee3f4a14bf5c85d2fa76b3bbc74dc53766d66b7579010bcde73e744cdf3: Status 404 returned error can't find the container with id daa38ee3f4a14bf5c85d2fa76b3bbc74dc53766d66b7579010bcde73e744cdf3 Jul 06 23:56:04.736743 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.736716 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9712533_d321_4629_a580_506946b47bc0.slice/crio-70ed34c38c9445a62a0eb5acaa88edd8ae2e74054baa5b488ed25325bc35f083 WatchSource:0}: Error finding container 70ed34c38c9445a62a0eb5acaa88edd8ae2e74054baa5b488ed25325bc35f083: Status 404 returned error can't find the container with id 70ed34c38c9445a62a0eb5acaa88edd8ae2e74054baa5b488ed25325bc35f083 Jul 06 23:56:04.737813 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:04.737793 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cc011d_9d00_462f_94bf_0a15148a8d63.slice/crio-50dd3947f3704ea97957f00b2fd5eb6e21cec68092b758e98d188967e657af0c WatchSource:0}: Error finding container 50dd3947f3704ea97957f00b2fd5eb6e21cec68092b758e98d188967e657af0c: Status 404 returned error can't find the container with id 50dd3947f3704ea97957f00b2fd5eb6e21cec68092b758e98d188967e657af0c Jul 06 23:56:05.109147 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.108919 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:56:05.181279 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.181241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:05.181460 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.181438 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:05.181520 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.181502 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs podName:cfb5c705-430c-47cb-956f-42a94a8fba69 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:07.181483585 +0000 UTC m=+6.042655319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs") pod "network-metrics-daemon-v7zbh" (UID: "cfb5c705-430c-47cb-956f-42a94a8fba69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:05.282784 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.282699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:05.282949 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.282877 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:05.282949 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.282946 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret podName:6b63f8f2-0579-4181-bdea-f9934aa9c91c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:07.282926542 +0000 UTC m=+6.144098263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret") pod "global-pull-secret-syncer-kgzw2" (UID: "6b63f8f2-0579-4181-bdea-f9934aa9c91c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:05.384139 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.383482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:05.384139 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.383678 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:56:05.384139 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.383699 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:56:05.384139 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.383712 2559 projected.go:196] Error preparing data for projected volume kube-api-access-ss9wl for pod openshift-network-diagnostics/network-check-target-zxd8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:05.384139 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.383773 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl podName:2479bb42-8207-49a7-af59-5ede1b14fed2 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:07.38375469 +0000 UTC m=+6.244926426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ss9wl" (UniqueName: "kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl") pod "network-check-target-zxd8t" (UID: "2479bb42-8207-49a7-af59-5ede1b14fed2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:05.593023 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.592841 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:51:03 +0000 UTC" deadline="2027-12-24 22:57:44.354495695 +0000 UTC" Jul 06 23:56:05.593023 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.592905 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12863h1m38.761595601s" Jul 06 23:56:05.661829 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.661798 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:05.661986 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.661940 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:05.662056 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.662020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:05.662104 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:05.662087 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:05.682954 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.682917 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" event={"ID":"34cc011d-9d00-462f-94bf-0a15148a8d63","Type":"ContainerStarted","Data":"50dd3947f3704ea97957f00b2fd5eb6e21cec68092b758e98d188967e657af0c"} Jul 06 23:56:05.703587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.703498 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m58pd" event={"ID":"162adc1c-09fc-41a5-8405-27851cc2aa30","Type":"ContainerStarted","Data":"6a358b3416a4d9770f97b799fe83e37d185f61a6574ad404ee4aec8a9bd79ada"} Jul 06 23:56:05.712323 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.712222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb852" event={"ID":"a9712533-d321-4629-a580-506946b47bc0","Type":"ContainerStarted","Data":"70ed34c38c9445a62a0eb5acaa88edd8ae2e74054baa5b488ed25325bc35f083"} Jul 06 23:56:05.717679 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.717626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r66zn" event={"ID":"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa","Type":"ContainerStarted","Data":"ed3cbcf7bde6ade19a8b94f69e79cf355d424d8662728ea5b0e130b989ce7567"} Jul 06 23:56:05.731020 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.730976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"f4a8ef597a0c03009f88011dd7839ab1864be38c93388a10362adcb257356fad"} Jul 06 23:56:05.745335 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.745099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" event={"ID":"308c73b8-ba95-43ce-8ea5-1e412bc6317e","Type":"ContainerStarted","Data":"718eeecae665d42c4f259c6de418ece631d986bbaa8ff0e22d06d853061c1c69"} Jul 06 23:56:05.760936 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.760899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerStarted","Data":"1aad78e35ffe3fd6f059f9b26c610db3907b27cd47297a2769a8db03d2b1c763"} Jul 06 23:56:05.773508 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.773466 2559 generic.go:356] "Generic (PLEG): container finished" podID="801aa8895e9784a4eed97a3e63d28124" containerID="c8e1edd62df5cfa108dac15a625209bec67c1ac1d6f5a8fb7c62e9514c6ecd5a" exitCode=0 Jul 06 23:56:05.773710 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.773564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" event={"ID":"801aa8895e9784a4eed97a3e63d28124","Type":"ContainerDied","Data":"c8e1edd62df5cfa108dac15a625209bec67c1ac1d6f5a8fb7c62e9514c6ecd5a"} Jul 06 23:56:05.804622 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.804308 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" event={"ID":"61b063d09864a821f799a2f4e68ab1a6","Type":"ContainerStarted","Data":"8e22266b263d93f0d0d17c8fece700cbab21317442ba57427fd872d82405dcac"} Jul 06 23:56:05.814360 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.814267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9gcsl" event={"ID":"2963e01f-2fdf-4f82-9b28-bece51715897","Type":"ContainerStarted","Data":"daa38ee3f4a14bf5c85d2fa76b3bbc74dc53766d66b7579010bcde73e744cdf3"} Jul 06 23:56:05.824596 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:05.824553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fb8x" event={"ID":"4e9be49f-c961-4384-895b-40317cc397f2","Type":"ContainerStarted","Data":"aa596668368fbe71503e7e2a590eafb55029ece8f918a0aebc6ae966ec64ee24"} Jul 06 23:56:06.659039 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:06.659002 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:06.659499 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:06.659141 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:06.844752 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:06.844718 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" event={"ID":"801aa8895e9784a4eed97a3e63d28124","Type":"ContainerStarted","Data":"ea73f06487aa887e7f8cc19ccdd466e39b7d59f28b768784b0fbdf2eee224275"} Jul 06 23:56:06.861952 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:06.861883 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-246.ec2.internal" podStartSLOduration=4.861859234 podStartE2EDuration="4.861859234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:05.820620555 +0000 UTC m=+4.681792296" watchObservedRunningTime="2026-07-06 23:56:06.861859234 +0000 UTC m=+5.723030977" Jul 06 23:56:07.198999 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:07.198905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:07.209679 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.208067 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:07.209679 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.208156 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs podName:cfb5c705-430c-47cb-956f-42a94a8fba69 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.208134589 +0000 UTC m=+10.069306327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs") pod "network-metrics-daemon-v7zbh" (UID: "cfb5c705-430c-47cb-956f-42a94a8fba69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:07.300605 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:07.300035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:07.300605 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.300192 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:07.300605 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.300257 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret podName:6b63f8f2-0579-4181-bdea-f9934aa9c91c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.30023873 +0000 UTC m=+10.161410453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret") pod "global-pull-secret-syncer-kgzw2" (UID: "6b63f8f2-0579-4181-bdea-f9934aa9c91c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:07.401371 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:07.401327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:07.401589 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.401552 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:56:07.401589 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.401572 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:56:07.401589 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.401587 2559 projected.go:196] Error preparing data for projected volume kube-api-access-ss9wl for pod openshift-network-diagnostics/network-check-target-zxd8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:07.401890 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.401666 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl podName:2479bb42-8207-49a7-af59-5ede1b14fed2 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.40163011 +0000 UTC m=+10.262801832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ss9wl" (UniqueName: "kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl") pod "network-check-target-zxd8t" (UID: "2479bb42-8207-49a7-af59-5ede1b14fed2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:07.661916 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:07.661830 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:07.662362 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.661966 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:07.662362 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:07.662325 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:07.662471 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:07.662407 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:08.659801 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:08.659764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:08.660009 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:08.659907 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:09.664317 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:09.663728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:09.664317 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:09.663739 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:09.664317 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:09.663852 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:09.664317 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:09.664276 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:10.659148 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:10.659071 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:10.659321 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:10.659208 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:11.232871 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:11.232835 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:11.233272 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.232986 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:11.233272 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.233053 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs podName:cfb5c705-430c-47cb-956f-42a94a8fba69 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:19.233033935 +0000 UTC m=+18.094205657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs") pod "network-metrics-daemon-v7zbh" (UID: "cfb5c705-430c-47cb-956f-42a94a8fba69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:11.334036 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:11.333999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:11.334200 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.334145 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:11.334200 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.334192 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret podName:6b63f8f2-0579-4181-bdea-f9934aa9c91c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:19.334179938 +0000 UTC m=+18.195351657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret") pod "global-pull-secret-syncer-kgzw2" (UID: "6b63f8f2-0579-4181-bdea-f9934aa9c91c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:11.434405 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:11.434368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:11.434587 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.434556 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:56:11.434587 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.434580 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:56:11.434707 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.434593 2559 projected.go:196] Error preparing data for projected volume kube-api-access-ss9wl for pod openshift-network-diagnostics/network-check-target-zxd8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:11.434707 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.434668 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl podName:2479bb42-8207-49a7-af59-5ede1b14fed2 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:19.434632236 +0000 UTC m=+18.295803959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ss9wl" (UniqueName: "kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl") pod "network-check-target-zxd8t" (UID: "2479bb42-8207-49a7-af59-5ede1b14fed2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:11.661200 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:11.660498 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:11.661200 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.660625 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:11.661200 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:11.661013 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:11.661200 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:11.661104 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:12.659841 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:12.659805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:12.660294 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:12.659920 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:13.659073 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:13.659033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:13.659268 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:13.659168 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:13.659543 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:13.659526 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:13.659630 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:13.659614 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:14.659298 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:14.659263 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:14.659804 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:14.659384 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:15.662589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:15.662557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:15.663050 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:15.662699 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:15.663050 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:15.662771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:15.663050 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:15.662874 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:16.658802 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:16.658767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:16.658990 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:16.658893 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:17.659034 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:17.658994 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:17.659576 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:17.659117 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:17.659576 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:17.659187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:17.659576 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:17.659314 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:18.659597 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:18.659566 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:18.660125 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:18.659690 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:19.292201 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:19.292166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:19.292459 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.292298 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:19.292459 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.292362 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs podName:cfb5c705-430c-47cb-956f-42a94a8fba69 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:35.292343064 +0000 UTC m=+34.153514784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs") pod "network-metrics-daemon-v7zbh" (UID: "cfb5c705-430c-47cb-956f-42a94a8fba69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:19.392929 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:19.392894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:19.393101 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.393028 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:19.393101 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.393084 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret podName:6b63f8f2-0579-4181-bdea-f9934aa9c91c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:35.393069697 +0000 UTC m=+34.254241415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret") pod "global-pull-secret-syncer-kgzw2" (UID: "6b63f8f2-0579-4181-bdea-f9934aa9c91c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:19.493717 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:19.493680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:19.493912 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.493843 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:56:19.493912 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.493862 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:56:19.493912 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.493874 2559 projected.go:196] Error preparing data for projected volume kube-api-access-ss9wl for pod openshift-network-diagnostics/network-check-target-zxd8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:19.494068 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.493938 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl podName:2479bb42-8207-49a7-af59-5ede1b14fed2 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:35.49392156 +0000 UTC m=+34.355093298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ss9wl" (UniqueName: "kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl") pod "network-check-target-zxd8t" (UID: "2479bb42-8207-49a7-af59-5ede1b14fed2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:19.660156 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:19.659637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:19.660156 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.659801 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:19.660156 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:19.659850 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:19.660156 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:19.659982 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:20.658766 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:20.658728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:20.658944 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:20.658840 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:21.659761 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:21.659725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:21.660217 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:21.659836 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:21.660217 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:21.659943 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:21.660217 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:21.660035 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:22.659492 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:22.659028 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:22.659492 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:22.659150 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:23.659527 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:23.659494 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:23.660019 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:23.659494 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:23.660019 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:23.659622 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:23.660019 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:23.659728 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:24.659620 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.659308 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:24.660284 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:24.659729 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:24.887805 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.887764 2559 generic.go:356] "Generic (PLEG): container finished" podID="24dd8dac-b62a-44a4-92d1-4dd8b0bd882f" containerID="0807c3ba682c911fae5854b23b23fe3816ccd5a83f79f96739c56e99a6854cb9" exitCode=0 Jul 06 23:56:24.887980 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.887852 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerDied","Data":"0807c3ba682c911fae5854b23b23fe3816ccd5a83f79f96739c56e99a6854cb9"} Jul 06 23:56:24.889853 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.889826 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9gcsl" event={"ID":"2963e01f-2fdf-4f82-9b28-bece51715897","Type":"ContainerStarted","Data":"9cb6c63b0bc708258556f9fabdb5106efb992793e1bd9358d5562c068f569ceb"} Jul 06 23:56:24.891425 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.891401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fb8x" event={"ID":"4e9be49f-c961-4384-895b-40317cc397f2","Type":"ContainerStarted","Data":"71431babbc6ae36b5a81f01a2ed29fcfa1cdb6ee912cc9ffb09d24f244264d08"} Jul 06 23:56:24.893938 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.893914 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" event={"ID":"34cc011d-9d00-462f-94bf-0a15148a8d63","Type":"ContainerStarted","Data":"e77382139e8801bcbfe88e1e9964dca704c7036db09557df93960af4e8454ab7"} Jul 06 23:56:24.895465 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.895439 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m58pd" event={"ID":"162adc1c-09fc-41a5-8405-27851cc2aa30","Type":"ContainerStarted","Data":"698d36f9e21f60b88d12f882fb0819ecaa747b5adf10af647ab01f053f13d7ad"} Jul 06 23:56:24.897169 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.897126 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r66zn" event={"ID":"1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa","Type":"ContainerStarted","Data":"619fde9994f7c8ef3da904291ad9a62fca3d7b44292237dbf1fa0b60c73ac321"} Jul 06 23:56:24.900347 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.900312 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"66984da80a2bf2de363c9cbfc19c69ef3e402ec57712345f723e3c7d46b964d2"} Jul 06 23:56:24.900434 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.900386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"62f317290873cdd04a4f5a3d58c1460a34acd801d2c3faa0a09748b737dec38f"} Jul 06 23:56:24.900482 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.900435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"0d5a19dd77d629d78ce4f3383be4b3cd69e74979ee9e1d9b5c211edccab1aef1"} Jul 06 23:56:24.900532 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.900483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"cf99ba8b49be1e28f08d12a3624169d3bcb1e4c2dd7870d6ed51c7b5f953d0ce"} Jul 06 23:56:24.900589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.900532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"ff3c65c4f5aa82e61411c40e0e18f9e79bb51dd8d8455f39b5837e3ea0184654"} Jul 06 23:56:24.900589 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.900579 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"5520e38f83dd5efb9b554e3d3110f68ee8a4b77427f18bf58e6f0580073e48d9"} Jul 06 23:56:24.901870 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.901846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" event={"ID":"308c73b8-ba95-43ce-8ea5-1e412bc6317e","Type":"ContainerStarted","Data":"6489fa776056859ca7b7ec33436e18441b946d22c4c6443f61a98b2b1ce5978d"} Jul 06 23:56:24.920251 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.920194 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-246.ec2.internal" podStartSLOduration=22.920175108 podStartE2EDuration="22.920175108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:06.862849055 +0000 UTC m=+5.724020796" watchObservedRunningTime="2026-07-06 23:56:24.920175108 +0000 UTC m=+23.781346852" Jul 06 23:56:24.935729 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.935642 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m58pd" podStartSLOduration=4.894926408 podStartE2EDuration="23.935621378s" totalImagesPullingTime="19.04069497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:24.934522019 +0000 UTC m=+23.795693759" watchObservedRunningTime="2026-07-06 23:56:24.935621378 +0000 UTC m=+23.796793123" Jul 06 23:56:24.952101 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.952040 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9gcsl" podStartSLOduration=4.846717411 podStartE2EDuration="23.952024907s" totalImagesPullingTime="19.105307496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:24.951389672 +0000 UTC m=+23.812561414" watchObservedRunningTime="2026-07-06 23:56:24.952024907 +0000 UTC m=+23.813196650" Jul 06 23:56:24.972018 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.971962 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r66zn" podStartSLOduration=9.107332487 podStartE2EDuration="23.971944065s" totalImagesPullingTime="14.864611578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:24.971876115 +0000 UTC m=+23.833047856" watchObservedRunningTime="2026-07-06 23:56:24.971944065 +0000 UTC m=+23.833115807" Jul 06 23:56:24.987050 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:24.986998 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4fb8x" podStartSLOduration=4.923147567 podStartE2EDuration="23.986983631s" totalImagesPullingTime="19.063836064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:24.986496891 +0000 UTC m=+23.847668631" watchObservedRunningTime="2026-07-06 23:56:24.986983631 +0000 UTC m=+23.848155371" Jul 06 23:56:25.008665 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.008612 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q9jhh" podStartSLOduration=4.9441867760000004 podStartE2EDuration="24.008597759s" totalImagesPullingTime="19.064410983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:25.008505163 +0000 UTC m=+23.869676904" watchObservedRunningTime="2026-07-06 23:56:25.008597759 +0000 UTC m=+23.869769500" Jul 06 23:56:25.442961 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.442928 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 23:56:25.623709 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.623585 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:56:25.442953351Z","UUID":"326bde29-d8a8-4598-b097-a90907da6ac7","Handler":null,"Name":"","Endpoint":""} Jul 06 23:56:25.624920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.624900 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 23:56:25.625029 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.624937 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 23:56:25.658962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.658883 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:25.659098 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:25.658994 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:25.659137 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.659092 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:25.659228 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:25.659206 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:25.906898 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.906858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" event={"ID":"34cc011d-9d00-462f-94bf-0a15148a8d63","Type":"ContainerStarted","Data":"9665cf8be5716bd385d9e90af26c9f9fa44108c100d3dc7d5e24b602a24e9327"} Jul 06 23:56:25.908607 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:25.908573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb852" event={"ID":"a9712533-d321-4629-a580-506946b47bc0","Type":"ContainerStarted","Data":"cbaea45604c779d157c625eb5a2f3d62c844d915df962b97683bbc1660e9537f"} Jul 06 23:56:26.332345 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:26.332308 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:26.332888 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:26.332873 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:26.363736 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:26.363681 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bb852" podStartSLOduration=5.317939267 podStartE2EDuration="24.363665864s" totalImagesPullingTime="19.045726597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:25.928739296 +0000 UTC m=+24.789911037" watchObservedRunningTime="2026-07-06 23:56:26.363665864 +0000 UTC m=+25.224837642" Jul 06 23:56:26.659200 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:26.659162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:26.659382 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:26.659358 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:26.912707 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:26.912609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" event={"ID":"34cc011d-9d00-462f-94bf-0a15148a8d63","Type":"ContainerStarted","Data":"ed12c606af23ec5e97f3f6fef38af88802afe4038998da872a1c0b1a4d11efbb"} Jul 06 23:56:26.915816 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:26.915791 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"6b9e0146dac4710aea9905e603c4930451603feb1317fe651c6819d037369fcc"} Jul 06 23:56:26.934026 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:26.932566 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8jn5" podStartSLOduration=3.484325371 podStartE2EDuration="24.932538113s" totalImagesPullingTime="21.448212742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:26.93175005 +0000 UTC m=+25.792921791" watchObservedRunningTime="2026-07-06 23:56:26.932538113 +0000 UTC m=+25.793709856" Jul 06 23:56:27.089798 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:27.089763 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:27.090317 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:27.090296 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r66zn" Jul 06 23:56:27.659594 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:27.659565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:27.659904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:27.659601 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:27.659904 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:27.659726 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:27.659904 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:27.659874 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:28.659954 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:28.659746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:28.660493 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:28.660071 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:29.659509 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:29.659476 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:29.659509 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:29.659505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:29.659748 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:29.659615 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:29.659787 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:29.659748 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:30.659603 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.659530 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:30.660264 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:30.659632 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:30.928381 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.928302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" event={"ID":"c92a0ae4-ec16-4c68-9a07-3c4f4a86966d","Type":"ContainerStarted","Data":"f1567a72301cd365ea2bc7683e7222f08a2fdc3e93b0e17b53b1c737d911ef9f"} Jul 06 23:56:30.928555 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.928541 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:30.928644 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.928613 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:30.930234 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.930209 2559 generic.go:356] "Generic (PLEG): container finished" podID="24dd8dac-b62a-44a4-92d1-4dd8b0bd882f" containerID="eb380936d7d537c7e126f1a57af75b65934fc2bd603c882f1bbdec5a414d6393" exitCode=0 Jul 06 23:56:30.930354 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.930251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerDied","Data":"eb380936d7d537c7e126f1a57af75b65934fc2bd603c882f1bbdec5a414d6393"} Jul 06 23:56:30.945634 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.945609 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:30.945808 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.945736 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:30.960760 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:30.960713 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" podStartSLOduration=9.825079395 podStartE2EDuration="28.96069998s" totalImagesPullingTime="19.135620585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:30.960008465 +0000 UTC m=+29.821180220" watchObservedRunningTime="2026-07-06 23:56:30.96069998 +0000 UTC m=+29.821871720" Jul 06 23:56:31.438065 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:31.437887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:56:31.659548 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:31.659515 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:31.659748 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:31.659607 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:31.659748 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:31.659686 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:31.660090 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:31.659757 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:32.659132 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.659097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:32.659339 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:32.659253 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:32.667830 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.667804 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7zbh"] Jul 06 23:56:32.668195 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.667932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:32.668195 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:32.668027 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:32.670557 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.670531 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kgzw2"] Jul 06 23:56:32.674075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.674052 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxd8t"] Jul 06 23:56:32.674198 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.674141 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:32.674262 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:32.674219 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:32.937962 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.937931 2559 generic.go:356] "Generic (PLEG): container finished" podID="24dd8dac-b62a-44a4-92d1-4dd8b0bd882f" containerID="3265a562318af27161889d931c701d0afc2d1174f887d3c1993cb0372a454577" exitCode=0 Jul 06 23:56:32.938136 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.938019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerDied","Data":"3265a562318af27161889d931c701d0afc2d1174f887d3c1993cb0372a454577"} Jul 06 23:56:32.938136 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:32.938062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:32.938246 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:32.938155 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:33.943639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:33.943608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerStarted","Data":"77205b07cbc87137ce211d93f83f1eb30bddfd4cfbd0041c4e295a0e7ed5aeb1"} Jul 06 23:56:34.659384 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:34.659342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:34.659384 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:34.659375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:34.659549 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:34.659466 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxd8t" podUID="2479bb42-8207-49a7-af59-5ede1b14fed2" Jul 06 23:56:34.659549 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:34.659515 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:34.659627 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:34.659598 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kgzw2" podUID="6b63f8f2-0579-4181-bdea-f9934aa9c91c" Jul 06 23:56:34.659711 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:34.659695 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7zbh" podUID="cfb5c705-430c-47cb-956f-42a94a8fba69" Jul 06 23:56:34.948126 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:34.948089 2559 generic.go:356] "Generic (PLEG): container finished" podID="24dd8dac-b62a-44a4-92d1-4dd8b0bd882f" containerID="77205b07cbc87137ce211d93f83f1eb30bddfd4cfbd0041c4e295a0e7ed5aeb1" exitCode=0 Jul 06 23:56:34.948511 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:34.948133 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerDied","Data":"77205b07cbc87137ce211d93f83f1eb30bddfd4cfbd0041c4e295a0e7ed5aeb1"} Jul 06 23:56:35.309464 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:35.309374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:35.309631 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.309524 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:35.309631 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.309599 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs podName:cfb5c705-430c-47cb-956f-42a94a8fba69 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:07.309577792 +0000 UTC m=+66.170749576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs") pod "network-metrics-daemon-v7zbh" (UID: "cfb5c705-430c-47cb-956f-42a94a8fba69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:56:35.410600 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:35.410562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:35.410769 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.410746 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:35.410837 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.410821 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret podName:6b63f8f2-0579-4181-bdea-f9934aa9c91c nodeName:}" failed. No retries permitted until 2026-07-06 23:57:07.410801454 +0000 UTC m=+66.271973177 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret") pod "global-pull-secret-syncer-kgzw2" (UID: "6b63f8f2-0579-4181-bdea-f9934aa9c91c") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:56:35.511168 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:35.511127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:35.511347 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.511293 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:56:35.511347 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.511317 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:56:35.511347 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.511328 2559 projected.go:196] Error preparing data for projected volume kube-api-access-ss9wl for pod openshift-network-diagnostics/network-check-target-zxd8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:35.511446 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:35.511388 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl podName:2479bb42-8207-49a7-af59-5ede1b14fed2 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:07.511367772 +0000 UTC m=+66.372539491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ss9wl" (UniqueName: "kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl") pod "network-check-target-zxd8t" (UID: "2479bb42-8207-49a7-af59-5ede1b14fed2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:56:36.438690 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.438639 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-246.ec2.internal" event="NodeReady" Jul 06 23:56:36.439154 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.438813 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 23:56:36.479510 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.479474 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75"] Jul 06 23:56:36.483963 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.483941 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6999ff98c-dkb4f"] Jul 06 23:56:36.484225 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.484188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:36.487177 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.487145 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.487177 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.487145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 23:56:36.487390 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.487154 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.487513 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.487500 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-scl5n\"" Jul 06 23:56:36.487635 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.487622 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9"] Jul 06 23:56:36.487760 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.487743 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.490978 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.490955 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 23:56:36.491082 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.491037 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 23:56:36.491133 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.491103 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 23:56:36.491133 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.491120 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgl2r\"" Jul 06 23:56:36.491411 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.491393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.496867 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.496842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 23:56:36.497131 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.497112 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.497276 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.497256 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 23:56:36.497686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.497309 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 23:56:36.497686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.497318 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.497686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.497568 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-z2qm7\"" Jul 06 23:56:36.498939 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.498922 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-574c44f6c5-xvvzs"] Jul 06 23:56:36.508287 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.508259 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c8c4f"] Jul 06 23:56:36.508770 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.508752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.511892 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.511923 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.511928 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.511942 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.511982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.511894 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75"] Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.512075 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql"] Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.512081 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.512268 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 23:56:36.512925 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.512613 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hhpww\"" Jul 06 23:56:36.514889 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.514871 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kl6tf\"" Jul 06 23:56:36.514975 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.514916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.516009 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.515985 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n"] Jul 06 23:56:36.516138 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.516121 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.518703 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.518570 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 23:56:36.518703 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.518698 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 23:56:36.521095 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.521077 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hc6zr"] Jul 06 23:56:36.522092 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.522071 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.522839 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.523231 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.523853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.524002 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.524207 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.524418 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-66gdn\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.524422 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.525437 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.526230 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2"] Jul 06 23:56:36.522860 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.526305 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.528316 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.527120 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 23:56:36.531049 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.527588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-298qm\"" Jul 06 23:56:36.531049 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.530870 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.531469 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.531443 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 23:56:36.532285 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.532265 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hk4cx\"" Jul 06 23:56:36.532549 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.532362 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 23:56:36.532686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.532643 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd"] Jul 06 23:56:36.532780 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.532764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" Jul 06 23:56:36.533912 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.533892 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.535901 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.535853 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.535989 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.535912 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq"] Jul 06 23:56:36.536110 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.536090 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" Jul 06 23:56:36.537013 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.536986 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.537013 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.536999 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5lspd\"" Jul 06 23:56:36.539706 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.539672 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6999ff98c-dkb4f"] Jul 06 23:56:36.539804 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.539739 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wjwvw"] Jul 06 23:56:36.541100 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.540846 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cv4vp\"" Jul 06 23:56:36.541185 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.541114 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.541527 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.541506 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 23:56:36.541888 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.541868 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.543104 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.543083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.545472 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.545453 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-87qqj"] Jul 06 23:56:36.545694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.545643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:36.546054 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.545889 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.547545 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.547523 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 23:56:36.547640 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.547630 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.547980 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.547951 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 23:56:36.548176 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.548124 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tpqdc\"" Jul 06 23:56:36.548545 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.548527 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 23:56:36.548639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.548557 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 23:56:36.548639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.548573 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 23:56:36.548639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.548617 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5xctx\"" Jul 06 23:56:36.549965 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.549942 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n"] Jul 06 23:56:36.550077 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.549990 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql"] Jul 06 23:56:36.550077 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550012 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c8c4f"] Jul 06 23:56:36.550077 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550040 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd"] Jul 06 23:56:36.550226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550086 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2"] Jul 06 23:56:36.550226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550145 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hc6zr"] Jul 06 23:56:36.550226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550187 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq"] Jul 06 23:56:36.550226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550213 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-574c44f6c5-xvvzs"] Jul 06 23:56:36.550226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550228 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87qqj"] Jul 06 23:56:36.550458 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550275 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9"] Jul 06 23:56:36.550458 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.550299 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wjwvw"] Jul 06 23:56:36.552773 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.552754 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.555541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.555520 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c6s9h\"" Jul 06 23:56:36.555732 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.555583 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 23:56:36.555732 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.555520 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 23:56:36.617285 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617257 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33f5d3f9-ee8d-49f8-a137-3819fe039137-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.617442 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:36.617442 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4677e488-e259-4482-9914-786385a15b13-trusted-ca\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.617442 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.617442 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd1bf71-2832-4504-8157-28bce1fd2fec-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hpk\" (UniqueName: \"kubernetes.io/projected/ffd1bf71-2832-4504-8157-28bce1fd2fec-kube-api-access-g2hpk\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmth\" (UniqueName: \"kubernetes.io/projected/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-kube-api-access-6pmth\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4677e488-e259-4482-9914-786385a15b13-serving-cert\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f02f9eb3-78b4-4e40-a9ae-2795432fb956-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-certificates\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-tmp-dir\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.617664 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33f5d3f9-ee8d-49f8-a137-3819fe039137-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-config\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-stats-auth\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-installation-pull-secrets\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqpr9\" (UniqueName: \"kubernetes.io/projected/acccb75c-be4d-46fe-9fc9-c7fb102a627e-kube-api-access-kqpr9\") pod \"volume-data-source-validator-5d456fdbcd-rdxs2\" (UID: \"acccb75c-be4d-46fe-9fc9-c7fb102a627e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-image-registry-private-configuration\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35864c42-ff25-4374-8b20-241f2d7a85cc-ca-trust-extracted\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-config-volume\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.617984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddcl5\" (UniqueName: \"kubernetes.io/projected/f02f9eb3-78b4-4e40-a9ae-2795432fb956-kube-api-access-ddcl5\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7rqp\" (UniqueName: \"kubernetes.io/projected/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-kube-api-access-p7rqp\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.618033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfckv\" (UniqueName: \"kubernetes.io/projected/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-kube-api-access-vfckv\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08100cfa-85bb-4bbb-be3f-39d2cf59c53d-cert\") pod \"ingress-canary-wjwvw\" (UID: \"08100cfa-85bb-4bbb-be3f-39d2cf59c53d\") " pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f548k\" (UniqueName: \"kubernetes.io/projected/942671b9-d77b-4f94-9120-df0c83aafbd6-kube-api-access-f548k\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-bound-sa-token\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dzdw\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-kube-api-access-2dzdw\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd1bf71-2832-4504-8157-28bce1fd2fec-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69x5\" (UniqueName: \"kubernetes.io/projected/33f5d3f9-ee8d-49f8-a137-3819fe039137-kube-api-access-w69x5\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t22l6\" (UniqueName: \"kubernetes.io/projected/4677e488-e259-4482-9914-786385a15b13-kube-api-access-t22l6\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4677e488-e259-4482-9914-786385a15b13-config\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-default-certificate\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd1bf71-2832-4504-8157-28bce1fd2fec-serving-cert\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmgfp\" (UniqueName: \"kubernetes.io/projected/08100cfa-85bb-4bbb-be3f-39d2cf59c53d-kube-api-access-fmgfp\") pod \"ingress-canary-wjwvw\" (UID: \"08100cfa-85bb-4bbb-be3f-39d2cf59c53d\") " pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffd1bf71-2832-4504-8157-28bce1fd2fec-snapshots\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.618550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-trusted-ca\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.619095 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.619095 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd1bf71-2832-4504-8157-28bce1fd2fec-tmp\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.619095 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618584 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv2hv\" (UniqueName: \"kubernetes.io/projected/8a533b04-2291-4b05-9738-0ea1093fb05f-kube-api-access-vv2hv\") pod \"network-check-source-989f8b8dc-qztzd\" (UID: \"8a533b04-2291-4b05-9738-0ea1093fb05f\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" Jul 06 23:56:36.619095 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.618616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.659255 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.659220 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:56:36.659764 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.659740 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:56:36.659972 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.659951 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:56:36.662012 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.661989 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v6rl\"" Jul 06 23:56:36.662404 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.662229 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:56:36.662500 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.662412 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m54k2\"" Jul 06 23:56:36.662563 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.662414 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:56:36.719882 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.719845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-default-certificate\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.719882 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.719879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd1bf71-2832-4504-8157-28bce1fd2fec-serving-cert\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.719908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmgfp\" (UniqueName: \"kubernetes.io/projected/08100cfa-85bb-4bbb-be3f-39d2cf59c53d-kube-api-access-fmgfp\") pod \"ingress-canary-wjwvw\" (UID: \"08100cfa-85bb-4bbb-be3f-39d2cf59c53d\") " pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.719937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffd1bf71-2832-4504-8157-28bce1fd2fec-snapshots\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.719955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-trusted-ca\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.719970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.719986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd1bf71-2832-4504-8157-28bce1fd2fec-tmp\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv2hv\" (UniqueName: \"kubernetes.io/projected/8a533b04-2291-4b05-9738-0ea1093fb05f-kube-api-access-vv2hv\") pod \"network-check-source-989f8b8dc-qztzd\" (UID: \"8a533b04-2291-4b05-9738-0ea1093fb05f\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33f5d3f9-ee8d-49f8-a137-3819fe039137-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4677e488-e259-4482-9914-786385a15b13-trusted-ca\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.720105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd1bf71-2832-4504-8157-28bce1fd2fec-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hpk\" (UniqueName: \"kubernetes.io/projected/ffd1bf71-2832-4504-8157-28bce1fd2fec-kube-api-access-g2hpk\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmth\" (UniqueName: \"kubernetes.io/projected/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-kube-api-access-6pmth\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4677e488-e259-4482-9914-786385a15b13-serving-cert\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f02f9eb3-78b4-4e40-a9ae-2795432fb956-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-certificates\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-tmp-dir\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33f5d3f9-ee8d-49f8-a137-3819fe039137-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-config\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-stats-auth\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-installation-pull-secrets\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqpr9\" (UniqueName: \"kubernetes.io/projected/acccb75c-be4d-46fe-9fc9-c7fb102a627e-kube-api-access-kqpr9\") pod \"volume-data-source-validator-5d456fdbcd-rdxs2\" (UID: \"acccb75c-be4d-46fe-9fc9-c7fb102a627e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-image-registry-private-configuration\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.720694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720628 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35864c42-ff25-4374-8b20-241f2d7a85cc-ca-trust-extracted\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-config-volume\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddcl5\" (UniqueName: \"kubernetes.io/projected/f02f9eb3-78b4-4e40-a9ae-2795432fb956-kube-api-access-ddcl5\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7rqp\" (UniqueName: \"kubernetes.io/projected/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-kube-api-access-p7rqp\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfckv\" (UniqueName: \"kubernetes.io/projected/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-kube-api-access-vfckv\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08100cfa-85bb-4bbb-be3f-39d2cf59c53d-cert\") pod \"ingress-canary-wjwvw\" (UID: \"08100cfa-85bb-4bbb-be3f-39d2cf59c53d\") " pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f548k\" (UniqueName: \"kubernetes.io/projected/942671b9-d77b-4f94-9120-df0c83aafbd6-kube-api-access-f548k\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-bound-sa-token\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dzdw\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-kube-api-access-2dzdw\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd1bf71-2832-4504-8157-28bce1fd2fec-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.720989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w69x5\" (UniqueName: \"kubernetes.io/projected/33f5d3f9-ee8d-49f8-a137-3819fe039137-kube-api-access-w69x5\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.721038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t22l6\" (UniqueName: \"kubernetes.io/projected/4677e488-e259-4482-9914-786385a15b13-kube-api-access-t22l6\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.721065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4677e488-e259-4482-9914-786385a15b13-config\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.721094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:36.721462 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.721208 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.721255 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls podName:942671b9-d77b-4f94-9120-df0c83aafbd6 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.221241279 +0000 UTC m=+36.082413018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kbr75" (UID: "942671b9-d77b-4f94-9120-df0c83aafbd6") : secret "samples-operator-tls" not found Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.721332 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd1bf71-2832-4504-8157-28bce1fd2fec-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.721690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-certificates\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.721726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-tmp-dir\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.721817 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.721831 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999ff98c-dkb4f: secret "image-registry-tls" not found Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.721874 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls podName:35864c42-ff25-4374-8b20-241f2d7a85cc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.221859865 +0000 UTC m=+36.083031601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls") pod "image-registry-6999ff98c-dkb4f" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc") : secret "image-registry-tls" not found Jul 06 23:56:36.722219 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.721902 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.22188471 +0000 UTC m=+36.083056441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : configmap references non-existent config key: service-ca.crt Jul 06 23:56:36.722629 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.722383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffd1bf71-2832-4504-8157-28bce1fd2fec-snapshots\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.722782 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.722757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f02f9eb3-78b4-4e40-a9ae-2795432fb956-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.722934 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.722909 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:56:36.723012 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.722975 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls podName:0a8cf44e-dcb9-4d8f-8085-db12e98ede5b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.222959823 +0000 UTC m=+36.084131543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls") pod "dns-default-87qqj" (UID: "0a8cf44e-dcb9-4d8f-8085-db12e98ede5b") : secret "dns-default-metrics-tls" not found Jul 06 23:56:36.723116 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.723093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-config\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.723189 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.723137 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33f5d3f9-ee8d-49f8-a137-3819fe039137-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.723631 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.723598 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd1bf71-2832-4504-8157-28bce1fd2fec-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.723745 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.723726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd1bf71-2832-4504-8157-28bce1fd2fec-tmp\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.724346 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.723810 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:56:36.724346 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.723865 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.223850247 +0000 UTC m=+36.085021971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : secret "router-metrics-certs-default" not found Jul 06 23:56:36.726993 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.724775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:36.726993 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.724633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4677e488-e259-4482-9914-786385a15b13-config\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.726993 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.725847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4677e488-e259-4482-9914-786385a15b13-trusted-ca\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.726993 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.726250 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35864c42-ff25-4374-8b20-241f2d7a85cc-ca-trust-extracted\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.726993 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.726373 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:36.726993 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.726419 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls podName:f02f9eb3-78b4-4e40-a9ae-2795432fb956 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.226404582 +0000 UTC m=+36.087576303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tlnbq" (UID: "f02f9eb3-78b4-4e40-a9ae-2795432fb956") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:36.727362 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.727056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4677e488-e259-4482-9914-786385a15b13-serving-cert\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.727362 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.727204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-default-certificate\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.727461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.727371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-config-volume\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.727595 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.727577 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 23:56:36.727720 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:36.727636 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert podName:97dc5c42-f119-4fbc-b57d-c0167eb8c81e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.22762072 +0000 UTC m=+36.088792438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7tl6n" (UID: "97dc5c42-f119-4fbc-b57d-c0167eb8c81e") : secret "networking-console-plugin-cert" not found Jul 06 23:56:36.728105 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.728067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-trusted-ca\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.728438 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.728395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-stats-auth\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.728805 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.728750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33f5d3f9-ee8d-49f8-a137-3819fe039137-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.728987 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.728963 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08100cfa-85bb-4bbb-be3f-39d2cf59c53d-cert\") pod \"ingress-canary-wjwvw\" (UID: \"08100cfa-85bb-4bbb-be3f-39d2cf59c53d\") " pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:36.729584 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.729544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.729898 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.729873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd1bf71-2832-4504-8157-28bce1fd2fec-serving-cert\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.730053 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.729906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-installation-pull-secrets\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.730117 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.730028 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-image-registry-private-configuration\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.732482 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.732433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hpk\" (UniqueName: \"kubernetes.io/projected/ffd1bf71-2832-4504-8157-28bce1fd2fec-kube-api-access-g2hpk\") pod \"insights-operator-5c847dcfc4-c8c4f\" (UID: \"ffd1bf71-2832-4504-8157-28bce1fd2fec\") " pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.733160 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.733136 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dzdw\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-kube-api-access-2dzdw\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.733261 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.733216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69x5\" (UniqueName: \"kubernetes.io/projected/33f5d3f9-ee8d-49f8-a137-3819fe039137-kube-api-access-w69x5\") pod \"kube-storage-version-migrator-operator-846bf668f7-h5wj9\" (UID: \"33f5d3f9-ee8d-49f8-a137-3819fe039137\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.733367 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.733345 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t22l6\" (UniqueName: \"kubernetes.io/projected/4677e488-e259-4482-9914-786385a15b13-kube-api-access-t22l6\") pod \"console-operator-68b757fb67-hc6zr\" (UID: \"4677e488-e259-4482-9914-786385a15b13\") " pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.734397 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.734140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfckv\" (UniqueName: \"kubernetes.io/projected/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-kube-api-access-vfckv\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:36.734845 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.734824 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmth\" (UniqueName: \"kubernetes.io/projected/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-kube-api-access-6pmth\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:36.735021 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.734993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmgfp\" (UniqueName: \"kubernetes.io/projected/08100cfa-85bb-4bbb-be3f-39d2cf59c53d-kube-api-access-fmgfp\") pod \"ingress-canary-wjwvw\" (UID: \"08100cfa-85bb-4bbb-be3f-39d2cf59c53d\") " pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:36.738677 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.738624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f548k\" (UniqueName: \"kubernetes.io/projected/942671b9-d77b-4f94-9120-df0c83aafbd6-kube-api-access-f548k\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:36.739299 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.739277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv2hv\" (UniqueName: \"kubernetes.io/projected/8a533b04-2291-4b05-9738-0ea1093fb05f-kube-api-access-vv2hv\") pod \"network-check-source-989f8b8dc-qztzd\" (UID: \"8a533b04-2291-4b05-9738-0ea1093fb05f\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" Jul 06 23:56:36.740581 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.740556 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddcl5\" (UniqueName: \"kubernetes.io/projected/f02f9eb3-78b4-4e40-a9ae-2795432fb956-kube-api-access-ddcl5\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:36.740984 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.740961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7rqp\" (UniqueName: \"kubernetes.io/projected/5ea591db-a6d2-4859-a1bd-8c9f8d4de788-kube-api-access-p7rqp\") pod \"service-ca-operator-5d46d9ffd4-t54ql\" (UID: \"5ea591db-a6d2-4859-a1bd-8c9f8d4de788\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.741327 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.741309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqpr9\" (UniqueName: \"kubernetes.io/projected/acccb75c-be4d-46fe-9fc9-c7fb102a627e-kube-api-access-kqpr9\") pod \"volume-data-source-validator-5d456fdbcd-rdxs2\" (UID: \"acccb75c-be4d-46fe-9fc9-c7fb102a627e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" Jul 06 23:56:36.741462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.741446 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-bound-sa-token\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:36.824858 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.824772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" Jul 06 23:56:36.845411 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.845146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" Jul 06 23:56:36.858143 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.858115 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" Jul 06 23:56:36.872884 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.872859 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:36.880413 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.880211 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" Jul 06 23:56:36.888704 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.888679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" Jul 06 23:56:36.902001 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:36.901979 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wjwvw" Jul 06 23:56:37.114795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.114280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9"] Jul 06 23:56:37.125965 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:37.125917 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f5d3f9_ee8d_49f8_a137_3819fe039137.slice/crio-ea169e397ae853e7924ee37c3c603dc3b1b389e292decce6995742d67e96740a WatchSource:0}: Error finding container ea169e397ae853e7924ee37c3c603dc3b1b389e292decce6995742d67e96740a: Status 404 returned error can't find the container with id ea169e397ae853e7924ee37c3c603dc3b1b389e292decce6995742d67e96740a Jul 06 23:56:37.145423 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.143966 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql"] Jul 06 23:56:37.148179 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.147614 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c8c4f"] Jul 06 23:56:37.148179 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.147679 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hc6zr"] Jul 06 23:56:37.148179 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:37.147938 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd1bf71_2832_4504_8157_28bce1fd2fec.slice/crio-016ccc5a20888697f40341a5c49439d91a2bec14709af00249f1456ca4bbfa2c WatchSource:0}: Error finding container 016ccc5a20888697f40341a5c49439d91a2bec14709af00249f1456ca4bbfa2c: Status 404 returned error can't find the container with id 016ccc5a20888697f40341a5c49439d91a2bec14709af00249f1456ca4bbfa2c Jul 06 23:56:37.151539 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:37.151517 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4677e488_e259_4482_9914_786385a15b13.slice/crio-e7a37dbbcba2f3d3e3c442dc59efa67b5175f800445f30e3c58e6085720eb285 WatchSource:0}: Error finding container e7a37dbbcba2f3d3e3c442dc59efa67b5175f800445f30e3c58e6085720eb285: Status 404 returned error can't find the container with id e7a37dbbcba2f3d3e3c442dc59efa67b5175f800445f30e3c58e6085720eb285 Jul 06 23:56:37.161906 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.161877 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd"] Jul 06 23:56:37.164263 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:37.164236 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a533b04_2291_4b05_9738_0ea1093fb05f.slice/crio-d6849b6e13749685122dfc29f124e8de1ed654ff161d524e750f49f4a4355d74 WatchSource:0}: Error finding container d6849b6e13749685122dfc29f124e8de1ed654ff161d524e750f49f4a4355d74: Status 404 returned error can't find the container with id d6849b6e13749685122dfc29f124e8de1ed654ff161d524e750f49f4a4355d74 Jul 06 23:56:37.180087 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.180056 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2"] Jul 06 23:56:37.183286 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:37.183260 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacccb75c_be4d_46fe_9fc9_c7fb102a627e.slice/crio-18b53619573655d5a3e3cd484676ea99c3f3cec48ccb68ea452cd1690bc72a0e WatchSource:0}: Error finding container 18b53619573655d5a3e3cd484676ea99c3f3cec48ccb68ea452cd1690bc72a0e: Status 404 returned error can't find the container with id 18b53619573655d5a3e3cd484676ea99c3f3cec48ccb68ea452cd1690bc72a0e Jul 06 23:56:37.184639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.184572 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wjwvw"] Jul 06 23:56:37.187311 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:56:37.187287 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08100cfa_85bb_4bbb_be3f_39d2cf59c53d.slice/crio-fca6665cfa7efb900ba62aefe4e3a07997dd06ff20786e466952d89765c2956b WatchSource:0}: Error finding container fca6665cfa7efb900ba62aefe4e3a07997dd06ff20786e466952d89765c2956b: Status 404 returned error can't find the container with id fca6665cfa7efb900ba62aefe4e3a07997dd06ff20786e466952d89765c2956b Jul 06 23:56:37.226919 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.226882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:37.227124 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.226956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:37.227124 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.226994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:37.227124 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.227038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:37.227124 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227077 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227125 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227130 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227137 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227154 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls podName:f02f9eb3-78b4-4e40-a9ae-2795432fb956 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:38.227133047 +0000 UTC m=+37.088304768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tlnbq" (UID: "f02f9eb3-78b4-4e40-a9ae-2795432fb956") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227213 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls podName:942671b9-d77b-4f94-9120-df0c83aafbd6 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:38.22716532 +0000 UTC m=+37.088337040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kbr75" (UID: "942671b9-d77b-4f94-9120-df0c83aafbd6") : secret "samples-operator-tls" not found Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227234 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls podName:0a8cf44e-dcb9-4d8f-8085-db12e98ede5b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:38.227224404 +0000 UTC m=+37.088396124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls") pod "dns-default-87qqj" (UID: "0a8cf44e-dcb9-4d8f-8085-db12e98ede5b") : secret "dns-default-metrics-tls" not found Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.227256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:37.227332 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.227282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:37.227609 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227339 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:38.227320737 +0000 UTC m=+37.088492471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : secret "router-metrics-certs-default" not found Jul 06 23:56:37.227609 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227363 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:56:37.227609 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227375 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999ff98c-dkb4f: secret "image-registry-tls" not found Jul 06 23:56:37.227609 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227394 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:38.227379113 +0000 UTC m=+37.088550834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : configmap references non-existent config key: service-ca.crt Jul 06 23:56:37.227609 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.227420 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls podName:35864c42-ff25-4374-8b20-241f2d7a85cc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:38.2274086 +0000 UTC m=+37.088580319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls") pod "image-registry-6999ff98c-dkb4f" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc") : secret "image-registry-tls" not found Jul 06 23:56:37.328465 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.328373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:37.328635 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.328485 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 23:56:37.328635 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:37.328559 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert podName:97dc5c42-f119-4fbc-b57d-c0167eb8c81e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:38.328543822 +0000 UTC m=+37.189715544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7tl6n" (UID: "97dc5c42-f119-4fbc-b57d-c0167eb8c81e") : secret "networking-console-plugin-cert" not found Jul 06 23:56:37.978166 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.978007 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wjwvw" event={"ID":"08100cfa-85bb-4bbb-be3f-39d2cf59c53d","Type":"ContainerStarted","Data":"fca6665cfa7efb900ba62aefe4e3a07997dd06ff20786e466952d89765c2956b"} Jul 06 23:56:37.981444 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.981349 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" event={"ID":"8a533b04-2291-4b05-9738-0ea1093fb05f","Type":"ContainerStarted","Data":"d6849b6e13749685122dfc29f124e8de1ed654ff161d524e750f49f4a4355d74"} Jul 06 23:56:37.991700 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:37.991474 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" event={"ID":"ffd1bf71-2832-4504-8157-28bce1fd2fec","Type":"ContainerStarted","Data":"016ccc5a20888697f40341a5c49439d91a2bec14709af00249f1456ca4bbfa2c"} Jul 06 23:56:38.000600 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.000510 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" event={"ID":"acccb75c-be4d-46fe-9fc9-c7fb102a627e","Type":"ContainerStarted","Data":"18b53619573655d5a3e3cd484676ea99c3f3cec48ccb68ea452cd1690bc72a0e"} Jul 06 23:56:38.005808 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.005777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" event={"ID":"5ea591db-a6d2-4859-a1bd-8c9f8d4de788","Type":"ContainerStarted","Data":"2af0ed8635f2f44c4916a329c97c599c86de831b6f6a515d03158ad27c29cb43"} Jul 06 23:56:38.018582 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.018505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" event={"ID":"4677e488-e259-4482-9914-786385a15b13","Type":"ContainerStarted","Data":"e7a37dbbcba2f3d3e3c442dc59efa67b5175f800445f30e3c58e6085720eb285"} Jul 06 23:56:38.032862 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.032828 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" event={"ID":"33f5d3f9-ee8d-49f8-a137-3819fe039137","Type":"ContainerStarted","Data":"ea169e397ae853e7924ee37c3c603dc3b1b389e292decce6995742d67e96740a"} Jul 06 23:56:38.239967 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.239850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:38.239967 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.239911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:38.239967 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.239954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:38.240231 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.240009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:38.240231 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.240040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:38.240231 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.240126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:38.240396 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.240267 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:38.240396 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.240331 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls podName:f02f9eb3-78b4-4e40-a9ae-2795432fb956 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.240313323 +0000 UTC m=+39.101485045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tlnbq" (UID: "f02f9eb3-78b4-4e40-a9ae-2795432fb956") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:38.240820 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.240799 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:56:38.240926 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.240860 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls podName:942671b9-d77b-4f94-9120-df0c83aafbd6 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.240843265 +0000 UTC m=+39.102014985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kbr75" (UID: "942671b9-d77b-4f94-9120-df0c83aafbd6") : secret "samples-operator-tls" not found Jul 06 23:56:38.240926 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.240918 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:56:38.241036 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.240947 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.240937966 +0000 UTC m=+39.102109688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : secret "router-metrics-certs-default" not found Jul 06 23:56:38.241036 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.241001 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:56:38.241036 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.241031 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls podName:0a8cf44e-dcb9-4d8f-8085-db12e98ede5b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.241019932 +0000 UTC m=+39.102191654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls") pod "dns-default-87qqj" (UID: "0a8cf44e-dcb9-4d8f-8085-db12e98ede5b") : secret "dns-default-metrics-tls" not found Jul 06 23:56:38.241191 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.241115 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.241105551 +0000 UTC m=+39.102277275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : configmap references non-existent config key: service-ca.crt Jul 06 23:56:38.241191 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.241178 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:56:38.241191 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.241189 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999ff98c-dkb4f: secret "image-registry-tls" not found Jul 06 23:56:38.241345 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.241218 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls podName:35864c42-ff25-4374-8b20-241f2d7a85cc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.241208679 +0000 UTC m=+39.102380414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls") pod "image-registry-6999ff98c-dkb4f" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc") : secret "image-registry-tls" not found Jul 06 23:56:38.340976 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:38.340778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:38.340976 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.340938 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 23:56:38.341204 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:38.341013 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert podName:97dc5c42-f119-4fbc-b57d-c0167eb8c81e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.340993256 +0000 UTC m=+39.202164980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7tl6n" (UID: "97dc5c42-f119-4fbc-b57d-c0167eb8c81e") : secret "networking-console-plugin-cert" not found Jul 06 23:56:40.263352 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:40.263312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:40.263397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:40.263434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263461 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:40.263484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263531 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls podName:f02f9eb3-78b4-4e40-a9ae-2795432fb956 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:44.263515437 +0000 UTC m=+43.124687156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tlnbq" (UID: "f02f9eb3-78b4-4e40-a9ae-2795432fb956") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:40.263566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263572 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263581 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:40.263589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263633 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls podName:942671b9-d77b-4f94-9120-df0c83aafbd6 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:44.26361519 +0000 UTC m=+43.124786925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kbr75" (UID: "942671b9-d77b-4f94-9120-df0c83aafbd6") : secret "samples-operator-tls" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263674 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:44.263663235 +0000 UTC m=+43.124834968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : secret "router-metrics-certs-default" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263690 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263701 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263707 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:44.26369052 +0000 UTC m=+43.124862240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : configmap references non-existent config key: service-ca.crt Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263714 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999ff98c-dkb4f: secret "image-registry-tls" not found Jul 06 23:56:40.263849 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263739 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls podName:0a8cf44e-dcb9-4d8f-8085-db12e98ede5b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:44.263725035 +0000 UTC m=+43.124896757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls") pod "dns-default-87qqj" (UID: "0a8cf44e-dcb9-4d8f-8085-db12e98ede5b") : secret "dns-default-metrics-tls" not found Jul 06 23:56:40.264413 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.263757 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls podName:35864c42-ff25-4374-8b20-241f2d7a85cc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:44.263747774 +0000 UTC m=+43.124919499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls") pod "image-registry-6999ff98c-dkb4f" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc") : secret "image-registry-tls" not found Jul 06 23:56:40.364755 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:40.364716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:40.364945 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.364852 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 23:56:40.364945 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:40.364921 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert podName:97dc5c42-f119-4fbc-b57d-c0167eb8c81e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:44.364905182 +0000 UTC m=+43.226076918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7tl6n" (UID: "97dc5c42-f119-4fbc-b57d-c0167eb8c81e") : secret "networking-console-plugin-cert" not found Jul 06 23:56:44.301738 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:44.301697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:44.301769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:44.301816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:44.301846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.301872 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:44.301929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.301941 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.301964 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.301944236 +0000 UTC m=+51.163115971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : configmap references non-existent config key: service-ca.crt Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.301993 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls podName:0a8cf44e-dcb9-4d8f-8085-db12e98ede5b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.301982492 +0000 UTC m=+51.163154215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls") pod "dns-default-87qqj" (UID: "0a8cf44e-dcb9-4d8f-8085-db12e98ede5b") : secret "dns-default-metrics-tls" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302002 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302009 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.302000814 +0000 UTC m=+51.163172535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : secret "router-metrics-certs-default" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302013 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302027 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999ff98c-dkb4f: secret "image-registry-tls" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302036 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls podName:f02f9eb3-78b4-4e40-a9ae-2795432fb956 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.302026455 +0000 UTC m=+51.163198188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tlnbq" (UID: "f02f9eb3-78b4-4e40-a9ae-2795432fb956") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302061 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls podName:35864c42-ff25-4374-8b20-241f2d7a85cc nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.302052886 +0000 UTC m=+51.163224606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls") pod "image-registry-6999ff98c-dkb4f" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc") : secret "image-registry-tls" not found Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:44.302114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:44.302298 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302202 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:56:44.303009 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.302239 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls podName:942671b9-d77b-4f94-9120-df0c83aafbd6 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.302228264 +0000 UTC m=+51.163399996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kbr75" (UID: "942671b9-d77b-4f94-9120-df0c83aafbd6") : secret "samples-operator-tls" not found Jul 06 23:56:44.402917 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:44.402886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:44.403129 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.403081 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 23:56:44.403196 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:44.403148 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert podName:97dc5c42-f119-4fbc-b57d-c0167eb8c81e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.403132397 +0000 UTC m=+51.264304116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7tl6n" (UID: "97dc5c42-f119-4fbc-b57d-c0167eb8c81e") : secret "networking-console-plugin-cert" not found Jul 06 23:56:47.066201 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.066124 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" event={"ID":"8a533b04-2291-4b05-9738-0ea1093fb05f","Type":"ContainerStarted","Data":"56d2609b74c89cf946a7aab390ba5381301ad7259c3e22aaf067ef9e2c306f5f"} Jul 06 23:56:47.068794 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.068078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" event={"ID":"ffd1bf71-2832-4504-8157-28bce1fd2fec","Type":"ContainerStarted","Data":"f90c95698776fe72bcaaa364c866c397551154289f94c621ea885ac62357bfab"} Jul 06 23:56:47.084329 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.084287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" event={"ID":"acccb75c-be4d-46fe-9fc9-c7fb102a627e","Type":"ContainerStarted","Data":"4d5f6597f22ae9749429f3e59f12c6c74dd15737078856a7e39019120f40fe51"} Jul 06 23:56:47.090139 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.089429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerStarted","Data":"d2dd3e10f6758125c860c0e2cfa702c8ca631b41925259ff3d2593350f3a5b28"} Jul 06 23:56:47.092392 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.091935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" event={"ID":"5ea591db-a6d2-4859-a1bd-8c9f8d4de788","Type":"ContainerStarted","Data":"8eda66a4b479d1d5f8be682fd89e0bbd9947a6a275872ebd73fc3f6583c626e5"} Jul 06 23:56:47.096362 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.094547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" event={"ID":"4677e488-e259-4482-9914-786385a15b13","Type":"ContainerStarted","Data":"a0c81d6cbfe2019f319a648e8e56e8fd67e084a24d7f977133e3349b7a43ba66"} Jul 06 23:56:47.100232 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.097089 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:47.100232 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.097447 2559 patch_prober.go:28] interesting pod/console-operator-68b757fb67-hc6zr container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Jul 06 23:56:47.100232 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.097492 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" podUID="4677e488-e259-4482-9914-786385a15b13" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" Jul 06 23:56:47.102900 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.102876 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" event={"ID":"33f5d3f9-ee8d-49f8-a137-3819fe039137","Type":"ContainerStarted","Data":"242cb741106adcee4497f44ddba5c67353f007d8a9d54aefe22a8e00d586a7a6"} Jul 06 23:56:47.136154 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.134411 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" podStartSLOduration=21.543198504 podStartE2EDuration="31.134388418s" totalImagesPullingTime="9.591189914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:47.099543972 +0000 UTC m=+45.960715714" watchObservedRunningTime="2026-07-06 23:56:47.134388418 +0000 UTC m=+45.995560161" Jul 06 23:56:47.158264 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.157580 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" podStartSLOduration=21.56716402 podStartE2EDuration="31.157558586s" totalImagesPullingTime="9.590394566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:47.156391196 +0000 UTC m=+46.017562986" watchObservedRunningTime="2026-07-06 23:56:47.157558586 +0000 UTC m=+46.018730328" Jul 06 23:56:47.202866 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.202673 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rdxs2" podStartSLOduration=21.647455998 podStartE2EDuration="31.202614747s" totalImagesPullingTime="9.555158749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:47.202576512 +0000 UTC m=+46.063748255" watchObservedRunningTime="2026-07-06 23:56:47.202614747 +0000 UTC m=+46.063786490" Jul 06 23:56:47.204641 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.204595 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" podStartSLOduration=21.613313976 podStartE2EDuration="31.204580121s" totalImagesPullingTime="9.591266145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:47.177636355 +0000 UTC m=+46.038808101" watchObservedRunningTime="2026-07-06 23:56:47.204580121 +0000 UTC m=+46.065751862" Jul 06 23:56:47.223996 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:47.223933 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" podStartSLOduration=21.611663823 podStartE2EDuration="31.22390902s" totalImagesPullingTime="9.612245197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:47.222427074 +0000 UTC m=+46.083598817" watchObservedRunningTime="2026-07-06 23:56:47.22390902 +0000 UTC m=+46.085080761" Jul 06 23:56:48.108058 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.107969 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wjwvw" event={"ID":"08100cfa-85bb-4bbb-be3f-39d2cf59c53d","Type":"ContainerStarted","Data":"fe012d6782de101202627c027e7833cbb5b8661c487ccba86fd06c7c2061da5b"} Jul 06 23:56:48.111409 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.111376 2559 generic.go:356] "Generic (PLEG): container finished" podID="24dd8dac-b62a-44a4-92d1-4dd8b0bd882f" containerID="d2dd3e10f6758125c860c0e2cfa702c8ca631b41925259ff3d2593350f3a5b28" exitCode=0 Jul 06 23:56:48.111669 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.111425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerDied","Data":"d2dd3e10f6758125c860c0e2cfa702c8ca631b41925259ff3d2593350f3a5b28"} Jul 06 23:56:48.113997 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.113933 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/0.log" Jul 06 23:56:48.113997 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.113965 2559 generic.go:356] "Generic (PLEG): container finished" podID="4677e488-e259-4482-9914-786385a15b13" containerID="a0c81d6cbfe2019f319a648e8e56e8fd67e084a24d7f977133e3349b7a43ba66" exitCode=255 Jul 06 23:56:48.115001 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.114981 2559 scope.go:117] "RemoveContainer" containerID="a0c81d6cbfe2019f319a648e8e56e8fd67e084a24d7f977133e3349b7a43ba66" Jul 06 23:56:48.115263 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.115243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" event={"ID":"4677e488-e259-4482-9914-786385a15b13","Type":"ContainerDied","Data":"a0c81d6cbfe2019f319a648e8e56e8fd67e084a24d7f977133e3349b7a43ba66"} Jul 06 23:56:48.129541 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.129490 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wjwvw" podStartSLOduration=2.5683850230000003 podStartE2EDuration="12.12947111s" totalImagesPullingTime="9.561086087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:48.12887041 +0000 UTC m=+46.990042155" watchObservedRunningTime="2026-07-06 23:56:48.12947111 +0000 UTC m=+46.990642850" Jul 06 23:56:48.195062 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.192066 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qztzd" podStartSLOduration=18.615101421 podStartE2EDuration="28.192042369s" totalImagesPullingTime="9.576940948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:48.191189832 +0000 UTC m=+47.052361574" watchObservedRunningTime="2026-07-06 23:56:48.192042369 +0000 UTC m=+47.053214108" Jul 06 23:56:48.724506 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.724419 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vtk2x"] Jul 06 23:56:48.746205 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.746172 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vtk2x"] Jul 06 23:56:48.746451 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.746430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.749425 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.749397 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 23:56:48.749555 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.749513 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phqcp\"" Jul 06 23:56:48.749667 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.749637 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 23:56:48.846409 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.846363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.846587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.846433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/278738d3-22b9-4d8b-bdcc-9000d4be09b1-crio-socket\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.846587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.846491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.846587 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.846551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52b9w\" (UniqueName: \"kubernetes.io/projected/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-api-access-52b9w\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.846792 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.846685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/278738d3-22b9-4d8b-bdcc-9000d4be09b1-data-volume\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.948023 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.947987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/278738d3-22b9-4d8b-bdcc-9000d4be09b1-data-volume\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.948174 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.948091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.948174 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.948149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/278738d3-22b9-4d8b-bdcc-9000d4be09b1-crio-socket\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.948274 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.948173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.948274 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.948196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52b9w\" (UniqueName: \"kubernetes.io/projected/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-api-access-52b9w\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.948274 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:48.948241 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:56:48.948388 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:48.948296 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:56:48.948388 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:48.948309 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:49.448293882 +0000 UTC m=+48.309465600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : secret "insights-runtime-extractor-tls" not found Jul 06 23:56:48.948388 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:48.948355 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:49.448337661 +0000 UTC m=+48.309509380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : configmap "kube-rbac-proxy" not found Jul 06 23:56:48.948495 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.948390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/278738d3-22b9-4d8b-bdcc-9000d4be09b1-data-volume\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.948495 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.948398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/278738d3-22b9-4d8b-bdcc-9000d4be09b1-crio-socket\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:48.975908 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:48.975825 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52b9w\" (UniqueName: \"kubernetes.io/projected/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-api-access-52b9w\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:49.122899 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.122842 2559 generic.go:356] "Generic (PLEG): container finished" podID="24dd8dac-b62a-44a4-92d1-4dd8b0bd882f" containerID="af1a52cd6d31fd6cd00e0f7e5a424b1ebc5c31123913480369e6033d6f966cca" exitCode=0 Jul 06 23:56:49.123498 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.122916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerDied","Data":"af1a52cd6d31fd6cd00e0f7e5a424b1ebc5c31123913480369e6033d6f966cca"} Jul 06 23:56:49.126288 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.126266 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 06 23:56:49.126778 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.126759 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/0.log" Jul 06 23:56:49.126884 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.126796 2559 generic.go:356] "Generic (PLEG): container finished" podID="4677e488-e259-4482-9914-786385a15b13" containerID="edcaae23c7c07d92f5cfda2ad9a89cdc44a8fb85ffa00760ec5d8dd8519295ab" exitCode=255 Jul 06 23:56:49.126884 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.126827 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" event={"ID":"4677e488-e259-4482-9914-786385a15b13","Type":"ContainerDied","Data":"edcaae23c7c07d92f5cfda2ad9a89cdc44a8fb85ffa00760ec5d8dd8519295ab"} Jul 06 23:56:49.126975 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.126885 2559 scope.go:117] "RemoveContainer" containerID="a0c81d6cbfe2019f319a648e8e56e8fd67e084a24d7f977133e3349b7a43ba66" Jul 06 23:56:49.127151 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.127131 2559 scope.go:117] "RemoveContainer" containerID="edcaae23c7c07d92f5cfda2ad9a89cdc44a8fb85ffa00760ec5d8dd8519295ab" Jul 06 23:56:49.127366 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:49.127338 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hc6zr_openshift-console-operator(4677e488-e259-4482-9914-786385a15b13)\"" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" podUID="4677e488-e259-4482-9914-786385a15b13" Jul 06 23:56:49.453842 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.453801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:49.454005 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:49.453922 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:56:49.454005 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:49.453956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:49.454005 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:49.453984 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:50.453969566 +0000 UTC m=+49.315141285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : configmap "kube-rbac-proxy" not found Jul 06 23:56:49.454110 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:49.454046 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:56:49.454110 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:49.454089 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:50.454077819 +0000 UTC m=+49.315249539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : secret "insights-runtime-extractor-tls" not found Jul 06 23:56:50.123595 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:50.123564 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fb8x_4e9be49f-c961-4384-895b-40317cc397f2/dns-node-resolver/0.log" Jul 06 23:56:50.133867 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:50.133833 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" event={"ID":"24dd8dac-b62a-44a4-92d1-4dd8b0bd882f","Type":"ContainerStarted","Data":"ccb868d0d7fb875a7bf978e97ec3ce9e512dabb02bf29ff3caa813b4dc4ef763"} Jul 06 23:56:50.135141 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:50.135122 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 06 23:56:50.135426 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:50.135413 2559 scope.go:117] "RemoveContainer" containerID="edcaae23c7c07d92f5cfda2ad9a89cdc44a8fb85ffa00760ec5d8dd8519295ab" Jul 06 23:56:50.135577 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:50.135553 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hc6zr_openshift-console-operator(4677e488-e259-4482-9914-786385a15b13)\"" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" podUID="4677e488-e259-4482-9914-786385a15b13" Jul 06 23:56:50.157791 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:50.157738 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ftpxs" podStartSLOduration=14.875049161 podStartE2EDuration="49.157721697s" totalImagesPullingTime="34.282672536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:50.156013194 +0000 UTC m=+49.017184933" watchObservedRunningTime="2026-07-06 23:56:50.157721697 +0000 UTC m=+49.018893429" Jul 06 23:56:50.463789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:50.463693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:50.463789 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:50.463758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:50.463992 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:50.463852 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:56:50.463992 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:50.463867 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:56:50.463992 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:50.463917 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.463903734 +0000 UTC m=+51.325075453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : configmap "kube-rbac-proxy" not found Jul 06 23:56:50.464090 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:50.463990 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:52.463970348 +0000 UTC m=+51.325142071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : secret "insights-runtime-extractor-tls" not found Jul 06 23:56:51.124778 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:51.124751 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m58pd_162adc1c-09fc-41a5-8405-27851cc2aa30/node-ca/0.log" Jul 06 23:56:52.123946 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.123911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wjwvw_08100cfa-85bb-4bbb-be3f-39d2cf59c53d/serve-healthcheck-canary/0.log" Jul 06 23:56:52.381009 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.380910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:56:52.381009 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.380977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:56:52.381009 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.381008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.381033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381058 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.381107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381120 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381126 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls podName:f02f9eb3-78b4-4e40-a9ae-2795432fb956 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:08.381111276 +0000 UTC m=+67.242282999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tlnbq" (UID: "f02f9eb3-78b4-4e40-a9ae-2795432fb956") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381155 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381159 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls podName:0a8cf44e-dcb9-4d8f-8085-db12e98ede5b nodeName:}" failed. No retries permitted until 2026-07-06 23:57:08.381148525 +0000 UTC m=+67.242320244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls") pod "dns-default-87qqj" (UID: "0a8cf44e-dcb9-4d8f-8085-db12e98ede5b") : secret "dns-default-metrics-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381200 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.381220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381247 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls podName:942671b9-d77b-4f94-9120-df0c83aafbd6 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:08.381234471 +0000 UTC m=+67.242406191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kbr75" (UID: "942671b9-d77b-4f94-9120-df0c83aafbd6") : secret "samples-operator-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381273 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:08.381260951 +0000 UTC m=+67.242432672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : configmap references non-existent config key: service-ca.crt Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381277 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381289 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999ff98c-dkb4f: secret "image-registry-tls" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381296 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs podName:65f6bf8a-7c32-460e-9a92-d148d6cda2f1 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:08.381288842 +0000 UTC m=+67.242460563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs") pod "router-default-574c44f6c5-xvvzs" (UID: "65f6bf8a-7c32-460e-9a92-d148d6cda2f1") : secret "router-metrics-certs-default" not found Jul 06 23:56:52.381528 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.381322 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls podName:35864c42-ff25-4374-8b20-241f2d7a85cc nodeName:}" failed. No retries permitted until 2026-07-06 23:57:08.381311915 +0000 UTC m=+67.242483633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls") pod "image-registry-6999ff98c-dkb4f" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc") : secret "image-registry-tls" not found Jul 06 23:56:52.482511 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.482467 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:56:52.482730 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.482598 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:52.482730 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.482620 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 23:56:52.482730 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:52.482640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:52.482730 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.482706 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert podName:97dc5c42-f119-4fbc-b57d-c0167eb8c81e nodeName:}" failed. No retries permitted until 2026-07-06 23:57:08.482690223 +0000 UTC m=+67.343861945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7tl6n" (UID: "97dc5c42-f119-4fbc-b57d-c0167eb8c81e") : secret "networking-console-plugin-cert" not found Jul 06 23:56:52.482897 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.482737 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:56:52.482897 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.482766 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:56:52.482897 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.482785 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:56.482770492 +0000 UTC m=+55.343942211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : configmap "kube-rbac-proxy" not found Jul 06 23:56:52.482897 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:52.482802 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:56.482791748 +0000 UTC m=+55.343963467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : secret "insights-runtime-extractor-tls" not found Jul 06 23:56:56.518639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:56.518599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:56.519214 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:56.518671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:56.519214 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:56.518762 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:56:56.519214 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:56.518832 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls podName:278738d3-22b9-4d8b-bdcc-9000d4be09b1 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:04.518816499 +0000 UTC m=+63.379988217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vtk2x" (UID: "278738d3-22b9-4d8b-bdcc-9000d4be09b1") : secret "insights-runtime-extractor-tls" not found Jul 06 23:56:56.519214 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:56.519140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/278738d3-22b9-4d8b-bdcc-9000d4be09b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:56:56.873935 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:56.873908 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:56.874283 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:56.874271 2559 scope.go:117] "RemoveContainer" containerID="edcaae23c7c07d92f5cfda2ad9a89cdc44a8fb85ffa00760ec5d8dd8519295ab" Jul 06 23:56:56.874437 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:56.874419 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hc6zr_openshift-console-operator(4677e488-e259-4482-9914-786385a15b13)\"" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" podUID="4677e488-e259-4482-9914-786385a15b13" Jul 06 23:56:57.095819 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:57.095789 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:56:57.160032 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:56:57.159958 2559 scope.go:117] "RemoveContainer" containerID="edcaae23c7c07d92f5cfda2ad9a89cdc44a8fb85ffa00760ec5d8dd8519295ab" Jul 06 23:56:57.160170 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:56:57.160109 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hc6zr_openshift-console-operator(4677e488-e259-4482-9914-786385a15b13)\"" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" podUID="4677e488-e259-4482-9914-786385a15b13" Jul 06 23:57:02.949509 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:02.949480 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8h5th" Jul 06 23:57:04.594238 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:04.594199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:57:04.596730 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:04.596696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/278738d3-22b9-4d8b-bdcc-9000d4be09b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtk2x\" (UID: \"278738d3-22b9-4d8b-bdcc-9000d4be09b1\") " pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:57:04.660047 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:04.660013 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phqcp\"" Jul 06 23:57:04.667337 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:04.667301 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vtk2x" Jul 06 23:57:04.799360 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:04.799334 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vtk2x"] Jul 06 23:57:04.801859 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:04.801831 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278738d3_22b9_4d8b_bdcc_9000d4be09b1.slice/crio-4c7be573bdf972cce1f9b5b2e473f331dacc7969709020c439914de6b5e8fb0e WatchSource:0}: Error finding container 4c7be573bdf972cce1f9b5b2e473f331dacc7969709020c439914de6b5e8fb0e: Status 404 returned error can't find the container with id 4c7be573bdf972cce1f9b5b2e473f331dacc7969709020c439914de6b5e8fb0e Jul 06 23:57:05.191670 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:05.191569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtk2x" event={"ID":"278738d3-22b9-4d8b-bdcc-9000d4be09b1","Type":"ContainerStarted","Data":"4c7be573bdf972cce1f9b5b2e473f331dacc7969709020c439914de6b5e8fb0e"} Jul 06 23:57:07.319389 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.319345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:57:07.322199 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.322177 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:57:07.332995 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.332944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb5c705-430c-47cb-956f-42a94a8fba69-metrics-certs\") pod \"network-metrics-daemon-v7zbh\" (UID: \"cfb5c705-430c-47cb-956f-42a94a8fba69\") " pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:57:07.420696 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.420640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:57:07.423642 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.423625 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:57:07.434159 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.434126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b63f8f2-0579-4181-bdea-f9934aa9c91c-original-pull-secret\") pod \"global-pull-secret-syncer-kgzw2\" (UID: \"6b63f8f2-0579-4181-bdea-f9934aa9c91c\") " pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:57:07.521207 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.521161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:57:07.524735 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.524710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9wl\" (UniqueName: \"kubernetes.io/projected/2479bb42-8207-49a7-af59-5ede1b14fed2-kube-api-access-ss9wl\") pod \"network-check-target-zxd8t\" (UID: \"2479bb42-8207-49a7-af59-5ede1b14fed2\") " pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:57:07.572509 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.572417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kgzw2" Jul 06 23:57:07.584363 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.584338 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6v6rl\"" Jul 06 23:57:07.589001 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.588976 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m54k2\"" Jul 06 23:57:07.592041 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.592015 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7zbh" Jul 06 23:57:07.596640 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:07.596619 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:57:08.430316 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.430281 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:57:08.430731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.430339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:08.430731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.430379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:57:08.430731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.430429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:08.430731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.430462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:57:08.430731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.430555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:57:08.431276 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.431248 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-service-ca-bundle\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:08.433711 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.433686 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/942671b9-d77b-4f94-9120-df0c83aafbd6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kbr75\" (UID: \"942671b9-d77b-4f94-9120-df0c83aafbd6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:57:08.434164 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.434125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f02f9eb3-78b4-4e40-a9ae-2795432fb956-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tlnbq\" (UID: \"f02f9eb3-78b4-4e40-a9ae-2795432fb956\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:57:08.434325 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.434303 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f6bf8a-7c32-460e-9a92-d148d6cda2f1-metrics-certs\") pod \"router-default-574c44f6c5-xvvzs\" (UID: \"65f6bf8a-7c32-460e-9a92-d148d6cda2f1\") " pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:08.434393 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.434374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8cf44e-dcb9-4d8f-8085-db12e98ede5b-metrics-tls\") pod \"dns-default-87qqj\" (UID: \"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b\") " pod="openshift-dns/dns-default-87qqj" Jul 06 23:57:08.434732 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.434715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"image-registry-6999ff98c-dkb4f\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:57:08.497359 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.497323 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kgzw2"] Jul 06 23:57:08.500796 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:08.500766 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b63f8f2_0579_4181_bdea_f9934aa9c91c.slice/crio-2b5e0fc8b9b4913711169493e1de41986ee8655fa44f8b5ddfe1665ce07982f0 WatchSource:0}: Error finding container 2b5e0fc8b9b4913711169493e1de41986ee8655fa44f8b5ddfe1665ce07982f0: Status 404 returned error can't find the container with id 2b5e0fc8b9b4913711169493e1de41986ee8655fa44f8b5ddfe1665ce07982f0 Jul 06 23:57:08.509683 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.509204 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxd8t"] Jul 06 23:57:08.512441 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:08.512402 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2479bb42_8207_49a7_af59_5ede1b14fed2.slice/crio-9b5d1d85efd42982824738efff58453a6e4be7cae08ff69a00cbddd4131069a0 WatchSource:0}: Error finding container 9b5d1d85efd42982824738efff58453a6e4be7cae08ff69a00cbddd4131069a0: Status 404 returned error can't find the container with id 9b5d1d85efd42982824738efff58453a6e4be7cae08ff69a00cbddd4131069a0 Jul 06 23:57:08.532000 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.531978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:57:08.534542 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.534522 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc5c42-f119-4fbc-b57d-c0167eb8c81e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7tl6n\" (UID: \"97dc5c42-f119-4fbc-b57d-c0167eb8c81e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:57:08.535281 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.535259 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7zbh"] Jul 06 23:57:08.538150 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:08.538085 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb5c705_430c_47cb_956f_42a94a8fba69.slice/crio-3dc6fe9380c524ca068a3b0c9afe1024234dfd804a5f6fea6dfc58d1b131515e WatchSource:0}: Error finding container 3dc6fe9380c524ca068a3b0c9afe1024234dfd804a5f6fea6dfc58d1b131515e: Status 404 returned error can't find the container with id 3dc6fe9380c524ca068a3b0c9afe1024234dfd804a5f6fea6dfc58d1b131515e Jul 06 23:57:08.600115 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.600033 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-scl5n\"" Jul 06 23:57:08.608232 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.608212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" Jul 06 23:57:08.613243 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.613222 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgl2r\"" Jul 06 23:57:08.622059 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.622037 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:57:08.636805 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.636785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hhpww\"" Jul 06 23:57:08.645049 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.645022 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:08.670326 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.670078 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-298qm\"" Jul 06 23:57:08.676506 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.676414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" Jul 06 23:57:08.698309 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.698118 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tpqdc\"" Jul 06 23:57:08.710782 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.709075 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" Jul 06 23:57:08.712060 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.712037 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c6s9h\"" Jul 06 23:57:08.721023 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.720537 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87qqj" Jul 06 23:57:08.788291 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.788180 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75"] Jul 06 23:57:08.835975 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.835889 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6999ff98c-dkb4f"] Jul 06 23:57:08.882904 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.882806 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-574c44f6c5-xvvzs"] Jul 06 23:57:08.890591 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:08.889099 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f6bf8a_7c32_460e_9a92_d148d6cda2f1.slice/crio-9d167b728a331c2b9f00ca735e5d600e2bf3450d261165fecc32b32dab20aa9d WatchSource:0}: Error finding container 9d167b728a331c2b9f00ca735e5d600e2bf3450d261165fecc32b32dab20aa9d: Status 404 returned error can't find the container with id 9d167b728a331c2b9f00ca735e5d600e2bf3450d261165fecc32b32dab20aa9d Jul 06 23:57:08.914819 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.914592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n"] Jul 06 23:57:08.936312 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.936288 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq"] Jul 06 23:57:08.940830 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:08.940804 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02f9eb3_78b4_4e40_a9ae_2795432fb956.slice/crio-92e80a67a542ba3ce1a51acae7bdaf492f90368262646fa03693749825791956 WatchSource:0}: Error finding container 92e80a67a542ba3ce1a51acae7bdaf492f90368262646fa03693749825791956: Status 404 returned error can't find the container with id 92e80a67a542ba3ce1a51acae7bdaf492f90368262646fa03693749825791956 Jul 06 23:57:08.965593 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:08.965524 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87qqj"] Jul 06 23:57:09.074483 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:09.074443 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8cf44e_dcb9_4d8f_8085_db12e98ede5b.slice/crio-34ae1bef192125b3cec2b1f76591006fba01f64e176d0e58cbab0e688e788c90 WatchSource:0}: Error finding container 34ae1bef192125b3cec2b1f76591006fba01f64e176d0e58cbab0e688e788c90: Status 404 returned error can't find the container with id 34ae1bef192125b3cec2b1f76591006fba01f64e176d0e58cbab0e688e788c90 Jul 06 23:57:09.208463 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.208372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87qqj" event={"ID":"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b","Type":"ContainerStarted","Data":"34ae1bef192125b3cec2b1f76591006fba01f64e176d0e58cbab0e688e788c90"} Jul 06 23:57:09.210168 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.210106 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" event={"ID":"f02f9eb3-78b4-4e40-a9ae-2795432fb956","Type":"ContainerStarted","Data":"92e80a67a542ba3ce1a51acae7bdaf492f90368262646fa03693749825791956"} Jul 06 23:57:09.213715 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.212843 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxd8t" event={"ID":"2479bb42-8207-49a7-af59-5ede1b14fed2","Type":"ContainerStarted","Data":"c035cc2d1977d78dc5527bf58a6db7f34e1f97f35fb2143a016f99fd769dcdd7"} Jul 06 23:57:09.213715 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.212885 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxd8t" event={"ID":"2479bb42-8207-49a7-af59-5ede1b14fed2","Type":"ContainerStarted","Data":"9b5d1d85efd42982824738efff58453a6e4be7cae08ff69a00cbddd4131069a0"} Jul 06 23:57:09.213715 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.213572 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:57:09.215850 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.215237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" event={"ID":"65f6bf8a-7c32-460e-9a92-d148d6cda2f1","Type":"ContainerStarted","Data":"bd78df065981dbb2b6e820161c1ee0ebd2c238061c32c420430c04316a2e1089"} Jul 06 23:57:09.215850 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.215278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" event={"ID":"65f6bf8a-7c32-460e-9a92-d148d6cda2f1","Type":"ContainerStarted","Data":"9d167b728a331c2b9f00ca735e5d600e2bf3450d261165fecc32b32dab20aa9d"} Jul 06 23:57:09.219167 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.219138 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtk2x" event={"ID":"278738d3-22b9-4d8b-bdcc-9000d4be09b1","Type":"ContainerStarted","Data":"167bde8687f6e7f8d0ea20436d744054400f8353adc7c18efaf2ead3a9b7c1fe"} Jul 06 23:57:09.219292 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.219208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtk2x" event={"ID":"278738d3-22b9-4d8b-bdcc-9000d4be09b1","Type":"ContainerStarted","Data":"a2e7de8f31b0c0d716deb313fdfd62e51a7ede1474e824f595dc58f7710ffae5"} Jul 06 23:57:09.220736 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.220676 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" event={"ID":"97dc5c42-f119-4fbc-b57d-c0167eb8c81e","Type":"ContainerStarted","Data":"1f98fe4cb4fa3f96c210b0945c120de00cf9e1ad253280dd7bae4776db221784"} Jul 06 23:57:09.222699 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.222577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" event={"ID":"35864c42-ff25-4374-8b20-241f2d7a85cc","Type":"ContainerStarted","Data":"af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520"} Jul 06 23:57:09.222699 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.222618 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" event={"ID":"35864c42-ff25-4374-8b20-241f2d7a85cc","Type":"ContainerStarted","Data":"81c594d4310b5ee50f586b91195cf8efce0498681c194d372de2e5c57999c7da"} Jul 06 23:57:09.223202 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.223142 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:57:09.224534 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.224511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" event={"ID":"942671b9-d77b-4f94-9120-df0c83aafbd6","Type":"ContainerStarted","Data":"3cc9a20ed8221e17ea0efbd61ef15d99a2c4a559f39a368a1c5e91711af8c375"} Jul 06 23:57:09.226096 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.226073 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7zbh" event={"ID":"cfb5c705-430c-47cb-956f-42a94a8fba69","Type":"ContainerStarted","Data":"3dc6fe9380c524ca068a3b0c9afe1024234dfd804a5f6fea6dfc58d1b131515e"} Jul 06 23:57:09.227221 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.227162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kgzw2" event={"ID":"6b63f8f2-0579-4181-bdea-f9934aa9c91c","Type":"ContainerStarted","Data":"2b5e0fc8b9b4913711169493e1de41986ee8655fa44f8b5ddfe1665ce07982f0"} Jul 06 23:57:09.231401 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.231260 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zxd8t" podStartSLOduration=67.231242281 podStartE2EDuration="1m7.231242281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:09.229730388 +0000 UTC m=+68.090902135" watchObservedRunningTime="2026-07-06 23:57:09.231242281 +0000 UTC m=+68.092414026" Jul 06 23:57:09.252167 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.252110 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" podStartSLOduration=67.252093717 podStartE2EDuration="1m7.252093717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:09.251120919 +0000 UTC m=+68.112292662" watchObservedRunningTime="2026-07-06 23:57:09.252093717 +0000 UTC m=+68.113265457" Jul 06 23:57:09.273369 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.273319 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" podStartSLOduration=53.273302238 podStartE2EDuration="53.273302238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:09.272719559 +0000 UTC m=+68.133891301" watchObservedRunningTime="2026-07-06 23:57:09.273302238 +0000 UTC m=+68.134473978" Jul 06 23:57:09.646042 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.645957 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:09.649069 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:09.648854 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:10.232560 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:10.232490 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:10.234560 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:10.234535 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-574c44f6c5-xvvzs" Jul 06 23:57:10.660136 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:10.660110 2559 scope.go:117] "RemoveContainer" containerID="edcaae23c7c07d92f5cfda2ad9a89cdc44a8fb85ffa00760ec5d8dd8519295ab" Jul 06 23:57:16.258632 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.258584 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtk2x" event={"ID":"278738d3-22b9-4d8b-bdcc-9000d4be09b1","Type":"ContainerStarted","Data":"64b6aa1be1d7002d786ab39fc41437a35c370d8db040b3447da37ded57363950"} Jul 06 23:57:16.260549 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.260216 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" event={"ID":"97dc5c42-f119-4fbc-b57d-c0167eb8c81e","Type":"ContainerStarted","Data":"0bca30d209c2d2f02a3b73b0fa91f4cda3dc2199fa17d7a35e5a6335b0c3cf4d"} Jul 06 23:57:16.262090 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.262060 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" event={"ID":"942671b9-d77b-4f94-9120-df0c83aafbd6","Type":"ContainerStarted","Data":"77e5a09488513196ac42cd49f6d0cbd4ee80ef18ba1db9b376c4f434bbacd137"} Jul 06 23:57:16.262187 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.262116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" event={"ID":"942671b9-d77b-4f94-9120-df0c83aafbd6","Type":"ContainerStarted","Data":"151e1401030161f0d5ccbf54fc87e3aa9695425f484c6f3a5a10df6d69850034"} Jul 06 23:57:16.264120 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.264038 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7zbh" event={"ID":"cfb5c705-430c-47cb-956f-42a94a8fba69","Type":"ContainerStarted","Data":"bfb41010fc6acf0c160a85da676400e1d4e37a90cbca3596cb3b766f5dd61543"} Jul 06 23:57:16.264120 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.264088 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7zbh" event={"ID":"cfb5c705-430c-47cb-956f-42a94a8fba69","Type":"ContainerStarted","Data":"773d9ac995ac4b8860f929c6f69dacd3293a9844354060ffa7d85c10936db1cb"} Jul 06 23:57:16.265462 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.265438 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kgzw2" event={"ID":"6b63f8f2-0579-4181-bdea-f9934aa9c91c","Type":"ContainerStarted","Data":"b30a9b287b56e93d895d378f68cd2b725fefca05821aa7144f979e2b30ba180f"} Jul 06 23:57:16.267299 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.267276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87qqj" event={"ID":"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b","Type":"ContainerStarted","Data":"d3ff518fee5c6a3a1c406000553bbff98f0fad7471247372682945a8bc10b35b"} Jul 06 23:57:16.267391 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.267321 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87qqj" event={"ID":"0a8cf44e-dcb9-4d8f-8085-db12e98ede5b","Type":"ContainerStarted","Data":"d1472e7c92cac8c3c39251c88d7f579df2f1b4a727b38e7b2fdc48a8b35981e9"} Jul 06 23:57:16.267391 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.267350 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-87qqj" Jul 06 23:57:16.268834 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.268812 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" event={"ID":"f02f9eb3-78b4-4e40-a9ae-2795432fb956","Type":"ContainerStarted","Data":"9b7f9c8ced6719ec553cf354c6ac958df7fe2767766f0a6a3cce9f410e4125ac"} Jul 06 23:57:16.270619 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.270601 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 06 23:57:16.270731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.270675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" event={"ID":"4677e488-e259-4482-9914-786385a15b13","Type":"ContainerStarted","Data":"4e616e3e83ea2ae6a6035bd7a52c1b5c893e612325a21bffd69c3280b39c8ef4"} Jul 06 23:57:16.270912 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.270896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:57:16.312532 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.312482 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vtk2x" podStartSLOduration=17.746894007 podStartE2EDuration="28.312465874s" totalImagesPullingTime="10.565571867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.283152305 +0000 UTC m=+75.144324047" watchObservedRunningTime="2026-07-06 23:57:16.312465874 +0000 UTC m=+75.173637606" Jul 06 23:57:16.332421 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.332364 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v7zbh" podStartSLOduration=70.200377069 podStartE2EDuration="1m15.332343501s" totalImagesPullingTime="5.131966432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.332048586 +0000 UTC m=+75.193220327" watchObservedRunningTime="2026-07-06 23:57:16.332343501 +0000 UTC m=+75.193515244" Jul 06 23:57:16.355895 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.355844 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kbr75" podStartSLOduration=53.715365073 podStartE2EDuration="1m0.355827088s" totalImagesPullingTime="6.640462015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.354373996 +0000 UTC m=+75.215545737" watchObservedRunningTime="2026-07-06 23:57:16.355827088 +0000 UTC m=+75.216998829" Jul 06 23:57:16.389767 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.389632 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kgzw2" podStartSLOduration=67.005500496 podStartE2EDuration="1m14.389611049s" totalImagesPullingTime="7.384110553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.389575782 +0000 UTC m=+75.250747526" watchObservedRunningTime="2026-07-06 23:57:16.389611049 +0000 UTC m=+75.250782790" Jul 06 23:57:16.413427 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.413369 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7tl6n" podStartSLOduration=44.8812262 podStartE2EDuration="51.413346883s" totalImagesPullingTime="6.532120683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.410155675 +0000 UTC m=+75.271327416" watchObservedRunningTime="2026-07-06 23:57:16.413346883 +0000 UTC m=+75.274518627" Jul 06 23:57:16.437479 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.437419 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tlnbq" podStartSLOduration=53.860137486 podStartE2EDuration="1m0.43740076s" totalImagesPullingTime="6.577263274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.436418124 +0000 UTC m=+75.297589870" watchObservedRunningTime="2026-07-06 23:57:16.43740076 +0000 UTC m=+75.298572500" Jul 06 23:57:16.513229 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.513075 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-87qqj" podStartSLOduration=34.06531307 podStartE2EDuration="40.513053468s" totalImagesPullingTime="6.447740398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.512332013 +0000 UTC m=+75.373503766" watchObservedRunningTime="2026-07-06 23:57:16.513053468 +0000 UTC m=+75.374225209" Jul 06 23:57:16.544943 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:16.544909 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-hc6zr" Jul 06 23:57:24.050778 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.050643 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr"] Jul 06 23:57:24.053974 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.053953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.056745 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.056719 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 23:57:24.057876 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.057854 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r5kqz\"" Jul 06 23:57:24.057984 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.057858 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 23:57:24.057984 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.057858 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 23:57:24.062135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.062111 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bglck"] Jul 06 23:57:24.064807 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.064790 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.067618 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.067601 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 23:57:24.067748 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.067600 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 23:57:24.067924 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.067907 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 23:57:24.068067 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.068046 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ptknx\"" Jul 06 23:57:24.077179 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.077146 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr"] Jul 06 23:57:24.170463 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-metrics-client-ca\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170463 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-wtmp\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrx6d\" (UniqueName: \"kubernetes.io/projected/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-kube-api-access-jrx6d\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.170686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-root\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.170686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-textfile\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-tls\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170686 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.170926 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrcs\" (UniqueName: \"kubernetes.io/projected/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-kube-api-access-2jrcs\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.170926 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-sys\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170926 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.170926 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.170754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-accelerators-collector-config\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271314 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-sys\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271314 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271561 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-accelerators-collector-config\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271561 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-metrics-client-ca\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271561 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-sys\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271561 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-wtmp\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrx6d\" (UniqueName: \"kubernetes.io/projected/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-kube-api-access-jrx6d\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.271803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271638 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-root\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-root\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.271803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-wtmp\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.272070 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.272070 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-textfile\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.272070 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.271881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-tls\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.272070 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.272047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-metrics-client-ca\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.272267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.272119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-accelerators-collector-config\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.272267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.272164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.272267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.272187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-textfile\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.272267 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.272204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrcs\" (UniqueName: \"kubernetes.io/projected/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-kube-api-access-2jrcs\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.272503 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.272479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.274390 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.274367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.274514 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.274493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-tls\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.274572 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.274554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.274613 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.274568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.305045 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.304975 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrcs\" (UniqueName: \"kubernetes.io/projected/e5e7dc2d-ba91-4318-b2f1-8606b2a7083f-kube-api-access-2jrcs\") pod \"openshift-state-metrics-54cf96dfcf-6mdgr\" (UID: \"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.314873 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.314846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrx6d\" (UniqueName: \"kubernetes.io/projected/6f9c0d42-d15e-4bf8-bb18-14235ac8922d-kube-api-access-jrx6d\") pod \"node-exporter-bglck\" (UID: \"6f9c0d42-d15e-4bf8-bb18-14235ac8922d\") " pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.364792 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.364756 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" Jul 06 23:57:24.372700 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.372672 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bglck" Jul 06 23:57:24.383691 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:24.383644 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9c0d42_d15e_4bf8_bb18_14235ac8922d.slice/crio-a1d8c7b29b4e42e49dcdbed31a0790295d2e57012162ce0665f0170794b4c886 WatchSource:0}: Error finding container a1d8c7b29b4e42e49dcdbed31a0790295d2e57012162ce0665f0170794b4c886: Status 404 returned error can't find the container with id a1d8c7b29b4e42e49dcdbed31a0790295d2e57012162ce0665f0170794b4c886 Jul 06 23:57:24.521468 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:24.521433 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr"] Jul 06 23:57:24.525207 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:24.525181 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e7dc2d_ba91_4318_b2f1_8606b2a7083f.slice/crio-b35e938a5898dba49b001f9e869828f682872f7ccbe9ba5ba4ada95284336100 WatchSource:0}: Error finding container b35e938a5898dba49b001f9e869828f682872f7ccbe9ba5ba4ada95284336100: Status 404 returned error can't find the container with id b35e938a5898dba49b001f9e869828f682872f7ccbe9ba5ba4ada95284336100 Jul 06 23:57:25.311371 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:25.311328 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bglck" event={"ID":"6f9c0d42-d15e-4bf8-bb18-14235ac8922d","Type":"ContainerStarted","Data":"a1d8c7b29b4e42e49dcdbed31a0790295d2e57012162ce0665f0170794b4c886"} Jul 06 23:57:25.313409 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:25.313380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" event={"ID":"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f","Type":"ContainerStarted","Data":"17fce2ba5bebe5b0d0ddf60924d9f305e08df67034b84d15094fcaf66ca1648f"} Jul 06 23:57:25.313550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:25.313443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" event={"ID":"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f","Type":"ContainerStarted","Data":"2184c4b5ad7c7361a28f86f15bbac0072c2cff57e6b0ed07ab01a918e962abb0"} Jul 06 23:57:25.313550 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:25.313474 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" event={"ID":"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f","Type":"ContainerStarted","Data":"b35e938a5898dba49b001f9e869828f682872f7ccbe9ba5ba4ada95284336100"} Jul 06 23:57:26.280092 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.280060 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-87qqj" Jul 06 23:57:26.319790 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.319750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" event={"ID":"e5e7dc2d-ba91-4318-b2f1-8606b2a7083f","Type":"ContainerStarted","Data":"cb3e4548f3e0944b543a37652c6192d5cf8645ce27e90421329fb0b103869ccf"} Jul 06 23:57:26.321524 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.321498 2559 generic.go:356] "Generic (PLEG): container finished" podID="6f9c0d42-d15e-4bf8-bb18-14235ac8922d" containerID="eea59e212dc260581d920e9f0396064cd5a737cb8ed791658dd5efbc03212c79" exitCode=0 Jul 06 23:57:26.321675 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.321560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bglck" event={"ID":"6f9c0d42-d15e-4bf8-bb18-14235ac8922d","Type":"ContainerDied","Data":"eea59e212dc260581d920e9f0396064cd5a737cb8ed791658dd5efbc03212c79"} Jul 06 23:57:26.343035 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.342982 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6mdgr" podStartSLOduration=1.462975878 podStartE2EDuration="2.342964582s" totalImagesPullingTime="879.988704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:26.34244062 +0000 UTC m=+85.203612363" watchObservedRunningTime="2026-07-06 23:57:26.342964582 +0000 UTC m=+85.204136322" Jul 06 23:57:26.846349 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.846318 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84d8668d7-fzs29"] Jul 06 23:57:26.849167 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.849150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.852093 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.852070 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 23:57:26.852258 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.852158 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 23:57:26.852258 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.852161 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-brdcepsccoi5\"" Jul 06 23:57:26.852714 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.852697 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 23:57:26.852795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.852732 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 23:57:26.852795 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.852743 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 23:57:26.852980 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.852842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mcs2q\"" Jul 06 23:57:26.868527 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.868494 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d8668d7-fzs29"] Jul 06 23:57:26.997357 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.997357 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55fec463-0cac-40e4-bcf3-8482f147466e-metrics-client-ca\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.997357 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.997717 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.997717 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.997717 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-tls\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.997717 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-grpc-tls\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:26.997717 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:26.997560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcfv6\" (UniqueName: \"kubernetes.io/projected/55fec463-0cac-40e4-bcf3-8482f147466e-kube-api-access-pcfv6\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098178 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098178 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098178 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-tls\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098178 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-grpc-tls\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098475 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098193 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcfv6\" (UniqueName: \"kubernetes.io/projected/55fec463-0cac-40e4-bcf3-8482f147466e-kube-api-access-pcfv6\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098475 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098217 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098475 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55fec463-0cac-40e4-bcf3-8482f147466e-metrics-client-ca\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.098475 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.098268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.099107 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.099074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55fec463-0cac-40e4-bcf3-8482f147466e-metrics-client-ca\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.101027 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.101000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.101128 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.101088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.101280 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.101263 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-grpc-tls\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.101355 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.101334 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.101893 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.101878 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-tls\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.101946 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.101921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55fec463-0cac-40e4-bcf3-8482f147466e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.106730 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.106709 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcfv6\" (UniqueName: \"kubernetes.io/projected/55fec463-0cac-40e4-bcf3-8482f147466e-kube-api-access-pcfv6\") pod \"thanos-querier-84d8668d7-fzs29\" (UID: \"55fec463-0cac-40e4-bcf3-8482f147466e\") " pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.158711 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.158678 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:27.305894 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.305870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d8668d7-fzs29"] Jul 06 23:57:27.308288 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:27.308260 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fec463_0cac_40e4_bcf3_8482f147466e.slice/crio-75bd6e9e7313bd1caca584acc68da97b0c4f9b38a0a59bbd20547173f61d5c12 WatchSource:0}: Error finding container 75bd6e9e7313bd1caca584acc68da97b0c4f9b38a0a59bbd20547173f61d5c12: Status 404 returned error can't find the container with id 75bd6e9e7313bd1caca584acc68da97b0c4f9b38a0a59bbd20547173f61d5c12 Jul 06 23:57:27.326791 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.326746 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" event={"ID":"55fec463-0cac-40e4-bcf3-8482f147466e","Type":"ContainerStarted","Data":"75bd6e9e7313bd1caca584acc68da97b0c4f9b38a0a59bbd20547173f61d5c12"} Jul 06 23:57:27.328926 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.328893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bglck" event={"ID":"6f9c0d42-d15e-4bf8-bb18-14235ac8922d","Type":"ContainerStarted","Data":"1321846aa39c9faf8d844c3d7f1066d9daaee7604318eda5fa69e2fd75ff999f"} Jul 06 23:57:27.329036 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.328949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bglck" event={"ID":"6f9c0d42-d15e-4bf8-bb18-14235ac8922d","Type":"ContainerStarted","Data":"d8d303cd14b3fc962de2f87ec252cb3832093eb6303c6af8df2515413cc28307"} Jul 06 23:57:27.349568 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:27.349470 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bglck" podStartSLOduration=2.138307099 podStartE2EDuration="3.349450071s" totalImagesPullingTime="1.134062542s" totalInitContainerRuntime="77.08043ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:27.34797068 +0000 UTC m=+86.209142421" watchObservedRunningTime="2026-07-06 23:57:27.349450071 +0000 UTC m=+86.210621814" Jul 06 23:57:28.108187 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.108144 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-688df956bc-9hkr2"] Jul 06 23:57:28.114091 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.110671 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.114546 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.114519 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 23:57:28.114771 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.114621 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 23:57:28.114771 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.114641 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 23:57:28.115827 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.115806 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 23:57:28.115963 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.115841 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 23:57:28.115963 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.115852 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 23:57:28.116138 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.116122 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 23:57:28.116244 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.116227 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5t4d7\"" Jul 06 23:57:28.124638 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.124605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688df956bc-9hkr2"] Jul 06 23:57:28.210767 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.210727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-serving-cert\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.210959 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.210796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-service-ca\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.210959 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.210836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnv5p\" (UniqueName: \"kubernetes.io/projected/436e5db4-c6ac-49b3-963b-a03c5ed62bce-kube-api-access-wnv5p\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.210959 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.210871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-oauth-config\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.210959 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.210899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-config\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.210959 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.210931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-oauth-serving-cert\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.311870 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.311830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-serving-cert\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312074 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.311947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-service-ca\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312074 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.311999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnv5p\" (UniqueName: \"kubernetes.io/projected/436e5db4-c6ac-49b3-963b-a03c5ed62bce-kube-api-access-wnv5p\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312074 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.312036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-oauth-config\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312074 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.312065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-config\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312284 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.312226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-oauth-serving-cert\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312709 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.312685 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-config\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312821 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.312723 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-service-ca\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.312865 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.312853 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-oauth-serving-cert\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.314388 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.314366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-serving-cert\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.314525 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.314509 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-oauth-config\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.322713 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.322688 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnv5p\" (UniqueName: \"kubernetes.io/projected/436e5db4-c6ac-49b3-963b-a03c5ed62bce-kube-api-access-wnv5p\") pod \"console-688df956bc-9hkr2\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.425952 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.425910 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:28.586928 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.586900 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688df956bc-9hkr2"] Jul 06 23:57:28.706293 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.706209 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-568b458b98-p72r6"] Jul 06 23:57:28.708940 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.708918 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.712299 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.712275 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 23:57:28.712803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.712780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 23:57:28.712918 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.712780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 23:57:28.713171 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.713151 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-88f5f28e4u66r\"" Jul 06 23:57:28.713278 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.713183 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mglqc\"" Jul 06 23:57:28.713278 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.713206 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 23:57:28.724301 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.724271 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-568b458b98-p72r6"] Jul 06 23:57:28.816539 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.816497 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-secret-metrics-server-tls\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.816747 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.816559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e15de56c-dcf4-4cf5-aad6-739ce670784f-audit-log\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.816747 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.816584 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-client-ca-bundle\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.816747 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.816679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-secret-metrics-server-client-certs\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.816747 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.816737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-648h8\" (UniqueName: \"kubernetes.io/projected/e15de56c-dcf4-4cf5-aad6-739ce670784f-kube-api-access-648h8\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.816894 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.816791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e15de56c-dcf4-4cf5-aad6-739ce670784f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.816894 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.816843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e15de56c-dcf4-4cf5-aad6-739ce670784f-metrics-server-audit-profiles\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.917721 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.917680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-secret-metrics-server-client-certs\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.917721 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.917727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-648h8\" (UniqueName: \"kubernetes.io/projected/e15de56c-dcf4-4cf5-aad6-739ce670784f-kube-api-access-648h8\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.917951 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.917764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e15de56c-dcf4-4cf5-aad6-739ce670784f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.917951 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.917805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e15de56c-dcf4-4cf5-aad6-739ce670784f-metrics-server-audit-profiles\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.917951 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.917853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-secret-metrics-server-tls\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.917951 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.917903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e15de56c-dcf4-4cf5-aad6-739ce670784f-audit-log\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.917951 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.917927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-client-ca-bundle\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.918441 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.918413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e15de56c-dcf4-4cf5-aad6-739ce670784f-audit-log\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.918694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.918619 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e15de56c-dcf4-4cf5-aad6-739ce670784f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.919343 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.919320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e15de56c-dcf4-4cf5-aad6-739ce670784f-metrics-server-audit-profiles\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.920642 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.920618 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-secret-metrics-server-client-certs\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.920837 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.920817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-client-ca-bundle\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.920939 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.920878 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e15de56c-dcf4-4cf5-aad6-739ce670784f-secret-metrics-server-tls\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:28.928694 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:28.928665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-648h8\" (UniqueName: \"kubernetes.io/projected/e15de56c-dcf4-4cf5-aad6-739ce670784f-kube-api-access-648h8\") pod \"metrics-server-568b458b98-p72r6\" (UID: \"e15de56c-dcf4-4cf5-aad6-739ce670784f\") " pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:29.020604 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:29.020507 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:29.073128 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:29.073096 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436e5db4_c6ac_49b3_963b_a03c5ed62bce.slice/crio-a9284d9ff34fcd811a6d0736e876bf6fb9692ca846b5710359a1e4b4e2561ce5 WatchSource:0}: Error finding container a9284d9ff34fcd811a6d0736e876bf6fb9692ca846b5710359a1e4b4e2561ce5: Status 404 returned error can't find the container with id a9284d9ff34fcd811a6d0736e876bf6fb9692ca846b5710359a1e4b4e2561ce5 Jul 06 23:57:29.220397 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:29.220368 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-568b458b98-p72r6"] Jul 06 23:57:29.224717 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:29.224645 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15de56c_dcf4_4cf5_aad6_739ce670784f.slice/crio-f13afc4b1f39e1763153ec01593845c90417aa33f97512a2d009621f345aa16a WatchSource:0}: Error finding container f13afc4b1f39e1763153ec01593845c90417aa33f97512a2d009621f345aa16a: Status 404 returned error can't find the container with id f13afc4b1f39e1763153ec01593845c90417aa33f97512a2d009621f345aa16a Jul 06 23:57:29.338109 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:29.338069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" event={"ID":"e15de56c-dcf4-4cf5-aad6-739ce670784f","Type":"ContainerStarted","Data":"f13afc4b1f39e1763153ec01593845c90417aa33f97512a2d009621f345aa16a"} Jul 06 23:57:29.339365 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:29.339338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688df956bc-9hkr2" event={"ID":"436e5db4-c6ac-49b3-963b-a03c5ed62bce","Type":"ContainerStarted","Data":"a9284d9ff34fcd811a6d0736e876bf6fb9692ca846b5710359a1e4b4e2561ce5"} Jul 06 23:57:29.341303 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:29.341278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" event={"ID":"55fec463-0cac-40e4-bcf3-8482f147466e","Type":"ContainerStarted","Data":"cecc46c3de97bb5f6013e5df28dae63c099c2e72a0ce3d60a316fe315a121bad"} Jul 06 23:57:29.341393 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:29.341332 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" event={"ID":"55fec463-0cac-40e4-bcf3-8482f147466e","Type":"ContainerStarted","Data":"1e09a923ef65e853f9a71935b07771ff25825c56c286aa49340f9ce488dbe07e"} Jul 06 23:57:29.341393 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:29.341356 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" event={"ID":"55fec463-0cac-40e4-bcf3-8482f147466e","Type":"ContainerStarted","Data":"98982a72bd8a9d902441da7063687071ed345a8aaebccfd7c34306de4bf1722d"} Jul 06 23:57:30.350754 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:30.350707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" event={"ID":"55fec463-0cac-40e4-bcf3-8482f147466e","Type":"ContainerStarted","Data":"e4e0f69509203fff9bfa6317a5457269402ae6a774b7c74b08bb259abe1c7a3f"} Jul 06 23:57:30.351130 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:30.350800 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" event={"ID":"55fec463-0cac-40e4-bcf3-8482f147466e","Type":"ContainerStarted","Data":"9023f614da3c93a890bcc4bd54ea43de8b7ac9679bac16bf3f67e35cbcce7dd7"} Jul 06 23:57:31.243290 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:31.242540 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:57:31.358744 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:31.358703 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" event={"ID":"55fec463-0cac-40e4-bcf3-8482f147466e","Type":"ContainerStarted","Data":"5f8d898711962cd28b8fe9dbbc6e8cfa9aa390880b3d49be43152890e2c5d313"} Jul 06 23:57:31.359198 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:31.358953 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:31.360603 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:31.360577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" event={"ID":"e15de56c-dcf4-4cf5-aad6-739ce670784f","Type":"ContainerStarted","Data":"2a990622d0ca62f0949d79c83d6df5bfcc051c55b7a0c8409213472dcb4c3859"} Jul 06 23:57:31.407739 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:31.407674 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" podStartSLOduration=2.778728373 podStartE2EDuration="5.407636123s" totalImagesPullingTime="2.62890775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:31.388001722 +0000 UTC m=+90.249173464" watchObservedRunningTime="2026-07-06 23:57:31.407636123 +0000 UTC m=+90.268807865" Jul 06 23:57:31.409066 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:31.409022 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" podStartSLOduration=1.8922440900000002 podStartE2EDuration="3.409010706s" totalImagesPullingTime="1.516766616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:31.406360846 +0000 UTC m=+90.267532589" watchObservedRunningTime="2026-07-06 23:57:31.409010706 +0000 UTC m=+90.270182447" Jul 06 23:57:32.366197 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:32.366097 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688df956bc-9hkr2" event={"ID":"436e5db4-c6ac-49b3-963b-a03c5ed62bce","Type":"ContainerStarted","Data":"2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534"} Jul 06 23:57:32.402177 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:32.402118 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-688df956bc-9hkr2" podStartSLOduration=1.445056377 podStartE2EDuration="4.402096942s" totalImagesPullingTime="2.957040565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:32.401541974 +0000 UTC m=+91.262713716" watchObservedRunningTime="2026-07-06 23:57:32.402096942 +0000 UTC m=+91.263268685" Jul 06 23:57:35.556861 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:35.556823 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6999ff98c-dkb4f"] Jul 06 23:57:37.373130 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.373101 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84d8668d7-fzs29" Jul 06 23:57:37.812090 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.812009 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f74ff988-4bnq4"] Jul 06 23:57:37.814752 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.814735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.832007 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.831985 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 23:57:37.842548 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.842522 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f74ff988-4bnq4"] Jul 06 23:57:37.897975 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.897936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-oauth-serving-cert\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.898191 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.897995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-trusted-ca-bundle\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.898191 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.898102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-console-config\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.898191 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.898143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-oauth-config\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.898328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.898202 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cg2r\" (UniqueName: \"kubernetes.io/projected/cc738397-7004-4044-9c98-b5071ee835f1-kube-api-access-4cg2r\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.898328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.898225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-service-ca\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.898328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.898276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-serving-cert\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.999519 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.999476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cg2r\" (UniqueName: \"kubernetes.io/projected/cc738397-7004-4044-9c98-b5071ee835f1-kube-api-access-4cg2r\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.999519 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.999521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-service-ca\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.999800 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.999546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-serving-cert\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.999800 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.999568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-oauth-serving-cert\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.999800 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.999639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-trusted-ca-bundle\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.999800 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.999732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-console-config\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:37.999800 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:37.999757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-oauth-config\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.000451 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.000364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-service-ca\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.000451 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.000364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-oauth-serving-cert\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.000451 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.000407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-console-config\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.000814 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.000789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-trusted-ca-bundle\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.002186 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.002166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-serving-cert\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.002402 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.002381 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-oauth-config\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.009604 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.009578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cg2r\" (UniqueName: \"kubernetes.io/projected/cc738397-7004-4044-9c98-b5071ee835f1-kube-api-access-4cg2r\") pod \"console-54f74ff988-4bnq4\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.124645 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.124610 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:38.288026 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.287993 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f74ff988-4bnq4"] Jul 06 23:57:38.290928 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:38.290898 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc738397_7004_4044_9c98_b5071ee835f1.slice/crio-21fe6d92d7e12508d391871f15906206a62da6b3cdcaa4990af2a72716a09208 WatchSource:0}: Error finding container 21fe6d92d7e12508d391871f15906206a62da6b3cdcaa4990af2a72716a09208: Status 404 returned error can't find the container with id 21fe6d92d7e12508d391871f15906206a62da6b3cdcaa4990af2a72716a09208 Jul 06 23:57:38.392542 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.392401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f74ff988-4bnq4" event={"ID":"cc738397-7004-4044-9c98-b5071ee835f1","Type":"ContainerStarted","Data":"c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb"} Jul 06 23:57:38.392542 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.392461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f74ff988-4bnq4" event={"ID":"cc738397-7004-4044-9c98-b5071ee835f1","Type":"ContainerStarted","Data":"21fe6d92d7e12508d391871f15906206a62da6b3cdcaa4990af2a72716a09208"} Jul 06 23:57:38.419873 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.419820 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f74ff988-4bnq4" podStartSLOduration=1.419801759 podStartE2EDuration="1.419801759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:38.418390685 +0000 UTC m=+97.279562429" watchObservedRunningTime="2026-07-06 23:57:38.419801759 +0000 UTC m=+97.280973500" Jul 06 23:57:38.426578 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.426550 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:38.426767 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.426611 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:38.431403 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:38.431379 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:39.400482 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:39.400454 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:57:41.240672 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:41.240620 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zxd8t" Jul 06 23:57:43.861982 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.861947 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f74ff988-4bnq4"] Jul 06 23:57:43.899696 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.899642 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df5dff768-zhx8w"] Jul 06 23:57:43.913842 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.913812 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df5dff768-zhx8w"] Jul 06 23:57:43.914013 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.913903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:43.955423 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.955382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-trusted-ca-bundle\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:43.955588 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.955440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-config\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:43.955588 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.955483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-service-ca\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:43.955588 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.955519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjcxs\" (UniqueName: \"kubernetes.io/projected/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-kube-api-access-xjcxs\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:43.955588 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.955578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-oauth-serving-cert\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:43.955753 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.955620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-serving-cert\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:43.955753 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:43.955695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-oauth-config\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.056441 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.056402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-oauth-config\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.056441 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.056445 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-trusted-ca-bundle\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.056731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.056488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-config\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.056731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.056505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-service-ca\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.056731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.056522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjcxs\" (UniqueName: \"kubernetes.io/projected/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-kube-api-access-xjcxs\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.056731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.056547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-oauth-serving-cert\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.056731 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.056585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-serving-cert\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.057337 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.057313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-config\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.057424 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.057397 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-oauth-serving-cert\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.057558 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.057541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-trusted-ca-bundle\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.057718 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.057694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-service-ca\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.059246 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.059218 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-oauth-config\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.059352 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.059227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-serving-cert\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.065831 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.065811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjcxs\" (UniqueName: \"kubernetes.io/projected/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-kube-api-access-xjcxs\") pod \"console-6df5dff768-zhx8w\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.223523 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.223492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:44.362007 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.361980 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df5dff768-zhx8w"] Jul 06 23:57:44.364021 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:57:44.363994 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1879e1a6_b4f7_48f9_892a_949f61e5b8fd.slice/crio-ad105d053ae0b08f643e4ad35b0057662c3c5ca6141474f924af6622f4e8c331 WatchSource:0}: Error finding container ad105d053ae0b08f643e4ad35b0057662c3c5ca6141474f924af6622f4e8c331: Status 404 returned error can't find the container with id ad105d053ae0b08f643e4ad35b0057662c3c5ca6141474f924af6622f4e8c331 Jul 06 23:57:44.418019 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:44.417983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df5dff768-zhx8w" event={"ID":"1879e1a6-b4f7-48f9-892a-949f61e5b8fd","Type":"ContainerStarted","Data":"ad105d053ae0b08f643e4ad35b0057662c3c5ca6141474f924af6622f4e8c331"} Jul 06 23:57:45.424227 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:45.424191 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df5dff768-zhx8w" event={"ID":"1879e1a6-b4f7-48f9-892a-949f61e5b8fd","Type":"ContainerStarted","Data":"4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c"} Jul 06 23:57:45.443518 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:45.443465 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df5dff768-zhx8w" podStartSLOduration=2.443448471 podStartE2EDuration="2.443448471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:45.44205181 +0000 UTC m=+104.303223550" watchObservedRunningTime="2026-07-06 23:57:45.443448471 +0000 UTC m=+104.304620211" Jul 06 23:57:48.124760 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:48.124721 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:57:49.021488 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:49.021449 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:49.021699 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:49.021516 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:57:53.463419 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:53.463379 2559 generic.go:356] "Generic (PLEG): container finished" podID="33f5d3f9-ee8d-49f8-a137-3819fe039137" containerID="242cb741106adcee4497f44ddba5c67353f007d8a9d54aefe22a8e00d586a7a6" exitCode=0 Jul 06 23:57:53.463849 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:53.463456 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" event={"ID":"33f5d3f9-ee8d-49f8-a137-3819fe039137","Type":"ContainerDied","Data":"242cb741106adcee4497f44ddba5c67353f007d8a9d54aefe22a8e00d586a7a6"} Jul 06 23:57:53.463893 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:53.463865 2559 scope.go:117] "RemoveContainer" containerID="242cb741106adcee4497f44ddba5c67353f007d8a9d54aefe22a8e00d586a7a6" Jul 06 23:57:54.223985 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:54.223948 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:54.224183 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:54.224013 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:54.228755 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:54.228733 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:54.469306 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:54.469268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h5wj9" event={"ID":"33f5d3f9-ee8d-49f8-a137-3819fe039137","Type":"ContainerStarted","Data":"bf4786b7f243be51c9ff2942354ee5d4cfcb1fff9a04785b60383f54b0bc4b45"} Jul 06 23:57:54.476475 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:54.476402 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:57:54.548906 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:54.548867 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688df956bc-9hkr2"] Jul 06 23:57:58.492931 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:58.492898 2559 generic.go:356] "Generic (PLEG): container finished" podID="ffd1bf71-2832-4504-8157-28bce1fd2fec" containerID="f90c95698776fe72bcaaa364c866c397551154289f94c621ea885ac62357bfab" exitCode=0 Jul 06 23:57:58.493359 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:58.492957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" event={"ID":"ffd1bf71-2832-4504-8157-28bce1fd2fec","Type":"ContainerDied","Data":"f90c95698776fe72bcaaa364c866c397551154289f94c621ea885ac62357bfab"} Jul 06 23:57:58.493359 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:58.493235 2559 scope.go:117] "RemoveContainer" containerID="f90c95698776fe72bcaaa364c866c397551154289f94c621ea885ac62357bfab" Jul 06 23:57:59.499834 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:57:59.499798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c8c4f" event={"ID":"ffd1bf71-2832-4504-8157-28bce1fd2fec","Type":"ContainerStarted","Data":"c692160b1473ba9070cefa45eba43dcaef74fc21847c3afa16f93caa931fd656"} Jul 06 23:58:00.577237 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.577195 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" podUID="35864c42-ff25-4374-8b20-241f2d7a85cc" containerName="registry" containerID="cri-o://af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520" gracePeriod=30 Jul 06 23:58:00.822404 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.822380 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:58:00.915932 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.915896 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-bound-sa-token\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.915971 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-certificates\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.915992 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-image-registry-private-configuration\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.916053 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-installation-pull-secrets\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.916085 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.916108 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dzdw\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-kube-api-access-2dzdw\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916135 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.916128 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35864c42-ff25-4374-8b20-241f2d7a85cc-ca-trust-extracted\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916454 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.916147 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-trusted-ca\") pod \"35864c42-ff25-4374-8b20-241f2d7a85cc\" (UID: \"35864c42-ff25-4374-8b20-241f2d7a85cc\") " Jul 06 23:58:00.916454 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.916433 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:00.916761 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.916737 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:00.918709 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.918685 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:58:00.919033 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.919007 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:58:00.919133 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.919108 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:58:00.919293 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.919276 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:58:00.919352 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.919318 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-kube-api-access-2dzdw" (OuterVolumeSpecName: "kube-api-access-2dzdw") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "kube-api-access-2dzdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:58:00.927291 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:00.927265 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35864c42-ff25-4374-8b20-241f2d7a85cc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "35864c42-ff25-4374-8b20-241f2d7a85cc" (UID: "35864c42-ff25-4374-8b20-241f2d7a85cc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:58:01.016907 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016864 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-tls\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.016907 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016898 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dzdw\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-kube-api-access-2dzdw\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.016907 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016909 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35864c42-ff25-4374-8b20-241f2d7a85cc-ca-trust-extracted\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.016907 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016917 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-trusted-ca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.017174 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016926 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35864c42-ff25-4374-8b20-241f2d7a85cc-bound-sa-token\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.017174 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016934 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35864c42-ff25-4374-8b20-241f2d7a85cc-registry-certificates\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.017174 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016943 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-image-registry-private-configuration\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.017174 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.016954 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35864c42-ff25-4374-8b20-241f2d7a85cc-installation-pull-secrets\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:01.509239 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.509200 2559 generic.go:356] "Generic (PLEG): container finished" podID="35864c42-ff25-4374-8b20-241f2d7a85cc" containerID="af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520" exitCode=0 Jul 06 23:58:01.509404 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.509250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" event={"ID":"35864c42-ff25-4374-8b20-241f2d7a85cc","Type":"ContainerDied","Data":"af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520"} Jul 06 23:58:01.509404 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.509268 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" Jul 06 23:58:01.509404 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.509332 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999ff98c-dkb4f" event={"ID":"35864c42-ff25-4374-8b20-241f2d7a85cc","Type":"ContainerDied","Data":"81c594d4310b5ee50f586b91195cf8efce0498681c194d372de2e5c57999c7da"} Jul 06 23:58:01.509404 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.509360 2559 scope.go:117] "RemoveContainer" containerID="af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520" Jul 06 23:58:01.520461 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.520438 2559 scope.go:117] "RemoveContainer" containerID="af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520" Jul 06 23:58:01.520787 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:58:01.520766 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520\": container with ID starting with af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520 not found: ID does not exist" containerID="af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520" Jul 06 23:58:01.520842 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.520797 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520"} err="failed to get container status \"af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520\": rpc error: code = NotFound desc = could not find container \"af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520\": container with ID starting with af118ec7321d9cd27eef0c6ece8980577fa5a2341b645d52990a498b3394f520 not found: ID does not exist" Jul 06 23:58:01.534846 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.534814 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6999ff98c-dkb4f"] Jul 06 23:58:01.539382 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.539353 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6999ff98c-dkb4f"] Jul 06 23:58:01.664059 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:01.664016 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35864c42-ff25-4374-8b20-241f2d7a85cc" path="/var/lib/kubelet/pods/35864c42-ff25-4374-8b20-241f2d7a85cc/volumes" Jul 06 23:58:08.539117 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:08.539017 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ea591db-a6d2-4859-a1bd-8c9f8d4de788" containerID="8eda66a4b479d1d5f8be682fd89e0bbd9947a6a275872ebd73fc3f6583c626e5" exitCode=0 Jul 06 23:58:08.539117 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:08.539090 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" event={"ID":"5ea591db-a6d2-4859-a1bd-8c9f8d4de788","Type":"ContainerDied","Data":"8eda66a4b479d1d5f8be682fd89e0bbd9947a6a275872ebd73fc3f6583c626e5"} Jul 06 23:58:08.539606 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:08.539437 2559 scope.go:117] "RemoveContainer" containerID="8eda66a4b479d1d5f8be682fd89e0bbd9947a6a275872ebd73fc3f6583c626e5" Jul 06 23:58:08.882889 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:08.882850 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54f74ff988-4bnq4" podUID="cc738397-7004-4044-9c98-b5071ee835f1" containerName="console" containerID="cri-o://c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb" gracePeriod=15 Jul 06 23:58:09.027384 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.027350 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:58:09.032075 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.032049 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-568b458b98-p72r6" Jul 06 23:58:09.145356 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.145293 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:58:09.295459 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295428 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-serving-cert\") pod \"cc738397-7004-4044-9c98-b5071ee835f1\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " Jul 06 23:58:09.295639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295507 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-oauth-config\") pod \"cc738397-7004-4044-9c98-b5071ee835f1\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " Jul 06 23:58:09.295639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295531 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cg2r\" (UniqueName: \"kubernetes.io/projected/cc738397-7004-4044-9c98-b5071ee835f1-kube-api-access-4cg2r\") pod \"cc738397-7004-4044-9c98-b5071ee835f1\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " Jul 06 23:58:09.295639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295573 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-oauth-serving-cert\") pod \"cc738397-7004-4044-9c98-b5071ee835f1\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " Jul 06 23:58:09.295831 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295679 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-trusted-ca-bundle\") pod \"cc738397-7004-4044-9c98-b5071ee835f1\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " Jul 06 23:58:09.295831 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295708 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-console-config\") pod \"cc738397-7004-4044-9c98-b5071ee835f1\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " Jul 06 23:58:09.295831 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295735 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-service-ca\") pod \"cc738397-7004-4044-9c98-b5071ee835f1\" (UID: \"cc738397-7004-4044-9c98-b5071ee835f1\") " Jul 06 23:58:09.296034 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.295942 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc738397-7004-4044-9c98-b5071ee835f1" (UID: "cc738397-7004-4044-9c98-b5071ee835f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:09.296092 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.296036 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc738397-7004-4044-9c98-b5071ee835f1" (UID: "cc738397-7004-4044-9c98-b5071ee835f1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:09.296165 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.296141 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-console-config" (OuterVolumeSpecName: "console-config") pod "cc738397-7004-4044-9c98-b5071ee835f1" (UID: "cc738397-7004-4044-9c98-b5071ee835f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:09.296464 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.296380 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc738397-7004-4044-9c98-b5071ee835f1" (UID: "cc738397-7004-4044-9c98-b5071ee835f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:09.298119 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.298079 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc738397-7004-4044-9c98-b5071ee835f1-kube-api-access-4cg2r" (OuterVolumeSpecName: "kube-api-access-4cg2r") pod "cc738397-7004-4044-9c98-b5071ee835f1" (UID: "cc738397-7004-4044-9c98-b5071ee835f1"). InnerVolumeSpecName "kube-api-access-4cg2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:58:09.298227 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.298213 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc738397-7004-4044-9c98-b5071ee835f1" (UID: "cc738397-7004-4044-9c98-b5071ee835f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:58:09.298276 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.298227 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc738397-7004-4044-9c98-b5071ee835f1" (UID: "cc738397-7004-4044-9c98-b5071ee835f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:58:09.396920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.396839 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-oauth-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:09.396920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.396870 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-trusted-ca-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:09.396920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.396883 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-console-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:09.396920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.396892 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc738397-7004-4044-9c98-b5071ee835f1-service-ca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:09.396920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.396900 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:09.396920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.396910 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc738397-7004-4044-9c98-b5071ee835f1-console-oauth-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:09.396920 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.396918 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cg2r\" (UniqueName: \"kubernetes.io/projected/cc738397-7004-4044-9c98-b5071ee835f1-kube-api-access-4cg2r\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:09.545041 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.545002 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc738397-7004-4044-9c98-b5071ee835f1" containerID="c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb" exitCode=0 Jul 06 23:58:09.545041 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.545046 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f74ff988-4bnq4" Jul 06 23:58:09.545601 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.545074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f74ff988-4bnq4" event={"ID":"cc738397-7004-4044-9c98-b5071ee835f1","Type":"ContainerDied","Data":"c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb"} Jul 06 23:58:09.545601 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.545125 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f74ff988-4bnq4" event={"ID":"cc738397-7004-4044-9c98-b5071ee835f1","Type":"ContainerDied","Data":"21fe6d92d7e12508d391871f15906206a62da6b3cdcaa4990af2a72716a09208"} Jul 06 23:58:09.545601 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.545155 2559 scope.go:117] "RemoveContainer" containerID="c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb" Jul 06 23:58:09.547410 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.547380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t54ql" event={"ID":"5ea591db-a6d2-4859-a1bd-8c9f8d4de788","Type":"ContainerStarted","Data":"b4a46df6afcf4628316f909bb56c1e1004c29f4d13cc978899ceb23cea1d7593"} Jul 06 23:58:09.554497 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.554476 2559 scope.go:117] "RemoveContainer" containerID="c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb" Jul 06 23:58:09.554802 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:58:09.554785 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb\": container with ID starting with c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb not found: ID does not exist" containerID="c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb" Jul 06 23:58:09.554858 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.554811 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb"} err="failed to get container status \"c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb\": rpc error: code = NotFound desc = could not find container \"c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb\": container with ID starting with c984cc2df915f4a72accf084fd350c81c851f4f895a2a2dc875b9b0ee7b281fb not found: ID does not exist" Jul 06 23:58:09.580981 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.580939 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f74ff988-4bnq4"] Jul 06 23:58:09.588173 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.588144 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f74ff988-4bnq4"] Jul 06 23:58:09.668803 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:09.668723 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc738397-7004-4044-9c98-b5071ee835f1" path="/var/lib/kubelet/pods/cc738397-7004-4044-9c98-b5071ee835f1/volumes" Jul 06 23:58:19.576100 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.576028 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-688df956bc-9hkr2" podUID="436e5db4-c6ac-49b3-963b-a03c5ed62bce" containerName="console" containerID="cri-o://2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534" gracePeriod=15 Jul 06 23:58:19.829108 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.829047 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:58:19.879179 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879146 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-service-ca\") pod \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " Jul 06 23:58:19.879179 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879196 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-serving-cert\") pod \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " Jul 06 23:58:19.879447 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879218 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnv5p\" (UniqueName: \"kubernetes.io/projected/436e5db4-c6ac-49b3-963b-a03c5ed62bce-kube-api-access-wnv5p\") pod \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " Jul 06 23:58:19.879447 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879239 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-oauth-serving-cert\") pod \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " Jul 06 23:58:19.879447 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879286 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-oauth-config\") pod \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " Jul 06 23:58:19.879447 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879355 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-config\") pod \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\" (UID: \"436e5db4-c6ac-49b3-963b-a03c5ed62bce\") " Jul 06 23:58:19.879719 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879686 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-service-ca" (OuterVolumeSpecName: "service-ca") pod "436e5db4-c6ac-49b3-963b-a03c5ed62bce" (UID: "436e5db4-c6ac-49b3-963b-a03c5ed62bce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:19.879816 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879757 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "436e5db4-c6ac-49b3-963b-a03c5ed62bce" (UID: "436e5db4-c6ac-49b3-963b-a03c5ed62bce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:19.879877 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.879822 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-config" (OuterVolumeSpecName: "console-config") pod "436e5db4-c6ac-49b3-963b-a03c5ed62bce" (UID: "436e5db4-c6ac-49b3-963b-a03c5ed62bce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:58:19.881666 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.881624 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "436e5db4-c6ac-49b3-963b-a03c5ed62bce" (UID: "436e5db4-c6ac-49b3-963b-a03c5ed62bce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:58:19.881776 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.881625 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/436e5db4-c6ac-49b3-963b-a03c5ed62bce-kube-api-access-wnv5p" (OuterVolumeSpecName: "kube-api-access-wnv5p") pod "436e5db4-c6ac-49b3-963b-a03c5ed62bce" (UID: "436e5db4-c6ac-49b3-963b-a03c5ed62bce"). InnerVolumeSpecName "kube-api-access-wnv5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:58:19.881776 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.881730 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "436e5db4-c6ac-49b3-963b-a03c5ed62bce" (UID: "436e5db4-c6ac-49b3-963b-a03c5ed62bce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:58:19.980041 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.980002 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnv5p\" (UniqueName: \"kubernetes.io/projected/436e5db4-c6ac-49b3-963b-a03c5ed62bce-kube-api-access-wnv5p\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:19.980041 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.980034 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-oauth-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:19.980041 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.980047 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-oauth-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:19.980283 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.980061 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:19.980283 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.980073 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/436e5db4-c6ac-49b3-963b-a03c5ed62bce-service-ca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:19.980283 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:19.980084 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/436e5db4-c6ac-49b3-963b-a03c5ed62bce-console-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:58:20.597639 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.597597 2559 generic.go:356] "Generic (PLEG): container finished" podID="436e5db4-c6ac-49b3-963b-a03c5ed62bce" containerID="2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534" exitCode=0 Jul 06 23:58:20.598096 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.597688 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688df956bc-9hkr2" Jul 06 23:58:20.598096 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.597685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688df956bc-9hkr2" event={"ID":"436e5db4-c6ac-49b3-963b-a03c5ed62bce","Type":"ContainerDied","Data":"2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534"} Jul 06 23:58:20.598096 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.597766 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688df956bc-9hkr2" event={"ID":"436e5db4-c6ac-49b3-963b-a03c5ed62bce","Type":"ContainerDied","Data":"a9284d9ff34fcd811a6d0736e876bf6fb9692ca846b5710359a1e4b4e2561ce5"} Jul 06 23:58:20.598096 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.597789 2559 scope.go:117] "RemoveContainer" containerID="2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534" Jul 06 23:58:20.606863 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.606845 2559 scope.go:117] "RemoveContainer" containerID="2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534" Jul 06 23:58:20.607147 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:58:20.607125 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534\": container with ID starting with 2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534 not found: ID does not exist" containerID="2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534" Jul 06 23:58:20.607210 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.607163 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534"} err="failed to get container status \"2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534\": rpc error: code = NotFound desc = could not find container \"2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534\": container with ID starting with 2d29197c31d7eed51f7e05358987ffc0762a21c94caf194f9f5fcf5de59fa534 not found: ID does not exist" Jul 06 23:58:20.619340 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.619313 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688df956bc-9hkr2"] Jul 06 23:58:20.623548 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:20.623524 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-688df956bc-9hkr2"] Jul 06 23:58:21.663392 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:21.663343 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="436e5db4-c6ac-49b3-963b-a03c5ed62bce" path="/var/lib/kubelet/pods/436e5db4-c6ac-49b3-963b-a03c5ed62bce/volumes" Jul 06 23:58:43.700590 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.700545 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d8f958b8-s9kfb"] Jul 06 23:58:43.701142 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701011 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436e5db4-c6ac-49b3-963b-a03c5ed62bce" containerName="console" Jul 06 23:58:43.701142 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701029 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="436e5db4-c6ac-49b3-963b-a03c5ed62bce" containerName="console" Jul 06 23:58:43.701142 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701052 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc738397-7004-4044-9c98-b5071ee835f1" containerName="console" Jul 06 23:58:43.701142 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701062 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc738397-7004-4044-9c98-b5071ee835f1" containerName="console" Jul 06 23:58:43.701142 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701074 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35864c42-ff25-4374-8b20-241f2d7a85cc" containerName="registry" Jul 06 23:58:43.701142 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701084 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="35864c42-ff25-4374-8b20-241f2d7a85cc" containerName="registry" Jul 06 23:58:43.701453 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701163 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc738397-7004-4044-9c98-b5071ee835f1" containerName="console" Jul 06 23:58:43.701453 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701176 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="436e5db4-c6ac-49b3-963b-a03c5ed62bce" containerName="console" Jul 06 23:58:43.701453 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.701184 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="35864c42-ff25-4374-8b20-241f2d7a85cc" containerName="registry" Jul 06 23:58:43.706847 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.706814 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.722575 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.722521 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d8f958b8-s9kfb"] Jul 06 23:58:43.779324 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.779290 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-service-ca\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.779324 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.779334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-oauth-serving-cert\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.779556 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.779370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-oauth-config\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.779556 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.779401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vfk9\" (UniqueName: \"kubernetes.io/projected/7d24a949-4fb8-4482-8987-888c7688cbbb-kube-api-access-4vfk9\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.779556 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.779419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-console-config\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.779556 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.779493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-serving-cert\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.779556 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.779532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-trusted-ca-bundle\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.880677 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.880597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-oauth-config\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.880677 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.880678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vfk9\" (UniqueName: \"kubernetes.io/projected/7d24a949-4fb8-4482-8987-888c7688cbbb-kube-api-access-4vfk9\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.880901 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.880699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-console-config\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.880901 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.880743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-serving-cert\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.880901 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.880884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-trusted-ca-bundle\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.881013 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.880955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-service-ca\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.881013 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.880995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-oauth-serving-cert\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.881622 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.881597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-service-ca\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.881622 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.881608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-trusted-ca-bundle\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.881792 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.881778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-console-config\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.881851 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.881830 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-oauth-serving-cert\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.883329 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.883309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-serving-cert\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.883441 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.883424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-oauth-config\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:43.889945 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:43.889924 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vfk9\" (UniqueName: \"kubernetes.io/projected/7d24a949-4fb8-4482-8987-888c7688cbbb-kube-api-access-4vfk9\") pod \"console-74d8f958b8-s9kfb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:44.017309 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:44.017197 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:44.157025 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:44.156987 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d8f958b8-s9kfb"] Jul 06 23:58:44.160566 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:58:44.160533 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d24a949_4fb8_4482_8987_888c7688cbbb.slice/crio-f0f2df00ff8ddec5ec5bcd6a4682d12f52fd14c5bb2186b96e7db2660513b935 WatchSource:0}: Error finding container f0f2df00ff8ddec5ec5bcd6a4682d12f52fd14c5bb2186b96e7db2660513b935: Status 404 returned error can't find the container with id f0f2df00ff8ddec5ec5bcd6a4682d12f52fd14c5bb2186b96e7db2660513b935 Jul 06 23:58:44.713433 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:44.713400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f958b8-s9kfb" event={"ID":"7d24a949-4fb8-4482-8987-888c7688cbbb","Type":"ContainerStarted","Data":"93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd"} Jul 06 23:58:44.713433 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:44.713450 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f958b8-s9kfb" event={"ID":"7d24a949-4fb8-4482-8987-888c7688cbbb","Type":"ContainerStarted","Data":"f0f2df00ff8ddec5ec5bcd6a4682d12f52fd14c5bb2186b96e7db2660513b935"} Jul 06 23:58:44.732403 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:44.732358 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d8f958b8-s9kfb" podStartSLOduration=1.732342069 podStartE2EDuration="1.732342069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:44.731640152 +0000 UTC m=+163.592811894" watchObservedRunningTime="2026-07-06 23:58:44.732342069 +0000 UTC m=+163.593513809" Jul 06 23:58:54.017584 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:54.017489 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:54.017584 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:54.017563 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:54.022373 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:54.022352 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:54.763308 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:54.763278 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 06 23:58:54.812741 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:58:54.812708 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df5dff768-zhx8w"] Jul 06 23:59:19.842439 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:19.842371 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6df5dff768-zhx8w" podUID="1879e1a6-b4f7-48f9-892a-949f61e5b8fd" containerName="console" containerID="cri-o://4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c" gracePeriod=15 Jul 06 23:59:20.097287 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.097222 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:59:20.199540 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.199504 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-serving-cert\") pod \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " Jul 06 23:59:20.199540 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.199545 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-service-ca\") pod \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " Jul 06 23:59:20.199861 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.199565 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-config\") pod \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " Jul 06 23:59:20.199861 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.199593 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-trusted-ca-bundle\") pod \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " Jul 06 23:59:20.199861 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.199673 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-oauth-serving-cert\") pod \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " Jul 06 23:59:20.199861 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.199710 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-oauth-config\") pod \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " Jul 06 23:59:20.199861 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.199740 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjcxs\" (UniqueName: \"kubernetes.io/projected/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-kube-api-access-xjcxs\") pod \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\" (UID: \"1879e1a6-b4f7-48f9-892a-949f61e5b8fd\") " Jul 06 23:59:20.200108 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.200039 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "1879e1a6-b4f7-48f9-892a-949f61e5b8fd" (UID: "1879e1a6-b4f7-48f9-892a-949f61e5b8fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:59:20.200180 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.200144 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-config" (OuterVolumeSpecName: "console-config") pod "1879e1a6-b4f7-48f9-892a-949f61e5b8fd" (UID: "1879e1a6-b4f7-48f9-892a-949f61e5b8fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:59:20.200233 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.200177 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1879e1a6-b4f7-48f9-892a-949f61e5b8fd" (UID: "1879e1a6-b4f7-48f9-892a-949f61e5b8fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:59:20.200233 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.200160 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1879e1a6-b4f7-48f9-892a-949f61e5b8fd" (UID: "1879e1a6-b4f7-48f9-892a-949f61e5b8fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:59:20.202091 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.202056 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1879e1a6-b4f7-48f9-892a-949f61e5b8fd" (UID: "1879e1a6-b4f7-48f9-892a-949f61e5b8fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:59:20.202214 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.202127 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-kube-api-access-xjcxs" (OuterVolumeSpecName: "kube-api-access-xjcxs") pod "1879e1a6-b4f7-48f9-892a-949f61e5b8fd" (UID: "1879e1a6-b4f7-48f9-892a-949f61e5b8fd"). InnerVolumeSpecName "kube-api-access-xjcxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:59:20.202214 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.202130 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1879e1a6-b4f7-48f9-892a-949f61e5b8fd" (UID: "1879e1a6-b4f7-48f9-892a-949f61e5b8fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:59:20.301014 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.300976 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:20.301014 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.301006 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-trusted-ca-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:20.301014 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.301017 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-oauth-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:20.301014 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.301025 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-oauth-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:20.301277 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.301033 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjcxs\" (UniqueName: \"kubernetes.io/projected/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-kube-api-access-xjcxs\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:20.301277 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.301042 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-console-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:20.301277 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.301050 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1879e1a6-b4f7-48f9-892a-949f61e5b8fd-service-ca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:20.861921 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.861885 2559 generic.go:356] "Generic (PLEG): container finished" podID="1879e1a6-b4f7-48f9-892a-949f61e5b8fd" containerID="4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c" exitCode=0 Jul 06 23:59:20.862371 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.861933 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df5dff768-zhx8w" Jul 06 23:59:20.862371 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.861961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df5dff768-zhx8w" event={"ID":"1879e1a6-b4f7-48f9-892a-949f61e5b8fd","Type":"ContainerDied","Data":"4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c"} Jul 06 23:59:20.862371 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.862011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df5dff768-zhx8w" event={"ID":"1879e1a6-b4f7-48f9-892a-949f61e5b8fd","Type":"ContainerDied","Data":"ad105d053ae0b08f643e4ad35b0057662c3c5ca6141474f924af6622f4e8c331"} Jul 06 23:59:20.862371 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.862040 2559 scope.go:117] "RemoveContainer" containerID="4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c" Jul 06 23:59:20.871302 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.871284 2559 scope.go:117] "RemoveContainer" containerID="4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c" Jul 06 23:59:20.871615 ip-10-0-131-246 kubenswrapper[2559]: E0706 23:59:20.871597 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c\": container with ID starting with 4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c not found: ID does not exist" containerID="4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c" Jul 06 23:59:20.871684 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.871624 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c"} err="failed to get container status \"4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c\": rpc error: code = NotFound desc = could not find container \"4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c\": container with ID starting with 4c493ae607842dabfc3d79d2b8154d4fc467e205ac852b80b687ba7a0940265c not found: ID does not exist" Jul 06 23:59:20.884139 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.884105 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df5dff768-zhx8w"] Jul 06 23:59:20.889252 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:20.889223 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df5dff768-zhx8w"] Jul 06 23:59:21.669396 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:21.665726 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1879e1a6-b4f7-48f9-892a-949f61e5b8fd" path="/var/lib/kubelet/pods/1879e1a6-b4f7-48f9-892a-949f61e5b8fd/volumes" Jul 06 23:59:32.954522 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.954488 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds"] Jul 06 23:59:32.954993 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.954808 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1879e1a6-b4f7-48f9-892a-949f61e5b8fd" containerName="console" Jul 06 23:59:32.954993 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.954819 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1879e1a6-b4f7-48f9-892a-949f61e5b8fd" containerName="console" Jul 06 23:59:32.954993 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.954874 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1879e1a6-b4f7-48f9-892a-949f61e5b8fd" containerName="console" Jul 06 23:59:32.959318 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.959298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:32.962226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.962201 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wts9q\"" Jul 06 23:59:32.962339 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.962257 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:59:32.963350 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.963329 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:59:32.967141 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:32.967120 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds"] Jul 06 23:59:33.112573 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.112537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.112573 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.112583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.112815 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.112688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkbvm\" (UniqueName: \"kubernetes.io/projected/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-kube-api-access-jkbvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.213985 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.213881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.213985 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.213940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.214179 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.213996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkbvm\" (UniqueName: \"kubernetes.io/projected/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-kube-api-access-jkbvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.214357 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.214332 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.214392 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.214368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.223299 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.223267 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkbvm\" (UniqueName: \"kubernetes.io/projected/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-kube-api-access-jkbvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.269272 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.269232 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:33.406029 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.405998 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds"] Jul 06 23:59:33.408274 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:59:33.408240 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1beabaff_327f_46cc_a2d7_85ed6f3f8dd5.slice/crio-39061cae5297699e3af5aa699fafa9bb8796a7aa5251a95354bdcd6ba5f09f56 WatchSource:0}: Error finding container 39061cae5297699e3af5aa699fafa9bb8796a7aa5251a95354bdcd6ba5f09f56: Status 404 returned error can't find the container with id 39061cae5297699e3af5aa699fafa9bb8796a7aa5251a95354bdcd6ba5f09f56 Jul 06 23:59:33.914421 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:33.914381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" event={"ID":"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5","Type":"ContainerStarted","Data":"39061cae5297699e3af5aa699fafa9bb8796a7aa5251a95354bdcd6ba5f09f56"} Jul 06 23:59:38.939080 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:38.939041 2559 generic.go:356] "Generic (PLEG): container finished" podID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerID="2d1999faca442717d977e6accc0f8ebc15e1338374b0b97815c3c8ed0e8b9073" exitCode=0 Jul 06 23:59:38.939624 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:38.939132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" event={"ID":"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5","Type":"ContainerDied","Data":"2d1999faca442717d977e6accc0f8ebc15e1338374b0b97815c3c8ed0e8b9073"} Jul 06 23:59:41.953290 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:41.953254 2559 generic.go:356] "Generic (PLEG): container finished" podID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerID="bb03adde285c4cd1896aa8324c9d730432d0bbe994e6eb1731a8a61a63762581" exitCode=0 Jul 06 23:59:41.953695 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:41.953332 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" event={"ID":"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5","Type":"ContainerDied","Data":"bb03adde285c4cd1896aa8324c9d730432d0bbe994e6eb1731a8a61a63762581"} Jul 06 23:59:49.990246 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:49.990207 2559 generic.go:356] "Generic (PLEG): container finished" podID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerID="8100d3da3c66eebbae32d7111b7af51b5d04e1c48903e9947bd3905abab27c8c" exitCode=0 Jul 06 23:59:49.990685 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:49.990298 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" event={"ID":"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5","Type":"ContainerDied","Data":"8100d3da3c66eebbae32d7111b7af51b5d04e1c48903e9947bd3905abab27c8c"} Jul 06 23:59:51.125782 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.125754 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:51.279720 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.279574 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkbvm\" (UniqueName: \"kubernetes.io/projected/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-kube-api-access-jkbvm\") pod \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " Jul 06 23:59:51.279720 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.279705 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-util\") pod \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " Jul 06 23:59:51.279975 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.279732 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-bundle\") pod \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\" (UID: \"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5\") " Jul 06 23:59:51.280472 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.280444 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-bundle" (OuterVolumeSpecName: "bundle") pod "1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" (UID: "1beabaff-327f-46cc-a2d7-85ed6f3f8dd5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:59:51.282036 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.282012 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-kube-api-access-jkbvm" (OuterVolumeSpecName: "kube-api-access-jkbvm") pod "1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" (UID: "1beabaff-327f-46cc-a2d7-85ed6f3f8dd5"). InnerVolumeSpecName "kube-api-access-jkbvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:59:51.284104 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.284077 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-util" (OuterVolumeSpecName: "util") pod "1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" (UID: "1beabaff-327f-46cc-a2d7-85ed6f3f8dd5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:59:51.380392 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.380348 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkbvm\" (UniqueName: \"kubernetes.io/projected/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-kube-api-access-jkbvm\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:51.380392 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.380383 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-util\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:51.380392 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:51.380396 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beabaff-327f-46cc-a2d7-85ed6f3f8dd5-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 06 23:59:52.001161 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:52.001079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" event={"ID":"1beabaff-327f-46cc-a2d7-85ed6f3f8dd5","Type":"ContainerDied","Data":"39061cae5297699e3af5aa699fafa9bb8796a7aa5251a95354bdcd6ba5f09f56"} Jul 06 23:59:52.001161 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:52.001123 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39061cae5297699e3af5aa699fafa9bb8796a7aa5251a95354bdcd6ba5f09f56" Jul 06 23:59:52.001161 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:52.001126 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bncds" Jul 06 23:59:56.046876 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.046841 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z"] Jul 06 23:59:56.047328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.047215 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerName="extract" Jul 06 23:59:56.047328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.047229 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerName="extract" Jul 06 23:59:56.047328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.047247 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerName="util" Jul 06 23:59:56.047328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.047253 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerName="util" Jul 06 23:59:56.047328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.047261 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerName="pull" Jul 06 23:59:56.047328 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.047266 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerName="pull" Jul 06 23:59:56.047525 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.047332 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1beabaff-327f-46cc-a2d7-85ed6f3f8dd5" containerName="extract" Jul 06 23:59:56.093699 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.093640 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z"] Jul 06 23:59:56.093864 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.093759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.096890 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.096860 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:59:56.097076 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.096890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zpxlr\"" Jul 06 23:59:56.097076 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.096869 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 23:59:56.120032 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.119996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk5bh\" (UniqueName: \"kubernetes.io/projected/c87ba59c-6db0-4d9b-ae6c-c50bb90e2579-kube-api-access-hk5bh\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9b6z\" (UID: \"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.120226 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.120051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c87ba59c-6db0-4d9b-ae6c-c50bb90e2579-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9b6z\" (UID: \"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.221213 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.221170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c87ba59c-6db0-4d9b-ae6c-c50bb90e2579-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9b6z\" (UID: \"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.221435 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.221257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk5bh\" (UniqueName: \"kubernetes.io/projected/c87ba59c-6db0-4d9b-ae6c-c50bb90e2579-kube-api-access-hk5bh\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9b6z\" (UID: \"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.221602 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.221579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c87ba59c-6db0-4d9b-ae6c-c50bb90e2579-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9b6z\" (UID: \"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.232974 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.232938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk5bh\" (UniqueName: \"kubernetes.io/projected/c87ba59c-6db0-4d9b-ae6c-c50bb90e2579-kube-api-access-hk5bh\") pod \"cert-manager-operator-controller-manager-55c444bf86-j9b6z\" (UID: \"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.403477 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.403440 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" Jul 06 23:59:56.582275 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:56.582249 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z"] Jul 06 23:59:56.584963 ip-10-0-131-246 kubenswrapper[2559]: W0706 23:59:56.584930 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87ba59c_6db0_4d9b_ae6c_c50bb90e2579.slice/crio-b3853324cf6406f19052576a769e9f88fd1ed96808953dda565b44df89adad2f WatchSource:0}: Error finding container b3853324cf6406f19052576a769e9f88fd1ed96808953dda565b44df89adad2f: Status 404 returned error can't find the container with id b3853324cf6406f19052576a769e9f88fd1ed96808953dda565b44df89adad2f Jul 06 23:59:57.022884 ip-10-0-131-246 kubenswrapper[2559]: I0706 23:59:57.022846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" event={"ID":"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579","Type":"ContainerStarted","Data":"b3853324cf6406f19052576a769e9f88fd1ed96808953dda565b44df89adad2f"} Jul 07 00:00:00.038396 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.038365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" event={"ID":"c87ba59c-6db0-4d9b-ae6c-c50bb90e2579","Type":"ContainerStarted","Data":"437c5932619167d7284bae4bcc17a6fee5e32cb19d7b5090461098097b9fbfd1"} Jul 07 00:00:00.058223 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.058114 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j9b6z" podStartSLOduration=0.84055813 podStartE2EDuration="4.058092903s" totalImagesPullingTime="3.217534773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:00.056526535 +0000 UTC m=+238.917698277" watchObservedRunningTime="2026-07-07 00:00:00.058092903 +0000 UTC m=+238.919264645" Jul 07 00:00:00.262406 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.262372 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29723040-frcxt"] Jul 07 00:00:00.264471 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.264454 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.266984 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.266964 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jul 07 00:00:00.267119 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.267043 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-kp4s2\"" Jul 07 00:00:00.278308 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.278275 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29723040-frcxt"] Jul 07 00:00:00.359004 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.358839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2r5p\" (UniqueName: \"kubernetes.io/projected/094f8df9-5062-4037-82c0-dcd400e2b4bf-kube-api-access-p2r5p\") pod \"image-pruner-29723040-frcxt\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.359004 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.358897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/094f8df9-5062-4037-82c0-dcd400e2b4bf-serviceca\") pod \"image-pruner-29723040-frcxt\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.459319 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.459284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/094f8df9-5062-4037-82c0-dcd400e2b4bf-serviceca\") pod \"image-pruner-29723040-frcxt\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.459700 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.459684 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2r5p\" (UniqueName: \"kubernetes.io/projected/094f8df9-5062-4037-82c0-dcd400e2b4bf-kube-api-access-p2r5p\") pod \"image-pruner-29723040-frcxt\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.460146 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.460126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/094f8df9-5062-4037-82c0-dcd400e2b4bf-serviceca\") pod \"image-pruner-29723040-frcxt\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.471585 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.471555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2r5p\" (UniqueName: \"kubernetes.io/projected/094f8df9-5062-4037-82c0-dcd400e2b4bf-kube-api-access-p2r5p\") pod \"image-pruner-29723040-frcxt\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.594734 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.594695 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:00.596724 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.596695 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj"] Jul 07 00:00:00.599183 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.599149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.606483 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.606454 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 00:00:00.607009 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.606835 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wts9q\"" Jul 07 00:00:00.611937 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.611913 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 00:00:00.632749 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.632672 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj"] Jul 07 00:00:00.661224 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.661181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvhsv\" (UniqueName: \"kubernetes.io/projected/7dad1926-e80e-46fe-a85c-cd9881010c24-kube-api-access-bvhsv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.661400 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.661255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.661400 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.661327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.762518 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.762475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvhsv\" (UniqueName: \"kubernetes.io/projected/7dad1926-e80e-46fe-a85c-cd9881010c24-kube-api-access-bvhsv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.762751 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.762563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.762751 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.762605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.763212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.763150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.763334 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.763264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.765549 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.765528 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29723040-frcxt"] Jul 07 00:00:00.768107 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:00:00.768085 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094f8df9_5062_4037_82c0_dcd400e2b4bf.slice/crio-c2508067aed7f254b37c9afaf9a19055bc44926a2be4c5db690548958488e233 WatchSource:0}: Error finding container c2508067aed7f254b37c9afaf9a19055bc44926a2be4c5db690548958488e233: Status 404 returned error can't find the container with id c2508067aed7f254b37c9afaf9a19055bc44926a2be4c5db690548958488e233 Jul 07 00:00:00.776745 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.776722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvhsv\" (UniqueName: \"kubernetes.io/projected/7dad1926-e80e-46fe-a85c-cd9881010c24-kube-api-access-bvhsv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:00.941201 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:00.941159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:01.046257 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:01.046217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-frcxt" event={"ID":"094f8df9-5062-4037-82c0-dcd400e2b4bf","Type":"ContainerStarted","Data":"95377c83352be06c7e51638f69a8fcf452d75d87b9b156adfcd0f7f0f6e0631e"} Jul 07 00:00:01.046721 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:01.046282 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-frcxt" event={"ID":"094f8df9-5062-4037-82c0-dcd400e2b4bf","Type":"ContainerStarted","Data":"c2508067aed7f254b37c9afaf9a19055bc44926a2be4c5db690548958488e233"} Jul 07 00:00:01.075375 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:01.075312 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29723040-frcxt" podStartSLOduration=1.075296885 podStartE2EDuration="1.075296885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:01.074891982 +0000 UTC m=+239.936063724" watchObservedRunningTime="2026-07-07 00:00:01.075296885 +0000 UTC m=+239.936468625" Jul 07 00:00:01.095681 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:01.095628 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj"] Jul 07 00:00:01.098245 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:00:01.098208 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dad1926_e80e_46fe_a85c_cd9881010c24.slice/crio-63fb265c040c4d91ec7ac3f883998ded1852b492a74c5ffde7a66875cc15eea0 WatchSource:0}: Error finding container 63fb265c040c4d91ec7ac3f883998ded1852b492a74c5ffde7a66875cc15eea0: Status 404 returned error can't find the container with id 63fb265c040c4d91ec7ac3f883998ded1852b492a74c5ffde7a66875cc15eea0 Jul 07 00:00:02.053316 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:02.053230 2559 generic.go:356] "Generic (PLEG): container finished" podID="094f8df9-5062-4037-82c0-dcd400e2b4bf" containerID="95377c83352be06c7e51638f69a8fcf452d75d87b9b156adfcd0f7f0f6e0631e" exitCode=0 Jul 07 00:00:02.053802 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:02.053377 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-frcxt" event={"ID":"094f8df9-5062-4037-82c0-dcd400e2b4bf","Type":"ContainerDied","Data":"95377c83352be06c7e51638f69a8fcf452d75d87b9b156adfcd0f7f0f6e0631e"} Jul 07 00:00:02.055636 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:02.055608 2559 generic.go:356] "Generic (PLEG): container finished" podID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerID="f42ba922bc07438a090d4556165db92edfb1582674b3f953ea843d8511d332e9" exitCode=0 Jul 07 00:00:02.055780 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:02.055677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" event={"ID":"7dad1926-e80e-46fe-a85c-cd9881010c24","Type":"ContainerDied","Data":"f42ba922bc07438a090d4556165db92edfb1582674b3f953ea843d8511d332e9"} Jul 07 00:00:02.055780 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:02.055720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" event={"ID":"7dad1926-e80e-46fe-a85c-cd9881010c24","Type":"ContainerStarted","Data":"63fb265c040c4d91ec7ac3f883998ded1852b492a74c5ffde7a66875cc15eea0"} Jul 07 00:00:03.188007 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:03.187985 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:03.284053 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:03.284018 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/094f8df9-5062-4037-82c0-dcd400e2b4bf-serviceca\") pod \"094f8df9-5062-4037-82c0-dcd400e2b4bf\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " Jul 07 00:00:03.284255 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:03.284163 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2r5p\" (UniqueName: \"kubernetes.io/projected/094f8df9-5062-4037-82c0-dcd400e2b4bf-kube-api-access-p2r5p\") pod \"094f8df9-5062-4037-82c0-dcd400e2b4bf\" (UID: \"094f8df9-5062-4037-82c0-dcd400e2b4bf\") " Jul 07 00:00:03.284424 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:03.284400 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/094f8df9-5062-4037-82c0-dcd400e2b4bf-serviceca" (OuterVolumeSpecName: "serviceca") pod "094f8df9-5062-4037-82c0-dcd400e2b4bf" (UID: "094f8df9-5062-4037-82c0-dcd400e2b4bf"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:03.286437 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:03.286414 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/094f8df9-5062-4037-82c0-dcd400e2b4bf-kube-api-access-p2r5p" (OuterVolumeSpecName: "kube-api-access-p2r5p") pod "094f8df9-5062-4037-82c0-dcd400e2b4bf" (UID: "094f8df9-5062-4037-82c0-dcd400e2b4bf"). InnerVolumeSpecName "kube-api-access-p2r5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:03.385730 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:03.385686 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2r5p\" (UniqueName: \"kubernetes.io/projected/094f8df9-5062-4037-82c0-dcd400e2b4bf-kube-api-access-p2r5p\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:03.385730 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:03.385722 2559 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/094f8df9-5062-4037-82c0-dcd400e2b4bf-serviceca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:04.066461 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:04.066367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-frcxt" event={"ID":"094f8df9-5062-4037-82c0-dcd400e2b4bf","Type":"ContainerDied","Data":"c2508067aed7f254b37c9afaf9a19055bc44926a2be4c5db690548958488e233"} Jul 07 00:00:04.066461 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:04.066401 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-frcxt" Jul 07 00:00:04.066461 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:04.066413 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2508067aed7f254b37c9afaf9a19055bc44926a2be4c5db690548958488e233" Jul 07 00:00:07.858872 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.858832 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2"] Jul 07 00:00:07.859323 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.859151 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094f8df9-5062-4037-82c0-dcd400e2b4bf" containerName="image-pruner" Jul 07 00:00:07.859323 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.859162 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="094f8df9-5062-4037-82c0-dcd400e2b4bf" containerName="image-pruner" Jul 07 00:00:07.859323 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.859223 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="094f8df9-5062-4037-82c0-dcd400e2b4bf" containerName="image-pruner" Jul 07 00:00:07.861318 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.861303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:07.866461 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.866440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nbzml\"" Jul 07 00:00:07.866728 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.866685 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 00:00:07.867558 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.867532 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 00:00:07.885323 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.885293 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2"] Jul 07 00:00:07.925043 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.925002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx4xv\" (UniqueName: \"kubernetes.io/projected/7b51eec5-d66f-4213-82bb-f6048013e0c4-kube-api-access-kx4xv\") pod \"cert-manager-cainjector-559cdd8c87-w2gs2\" (UID: \"7b51eec5-d66f-4213-82bb-f6048013e0c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:07.925043 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:07.925043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b51eec5-d66f-4213-82bb-f6048013e0c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w2gs2\" (UID: \"7b51eec5-d66f-4213-82bb-f6048013e0c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:08.026189 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:08.026129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx4xv\" (UniqueName: \"kubernetes.io/projected/7b51eec5-d66f-4213-82bb-f6048013e0c4-kube-api-access-kx4xv\") pod \"cert-manager-cainjector-559cdd8c87-w2gs2\" (UID: \"7b51eec5-d66f-4213-82bb-f6048013e0c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:08.026189 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:08.026185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b51eec5-d66f-4213-82bb-f6048013e0c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w2gs2\" (UID: \"7b51eec5-d66f-4213-82bb-f6048013e0c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:08.035693 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:08.035634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx4xv\" (UniqueName: \"kubernetes.io/projected/7b51eec5-d66f-4213-82bb-f6048013e0c4-kube-api-access-kx4xv\") pod \"cert-manager-cainjector-559cdd8c87-w2gs2\" (UID: \"7b51eec5-d66f-4213-82bb-f6048013e0c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:08.036704 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:08.036684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b51eec5-d66f-4213-82bb-f6048013e0c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w2gs2\" (UID: \"7b51eec5-d66f-4213-82bb-f6048013e0c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:08.179373 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:08.179333 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" Jul 07 00:00:08.322831 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:08.322805 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2"] Jul 07 00:00:08.323614 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:00:08.323589 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b51eec5_d66f_4213_82bb_f6048013e0c4.slice/crio-77a952b83a7aa8901d33c28e32ec752f5c0d0c739c9fee4d3f39d9cc7c3b1cbc WatchSource:0}: Error finding container 77a952b83a7aa8901d33c28e32ec752f5c0d0c739c9fee4d3f39d9cc7c3b1cbc: Status 404 returned error can't find the container with id 77a952b83a7aa8901d33c28e32ec752f5c0d0c739c9fee4d3f39d9cc7c3b1cbc Jul 07 00:00:09.090385 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:09.090348 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" event={"ID":"7b51eec5-d66f-4213-82bb-f6048013e0c4","Type":"ContainerStarted","Data":"77a952b83a7aa8901d33c28e32ec752f5c0d0c739c9fee4d3f39d9cc7c3b1cbc"} Jul 07 00:00:13.059546 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.059508 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2tkn4"] Jul 07 00:00:13.062688 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.062673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.066243 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.066221 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9876l\"" Jul 07 00:00:13.084954 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.084921 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2tkn4"] Jul 07 00:00:13.172616 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.172576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm6c9\" (UniqueName: \"kubernetes.io/projected/2dc04cf4-37e8-4479-847e-d8a164bb8b73-kube-api-access-bm6c9\") pod \"cert-manager-webhook-6486ffd997-2tkn4\" (UID: \"2dc04cf4-37e8-4479-847e-d8a164bb8b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.172845 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.172689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc04cf4-37e8-4479-847e-d8a164bb8b73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2tkn4\" (UID: \"2dc04cf4-37e8-4479-847e-d8a164bb8b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.273960 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.273916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm6c9\" (UniqueName: \"kubernetes.io/projected/2dc04cf4-37e8-4479-847e-d8a164bb8b73-kube-api-access-bm6c9\") pod \"cert-manager-webhook-6486ffd997-2tkn4\" (UID: \"2dc04cf4-37e8-4479-847e-d8a164bb8b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.274112 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.274001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc04cf4-37e8-4479-847e-d8a164bb8b73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2tkn4\" (UID: \"2dc04cf4-37e8-4479-847e-d8a164bb8b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.284833 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.284799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc04cf4-37e8-4479-847e-d8a164bb8b73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2tkn4\" (UID: \"2dc04cf4-37e8-4479-847e-d8a164bb8b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.284931 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.284918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm6c9\" (UniqueName: \"kubernetes.io/projected/2dc04cf4-37e8-4479-847e-d8a164bb8b73-kube-api-access-bm6c9\") pod \"cert-manager-webhook-6486ffd997-2tkn4\" (UID: \"2dc04cf4-37e8-4479-847e-d8a164bb8b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.372029 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.371988 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:13.506792 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:13.506764 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2tkn4"] Jul 07 00:00:13.508603 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:00:13.508573 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dc04cf4_37e8_4479_847e_d8a164bb8b73.slice/crio-2c30fecad5af669e2df2a4f1b3338c73a9913c1aa1ece6d83ffb748514ff78d7 WatchSource:0}: Error finding container 2c30fecad5af669e2df2a4f1b3338c73a9913c1aa1ece6d83ffb748514ff78d7: Status 404 returned error can't find the container with id 2c30fecad5af669e2df2a4f1b3338c73a9913c1aa1ece6d83ffb748514ff78d7 Jul 07 00:00:14.113597 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:14.113562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" event={"ID":"2dc04cf4-37e8-4479-847e-d8a164bb8b73","Type":"ContainerStarted","Data":"2c30fecad5af669e2df2a4f1b3338c73a9913c1aa1ece6d83ffb748514ff78d7"} Jul 07 00:00:20.142307 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:20.142267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" event={"ID":"7b51eec5-d66f-4213-82bb-f6048013e0c4","Type":"ContainerStarted","Data":"065b57b1487a11747b28211e63770ac2e2de96e361553569d59709c9c3abe323"} Jul 07 00:00:20.162286 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:20.162234 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w2gs2" podStartSLOduration=1.662739276 podStartE2EDuration="13.162216228s" totalImagesPullingTime="11.499476952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:20.161072665 +0000 UTC m=+259.022244408" watchObservedRunningTime="2026-07-07 00:00:20.162216228 +0000 UTC m=+259.023387968" Jul 07 00:00:21.148427 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:21.148387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" event={"ID":"2dc04cf4-37e8-4479-847e-d8a164bb8b73","Type":"ContainerStarted","Data":"4bdfda850253a60bde5f1ba30d6e8cde40c258d35ec0fc9661825317168c77f9"} Jul 07 00:00:21.148842 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:21.148680 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:21.171047 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:21.170995 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" podStartSLOduration=1.447088058 podStartE2EDuration="8.170980917s" totalImagesPullingTime="6.723892859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:21.169483147 +0000 UTC m=+260.030654889" watchObservedRunningTime="2026-07-07 00:00:21.170980917 +0000 UTC m=+260.032152657" Jul 07 00:00:27.155678 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:27.155570 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2tkn4" Jul 07 00:00:29.193462 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:29.193428 2559 generic.go:356] "Generic (PLEG): container finished" podID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerID="75df5b587f2eb374b31c5e82b9c6c2943b270d82c85a69c4ed6b432ca8355d26" exitCode=0 Jul 07 00:00:29.193920 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:29.193506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" event={"ID":"7dad1926-e80e-46fe-a85c-cd9881010c24","Type":"ContainerDied","Data":"75df5b587f2eb374b31c5e82b9c6c2943b270d82c85a69c4ed6b432ca8355d26"} Jul 07 00:00:30.200884 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:30.200855 2559 generic.go:356] "Generic (PLEG): container finished" podID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerID="14250f1cbc26042ce3b75d9333984aa25b5d7077c33121068a37df4192f40492" exitCode=0 Jul 07 00:00:30.201351 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:30.200909 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" event={"ID":"7dad1926-e80e-46fe-a85c-cd9881010c24","Type":"ContainerDied","Data":"14250f1cbc26042ce3b75d9333984aa25b5d7077c33121068a37df4192f40492"} Jul 07 00:00:31.338491 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.338463 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:31.431954 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.431904 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-util\") pod \"7dad1926-e80e-46fe-a85c-cd9881010c24\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " Jul 07 00:00:31.432151 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.431974 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-bundle\") pod \"7dad1926-e80e-46fe-a85c-cd9881010c24\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " Jul 07 00:00:31.432151 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.432107 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvhsv\" (UniqueName: \"kubernetes.io/projected/7dad1926-e80e-46fe-a85c-cd9881010c24-kube-api-access-bvhsv\") pod \"7dad1926-e80e-46fe-a85c-cd9881010c24\" (UID: \"7dad1926-e80e-46fe-a85c-cd9881010c24\") " Jul 07 00:00:31.432373 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.432345 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-bundle" (OuterVolumeSpecName: "bundle") pod "7dad1926-e80e-46fe-a85c-cd9881010c24" (UID: "7dad1926-e80e-46fe-a85c-cd9881010c24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:00:31.434302 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.434278 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dad1926-e80e-46fe-a85c-cd9881010c24-kube-api-access-bvhsv" (OuterVolumeSpecName: "kube-api-access-bvhsv") pod "7dad1926-e80e-46fe-a85c-cd9881010c24" (UID: "7dad1926-e80e-46fe-a85c-cd9881010c24"). InnerVolumeSpecName "kube-api-access-bvhsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:31.436416 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.436392 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-util" (OuterVolumeSpecName: "util") pod "7dad1926-e80e-46fe-a85c-cd9881010c24" (UID: "7dad1926-e80e-46fe-a85c-cd9881010c24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:00:31.532891 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.532799 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvhsv\" (UniqueName: \"kubernetes.io/projected/7dad1926-e80e-46fe-a85c-cd9881010c24-kube-api-access-bvhsv\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:31.532891 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.532841 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-util\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:31.532891 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:31.532852 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad1926-e80e-46fe-a85c-cd9881010c24-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:32.211388 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:32.211359 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" Jul 07 00:00:32.211560 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:32.211358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw5vkj" event={"ID":"7dad1926-e80e-46fe-a85c-cd9881010c24","Type":"ContainerDied","Data":"63fb265c040c4d91ec7ac3f883998ded1852b492a74c5ffde7a66875cc15eea0"} Jul 07 00:00:32.211560 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:32.211501 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63fb265c040c4d91ec7ac3f883998ded1852b492a74c5ffde7a66875cc15eea0" Jul 07 00:00:38.478048 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478008 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj"] Jul 07 00:00:38.478550 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478499 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerName="util" Jul 07 00:00:38.478550 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478518 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerName="util" Jul 07 00:00:38.478550 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478530 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerName="extract" Jul 07 00:00:38.478550 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478538 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerName="extract" Jul 07 00:00:38.478795 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478566 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerName="pull" Jul 07 00:00:38.478795 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478573 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerName="pull" Jul 07 00:00:38.478795 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.478686 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dad1926-e80e-46fe-a85c-cd9881010c24" containerName="extract" Jul 07 00:00:38.481943 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.481923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.484484 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.484463 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 00:00:38.485413 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.485390 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 00:00:38.485561 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.485451 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b4t8q\"" Jul 07 00:00:38.488769 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.488747 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj"] Jul 07 00:00:38.594283 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.594242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866kq\" (UniqueName: \"kubernetes.io/projected/e41acea9-4da1-4160-9d61-01c6046b629b-kube-api-access-866kq\") pod \"openshift-lws-operator-fd8ccff4c-d9prj\" (UID: \"e41acea9-4da1-4160-9d61-01c6046b629b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.594283 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.594288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e41acea9-4da1-4160-9d61-01c6046b629b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9prj\" (UID: \"e41acea9-4da1-4160-9d61-01c6046b629b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.695855 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.695809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-866kq\" (UniqueName: \"kubernetes.io/projected/e41acea9-4da1-4160-9d61-01c6046b629b-kube-api-access-866kq\") pod \"openshift-lws-operator-fd8ccff4c-d9prj\" (UID: \"e41acea9-4da1-4160-9d61-01c6046b629b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.695855 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.695861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e41acea9-4da1-4160-9d61-01c6046b629b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9prj\" (UID: \"e41acea9-4da1-4160-9d61-01c6046b629b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.696241 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.696225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e41acea9-4da1-4160-9d61-01c6046b629b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9prj\" (UID: \"e41acea9-4da1-4160-9d61-01c6046b629b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.707314 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.707283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-866kq\" (UniqueName: \"kubernetes.io/projected/e41acea9-4da1-4160-9d61-01c6046b629b-kube-api-access-866kq\") pod \"openshift-lws-operator-fd8ccff4c-d9prj\" (UID: \"e41acea9-4da1-4160-9d61-01c6046b629b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.792385 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.792294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" Jul 07 00:00:38.937470 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:38.937445 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj"] Jul 07 00:00:38.939437 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:00:38.939410 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode41acea9_4da1_4160_9d61_01c6046b629b.slice/crio-82bce561c8e827705dc69fa9ad88d2e2ef73825cc0a7656feba7afd1eced177b WatchSource:0}: Error finding container 82bce561c8e827705dc69fa9ad88d2e2ef73825cc0a7656feba7afd1eced177b: Status 404 returned error can't find the container with id 82bce561c8e827705dc69fa9ad88d2e2ef73825cc0a7656feba7afd1eced177b Jul 07 00:00:39.247199 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:39.247161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" event={"ID":"e41acea9-4da1-4160-9d61-01c6046b629b","Type":"ContainerStarted","Data":"82bce561c8e827705dc69fa9ad88d2e2ef73825cc0a7656feba7afd1eced177b"} Jul 07 00:00:41.260024 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:41.259984 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" event={"ID":"e41acea9-4da1-4160-9d61-01c6046b629b","Type":"ContainerStarted","Data":"e733af4aa6360e7c6fcb31e8c193a103e75ed502720119960c520d7016603810"} Jul 07 00:00:41.276478 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:41.276428 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9prj" podStartSLOduration=1.431941414 podStartE2EDuration="3.276411167s" totalImagesPullingTime="1.844469753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:41.275327805 +0000 UTC m=+280.136499544" watchObservedRunningTime="2026-07-07 00:00:41.276411167 +0000 UTC m=+280.137582908" Jul 07 00:00:43.975088 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:43.975053 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24"] Jul 07 00:00:43.979022 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:43.978999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:43.981824 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:43.981801 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 00:00:43.982873 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:43.982856 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 00:00:43.982969 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:43.982857 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wts9q\"" Jul 07 00:00:43.987907 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:43.987884 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24"] Jul 07 00:00:44.144723 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.144690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.144723 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.144730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twd89\" (UniqueName: \"kubernetes.io/projected/17bee57e-1a0d-40a5-81b4-ede61c839c52-kube-api-access-twd89\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.144936 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.144771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.245637 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.245547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.245796 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.245641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.245796 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.245700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twd89\" (UniqueName: \"kubernetes.io/projected/17bee57e-1a0d-40a5-81b4-ede61c839c52-kube-api-access-twd89\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.245964 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.245942 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.246048 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.246026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.257563 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.257531 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twd89\" (UniqueName: \"kubernetes.io/projected/17bee57e-1a0d-40a5-81b4-ede61c839c52-kube-api-access-twd89\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.289220 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.289185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:44.424721 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:44.424692 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24"] Jul 07 00:00:44.426351 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:00:44.426317 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bee57e_1a0d_40a5_81b4_ede61c839c52.slice/crio-be14cdec392900ca437f408a45816507e455b519dadea971a7d50cb52bbabac7 WatchSource:0}: Error finding container be14cdec392900ca437f408a45816507e455b519dadea971a7d50cb52bbabac7: Status 404 returned error can't find the container with id be14cdec392900ca437f408a45816507e455b519dadea971a7d50cb52bbabac7 Jul 07 00:00:45.280693 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:45.280663 2559 generic.go:356] "Generic (PLEG): container finished" podID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerID="1d44a7893963948ca20ab3f45303e10d716f78e0b02febe4132b4efa247e8c94" exitCode=0 Jul 07 00:00:45.281052 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:45.280703 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" event={"ID":"17bee57e-1a0d-40a5-81b4-ede61c839c52","Type":"ContainerDied","Data":"1d44a7893963948ca20ab3f45303e10d716f78e0b02febe4132b4efa247e8c94"} Jul 07 00:00:45.281052 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:45.280738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" event={"ID":"17bee57e-1a0d-40a5-81b4-ede61c839c52","Type":"ContainerStarted","Data":"be14cdec392900ca437f408a45816507e455b519dadea971a7d50cb52bbabac7"} Jul 07 00:00:46.287787 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:46.287690 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" event={"ID":"17bee57e-1a0d-40a5-81b4-ede61c839c52","Type":"ContainerDied","Data":"6ebd2df87982a4951b3d981476651adf601b5725e0f1697bce79202b77cb213c"} Jul 07 00:00:46.287787 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:46.287634 2559 generic.go:356] "Generic (PLEG): container finished" podID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerID="6ebd2df87982a4951b3d981476651adf601b5725e0f1697bce79202b77cb213c" exitCode=0 Jul 07 00:00:47.298319 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:47.298273 2559 generic.go:356] "Generic (PLEG): container finished" podID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerID="b17ce30de4e5727f2d9bb23c794ee8e5cc281b22a406de81cd8b33f3c80f7c09" exitCode=0 Jul 07 00:00:47.298708 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:47.298342 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" event={"ID":"17bee57e-1a0d-40a5-81b4-ede61c839c52","Type":"ContainerDied","Data":"b17ce30de4e5727f2d9bb23c794ee8e5cc281b22a406de81cd8b33f3c80f7c09"} Jul 07 00:00:48.434573 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.434543 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:48.478148 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.478109 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-bundle\") pod \"17bee57e-1a0d-40a5-81b4-ede61c839c52\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " Jul 07 00:00:48.478343 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.478167 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twd89\" (UniqueName: \"kubernetes.io/projected/17bee57e-1a0d-40a5-81b4-ede61c839c52-kube-api-access-twd89\") pod \"17bee57e-1a0d-40a5-81b4-ede61c839c52\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " Jul 07 00:00:48.478343 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.478201 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-util\") pod \"17bee57e-1a0d-40a5-81b4-ede61c839c52\" (UID: \"17bee57e-1a0d-40a5-81b4-ede61c839c52\") " Jul 07 00:00:48.478974 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.478941 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-bundle" (OuterVolumeSpecName: "bundle") pod "17bee57e-1a0d-40a5-81b4-ede61c839c52" (UID: "17bee57e-1a0d-40a5-81b4-ede61c839c52"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:00:48.480556 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.480523 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17bee57e-1a0d-40a5-81b4-ede61c839c52-kube-api-access-twd89" (OuterVolumeSpecName: "kube-api-access-twd89") pod "17bee57e-1a0d-40a5-81b4-ede61c839c52" (UID: "17bee57e-1a0d-40a5-81b4-ede61c839c52"). InnerVolumeSpecName "kube-api-access-twd89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:48.483967 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.483945 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-util" (OuterVolumeSpecName: "util") pod "17bee57e-1a0d-40a5-81b4-ede61c839c52" (UID: "17bee57e-1a0d-40a5-81b4-ede61c839c52"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:00:48.578815 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.578716 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:48.578815 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.578760 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twd89\" (UniqueName: \"kubernetes.io/projected/17bee57e-1a0d-40a5-81b4-ede61c839c52-kube-api-access-twd89\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:48.578815 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:48.578771 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bee57e-1a0d-40a5-81b4-ede61c839c52-util\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:00:49.310526 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:49.310493 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" event={"ID":"17bee57e-1a0d-40a5-81b4-ede61c839c52","Type":"ContainerDied","Data":"be14cdec392900ca437f408a45816507e455b519dadea971a7d50cb52bbabac7"} Jul 07 00:00:49.310526 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:49.310529 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4zj24" Jul 07 00:00:49.310760 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:49.310541 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be14cdec392900ca437f408a45816507e455b519dadea971a7d50cb52bbabac7" Jul 07 00:00:56.958227 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958193 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8"] Jul 07 00:00:56.958737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958532 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerName="extract" Jul 07 00:00:56.958737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958544 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerName="extract" Jul 07 00:00:56.958737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958564 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerName="util" Jul 07 00:00:56.958737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958569 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerName="util" Jul 07 00:00:56.958737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958588 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerName="pull" Jul 07 00:00:56.958737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958596 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerName="pull" Jul 07 00:00:56.958737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.958666 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="17bee57e-1a0d-40a5-81b4-ede61c839c52" containerName="extract" Jul 07 00:00:56.960923 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.960908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:56.964777 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.964756 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 00:00:56.965182 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.965164 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 00:00:56.965311 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.965296 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 00:00:56.965440 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.965423 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 00:00:56.965550 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.965537 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p27dv\"" Jul 07 00:00:56.977305 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:56.977280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8"] Jul 07 00:00:57.037791 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.037750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aecd5f50-e817-4d11-8156-93b71bd80530-tmp\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.037976 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.037805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrph\" (UniqueName: \"kubernetes.io/projected/aecd5f50-e817-4d11-8156-93b71bd80530-kube-api-access-9mrph\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.037976 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.037869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aecd5f50-e817-4d11-8156-93b71bd80530-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.037976 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.037904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aecd5f50-e817-4d11-8156-93b71bd80530-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.037976 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.037955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aecd5f50-e817-4d11-8156-93b71bd80530-manifests\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.138341 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.138296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aecd5f50-e817-4d11-8156-93b71bd80530-manifests\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.138341 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.138348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aecd5f50-e817-4d11-8156-93b71bd80530-tmp\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.138608 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.138390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrph\" (UniqueName: \"kubernetes.io/projected/aecd5f50-e817-4d11-8156-93b71bd80530-kube-api-access-9mrph\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.138608 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.138427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aecd5f50-e817-4d11-8156-93b71bd80530-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.138608 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.138457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aecd5f50-e817-4d11-8156-93b71bd80530-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.138822 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.138782 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aecd5f50-e817-4d11-8156-93b71bd80530-manifests\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.140883 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.140851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aecd5f50-e817-4d11-8156-93b71bd80530-tmp\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.141012 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.140954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aecd5f50-e817-4d11-8156-93b71bd80530-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.141129 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.141110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aecd5f50-e817-4d11-8156-93b71bd80530-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.147259 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.147238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrph\" (UniqueName: \"kubernetes.io/projected/aecd5f50-e817-4d11-8156-93b71bd80530-kube-api-access-9mrph\") pod \"opendatahub-operator-controller-manager-5d7997cf4b-mgvn8\" (UID: \"aecd5f50-e817-4d11-8156-93b71bd80530\") " pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.272037 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.271951 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:00:57.421664 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:57.421627 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8"] Jul 07 00:00:57.423983 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:00:57.423949 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecd5f50_e817_4d11_8156_93b71bd80530.slice/crio-f1a592fa94fad6cd2f3a7a73db1afe675d1ad90e3b798abafab0e6f4266e10c6 WatchSource:0}: Error finding container f1a592fa94fad6cd2f3a7a73db1afe675d1ad90e3b798abafab0e6f4266e10c6: Status 404 returned error can't find the container with id f1a592fa94fad6cd2f3a7a73db1afe675d1ad90e3b798abafab0e6f4266e10c6 Jul 07 00:00:58.359390 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:00:58.359352 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" event={"ID":"aecd5f50-e817-4d11-8156-93b71bd80530","Type":"ContainerStarted","Data":"f1a592fa94fad6cd2f3a7a73db1afe675d1ad90e3b798abafab0e6f4266e10c6"} Jul 07 00:01:01.384729 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:01.384687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" event={"ID":"aecd5f50-e817-4d11-8156-93b71bd80530","Type":"ContainerStarted","Data":"47e3aa89bb09ab54f9c8e50c7bfda8c1a168f203fa5c1902c16fa3acd27685c5"} Jul 07 00:01:01.563160 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:01.563127 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:01:01.566929 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:01.566898 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:01:01.575030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:01.575004 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 00:01:01.734554 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:01.734517 2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecd5f50_e817_4d11_8156_93b71bd80530.slice/crio-conmon-47e3aa89bb09ab54f9c8e50c7bfda8c1a168f203fa5c1902c16fa3acd27685c5.scope\": RecentStats: unable to find data in memory cache]" Jul 07 00:01:02.391377 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:02.391327 2559 generic.go:356] "Generic (PLEG): container finished" podID="aecd5f50-e817-4d11-8156-93b71bd80530" containerID="47e3aa89bb09ab54f9c8e50c7bfda8c1a168f203fa5c1902c16fa3acd27685c5" exitCode=0 Jul 07 00:01:02.391788 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:02.391388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" event={"ID":"aecd5f50-e817-4d11-8156-93b71bd80530","Type":"ContainerDied","Data":"47e3aa89bb09ab54f9c8e50c7bfda8c1a168f203fa5c1902c16fa3acd27685c5"} Jul 07 00:01:03.399576 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:03.399534 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" event={"ID":"aecd5f50-e817-4d11-8156-93b71bd80530","Type":"ContainerStarted","Data":"4b2e6470b6e0d036147baf05d64de28299fdba625adbecd850a1031976eea69e"} Jul 07 00:01:03.400212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:03.399717 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:01:03.425691 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:03.425610 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" podStartSLOduration=2.923899368 podStartE2EDuration="7.425585941s" totalImagesPullingTime="3.409519622s" totalInitContainerRuntime="1.092166951s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:03.424264451 +0000 UTC m=+302.285436193" watchObservedRunningTime="2026-07-07 00:01:03.425585941 +0000 UTC m=+302.286757682" Jul 07 00:01:14.407109 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:14.407078 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d7997cf4b-mgvn8" Jul 07 00:01:17.899627 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:17.899589 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc"] Jul 07 00:01:17.910841 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:17.910810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:17.913810 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:17.913763 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 00:01:17.914018 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:17.913994 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 00:01:17.920579 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:17.920555 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc"] Jul 07 00:01:18.015171 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.015134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tmp\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.015365 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.015221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbzp\" (UniqueName: \"kubernetes.io/projected/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-kube-api-access-qpbzp\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.015365 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.015248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tls-certs\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.088627 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.088589 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jm67q"] Jul 07 00:01:18.092316 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.092299 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.098596 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.098562 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 00:01:18.098772 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.098674 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-g6b2m\"" Jul 07 00:01:18.116033 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.115989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbzp\" (UniqueName: \"kubernetes.io/projected/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-kube-api-access-qpbzp\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.116033 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.116027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tls-certs\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.116370 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.116092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tmp\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.116370 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:18.116234 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 07 00:01:18.116370 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:18.116339 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tls-certs podName:61f266e3-31c0-4a2f-bb0b-5eacaafd8f87 nodeName:}" failed. No retries permitted until 2026-07-07 00:01:18.616322045 +0000 UTC m=+317.477493764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tls-certs") pod "kube-auth-proxy-7697f65cb7-p4prc" (UID: "61f266e3-31c0-4a2f-bb0b-5eacaafd8f87") : secret "kube-auth-proxy-tls" not found Jul 07 00:01:18.119321 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.119290 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tmp\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.120353 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.120327 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jm67q"] Jul 07 00:01:18.152388 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.152322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbzp\" (UniqueName: \"kubernetes.io/projected/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-kube-api-access-qpbzp\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.217063 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.217023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks552\" (UniqueName: \"kubernetes.io/projected/67fc2324-b6fe-4b12-83a3-d29e1185c630-kube-api-access-ks552\") pod \"odh-model-controller-7998c67dc4-jm67q\" (UID: \"67fc2324-b6fe-4b12-83a3-d29e1185c630\") " pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.217252 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.217138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fc2324-b6fe-4b12-83a3-d29e1185c630-cert\") pod \"odh-model-controller-7998c67dc4-jm67q\" (UID: \"67fc2324-b6fe-4b12-83a3-d29e1185c630\") " pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.318188 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.318151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks552\" (UniqueName: \"kubernetes.io/projected/67fc2324-b6fe-4b12-83a3-d29e1185c630-kube-api-access-ks552\") pod \"odh-model-controller-7998c67dc4-jm67q\" (UID: \"67fc2324-b6fe-4b12-83a3-d29e1185c630\") " pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.318389 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.318260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fc2324-b6fe-4b12-83a3-d29e1185c630-cert\") pod \"odh-model-controller-7998c67dc4-jm67q\" (UID: \"67fc2324-b6fe-4b12-83a3-d29e1185c630\") " pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.318389 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:18.318379 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 00:01:18.318504 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:18.318449 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67fc2324-b6fe-4b12-83a3-d29e1185c630-cert podName:67fc2324-b6fe-4b12-83a3-d29e1185c630 nodeName:}" failed. No retries permitted until 2026-07-07 00:01:18.818427445 +0000 UTC m=+317.679599187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67fc2324-b6fe-4b12-83a3-d29e1185c630-cert") pod "odh-model-controller-7998c67dc4-jm67q" (UID: "67fc2324-b6fe-4b12-83a3-d29e1185c630") : secret "odh-model-controller-webhook-cert" not found Jul 07 00:01:18.347998 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.347969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks552\" (UniqueName: \"kubernetes.io/projected/67fc2324-b6fe-4b12-83a3-d29e1185c630-kube-api-access-ks552\") pod \"odh-model-controller-7998c67dc4-jm67q\" (UID: \"67fc2324-b6fe-4b12-83a3-d29e1185c630\") " pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.620278 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.620246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tls-certs\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.622883 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.622851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f266e3-31c0-4a2f-bb0b-5eacaafd8f87-tls-certs\") pod \"kube-auth-proxy-7697f65cb7-p4prc\" (UID: \"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87\") " pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.822103 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.822064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" Jul 07 00:01:18.822302 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.822275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fc2324-b6fe-4b12-83a3-d29e1185c630-cert\") pod \"odh-model-controller-7998c67dc4-jm67q\" (UID: \"67fc2324-b6fe-4b12-83a3-d29e1185c630\") " pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.824949 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.824917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fc2324-b6fe-4b12-83a3-d29e1185c630-cert\") pod \"odh-model-controller-7998c67dc4-jm67q\" (UID: \"67fc2324-b6fe-4b12-83a3-d29e1185c630\") " pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:18.978167 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.978133 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc"] Jul 07 00:01:18.979832 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:01:18.979795 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f266e3_31c0_4a2f_bb0b_5eacaafd8f87.slice/crio-17e6346421c6eb29599766b1199345f4150bb0a654865703bb56a8f0fcbbe9c2 WatchSource:0}: Error finding container 17e6346421c6eb29599766b1199345f4150bb0a654865703bb56a8f0fcbbe9c2: Status 404 returned error can't find the container with id 17e6346421c6eb29599766b1199345f4150bb0a654865703bb56a8f0fcbbe9c2 Jul 07 00:01:18.981595 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:18.981577 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:01:19.003285 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.003255 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:19.121209 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.120998 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-85wgw"] Jul 07 00:01:19.127870 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.127783 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.136174 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.136147 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 00:01:19.146903 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.146873 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-85wgw"] Jul 07 00:01:19.214711 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.214669 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jm67q"] Jul 07 00:01:19.219101 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:01:19.219067 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fc2324_b6fe_4b12_83a3_d29e1185c630.slice/crio-549a84cbf3fbcff62cde5bd09704e225887e0c242d9b7b3d7e960cd97a0809ac WatchSource:0}: Error finding container 549a84cbf3fbcff62cde5bd09704e225887e0c242d9b7b3d7e960cd97a0809ac: Status 404 returned error can't find the container with id 549a84cbf3fbcff62cde5bd09704e225887e0c242d9b7b3d7e960cd97a0809ac Jul 07 00:01:19.226479 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.226451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfvd\" (UniqueName: \"kubernetes.io/projected/36ac489d-577a-423d-8bb3-8fba2978028b-kube-api-access-twfvd\") pod \"model-serving-api-54d89bd5fc-85wgw\" (UID: \"36ac489d-577a-423d-8bb3-8fba2978028b\") " pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.226580 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.226496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ac489d-577a-423d-8bb3-8fba2978028b-tls-certs\") pod \"model-serving-api-54d89bd5fc-85wgw\" (UID: \"36ac489d-577a-423d-8bb3-8fba2978028b\") " pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.327860 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.327822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfvd\" (UniqueName: \"kubernetes.io/projected/36ac489d-577a-423d-8bb3-8fba2978028b-kube-api-access-twfvd\") pod \"model-serving-api-54d89bd5fc-85wgw\" (UID: \"36ac489d-577a-423d-8bb3-8fba2978028b\") " pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.327860 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.327860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ac489d-577a-423d-8bb3-8fba2978028b-tls-certs\") pod \"model-serving-api-54d89bd5fc-85wgw\" (UID: \"36ac489d-577a-423d-8bb3-8fba2978028b\") " pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.330413 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.330390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ac489d-577a-423d-8bb3-8fba2978028b-tls-certs\") pod \"model-serving-api-54d89bd5fc-85wgw\" (UID: \"36ac489d-577a-423d-8bb3-8fba2978028b\") " pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.338083 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.338056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfvd\" (UniqueName: \"kubernetes.io/projected/36ac489d-577a-423d-8bb3-8fba2978028b-kube-api-access-twfvd\") pod \"model-serving-api-54d89bd5fc-85wgw\" (UID: \"36ac489d-577a-423d-8bb3-8fba2978028b\") " pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.448203 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.448109 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:19.483098 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.483056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" event={"ID":"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87","Type":"ContainerStarted","Data":"17e6346421c6eb29599766b1199345f4150bb0a654865703bb56a8f0fcbbe9c2"} Jul 07 00:01:19.484499 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.484471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" event={"ID":"67fc2324-b6fe-4b12-83a3-d29e1185c630","Type":"ContainerStarted","Data":"549a84cbf3fbcff62cde5bd09704e225887e0c242d9b7b3d7e960cd97a0809ac"} Jul 07 00:01:19.598636 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.598603 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-85wgw"] Jul 07 00:01:19.602152 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:01:19.602126 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ac489d_577a_423d_8bb3_8fba2978028b.slice/crio-eae0059add095e3ef0c45ee58a823cc10cab107ac645261c63d34d515b854705 WatchSource:0}: Error finding container eae0059add095e3ef0c45ee58a823cc10cab107ac645261c63d34d515b854705: Status 404 returned error can't find the container with id eae0059add095e3ef0c45ee58a823cc10cab107ac645261c63d34d515b854705 Jul 07 00:01:19.654503 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.654462 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5"] Jul 07 00:01:19.659438 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.659409 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.664188 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.664165 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 00:01:19.664468 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.664440 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 00:01:19.664601 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.664490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ft49l\"" Jul 07 00:01:19.664601 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.664493 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 00:01:19.665802 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.665788 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 00:01:19.678362 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.678328 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5"] Jul 07 00:01:19.732690 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.732538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.732690 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.732595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-token\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.732690 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.732668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltz6r\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-kube-api-access-ltz6r\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.732989 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.732706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-cacerts\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.732989 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.732730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.732989 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.732753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.732989 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.732796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45aedf43-efe6-4c39-8da2-10491e2ae33f-local-certs\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.834258 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.834215 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.834258 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.834271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-token\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.834530 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.834316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltz6r\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-kube-api-access-ltz6r\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.834530 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.834349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-cacerts\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.834530 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.834365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.834530 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.834382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.834530 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.834422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45aedf43-efe6-4c39-8da2-10491e2ae33f-local-certs\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.835841 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.835758 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.837441 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.837395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.837910 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.837886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45aedf43-efe6-4c39-8da2-10491e2ae33f-local-certs\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.837910 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.837902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.838327 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.838306 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-cacerts\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.843516 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.843488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltz6r\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-kube-api-access-ltz6r\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.843687 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.843630 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-token\") pod \"istiod-openshift-gateway-7574459656-lcvh5\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:19.970796 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:19.970760 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:20.185847 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:20.184708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5"] Jul 07 00:01:20.187265 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:01:20.187229 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45aedf43_efe6_4c39_8da2_10491e2ae33f.slice/crio-8e2387069239ee46d1e06832d83e4215a109f3d5c3ef56e94c77feba08f39287 WatchSource:0}: Error finding container 8e2387069239ee46d1e06832d83e4215a109f3d5c3ef56e94c77feba08f39287: Status 404 returned error can't find the container with id 8e2387069239ee46d1e06832d83e4215a109f3d5c3ef56e94c77feba08f39287 Jul 07 00:01:20.494931 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:20.494885 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" event={"ID":"45aedf43-efe6-4c39-8da2-10491e2ae33f","Type":"ContainerStarted","Data":"8e2387069239ee46d1e06832d83e4215a109f3d5c3ef56e94c77feba08f39287"} Jul 07 00:01:20.497012 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:20.496974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" event={"ID":"36ac489d-577a-423d-8bb3-8fba2978028b","Type":"ContainerStarted","Data":"eae0059add095e3ef0c45ee58a823cc10cab107ac645261c63d34d515b854705"} Jul 07 00:01:24.526429 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.526380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" event={"ID":"36ac489d-577a-423d-8bb3-8fba2978028b","Type":"ContainerStarted","Data":"e7c8a36bb6402cb0177fe798cf81bfd3f9c3c0ba978dbb42a9caad95f4d7fd4c"} Jul 07 00:01:24.526957 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.526494 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:24.529514 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.529470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" event={"ID":"61f266e3-31c0-4a2f-bb0b-5eacaafd8f87","Type":"ContainerStarted","Data":"690715069c5ec85c5a08cb38429c73848c81011f6b9fd0ab440f4a40399635f1"} Jul 07 00:01:24.531679 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.531601 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" event={"ID":"67fc2324-b6fe-4b12-83a3-d29e1185c630","Type":"ContainerStarted","Data":"cf06fb728eb8df2ac3a99b437c541770a56bc68f8685068a9b3e298e1b0f6209"} Jul 07 00:01:24.531839 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.531756 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:24.546242 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.546150 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" podStartSLOduration=1.5632092 podStartE2EDuration="5.546130331s" totalImagesPullingTime="3.982921131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:24.544975623 +0000 UTC m=+323.406147365" watchObservedRunningTime="2026-07-07 00:01:24.546130331 +0000 UTC m=+323.407302073" Jul 07 00:01:24.564256 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.564192 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" podStartSLOduration=2.180426122 podStartE2EDuration="6.564172829s" totalImagesPullingTime="4.383746707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:24.562581711 +0000 UTC m=+323.423753452" watchObservedRunningTime="2026-07-07 00:01:24.564172829 +0000 UTC m=+323.425344573" Jul 07 00:01:24.585303 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:24.585251 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7697f65cb7-p4prc" podStartSLOduration=2.974487315 podStartE2EDuration="7.585229079s" totalImagesPullingTime="4.610741764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:24.58329424 +0000 UTC m=+323.444465981" watchObservedRunningTime="2026-07-07 00:01:24.585229079 +0000 UTC m=+323.446400826" Jul 07 00:01:25.042643 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:25.042603 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:01:25.042643 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:25.042689 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:01:25.539243 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:25.539199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" event={"ID":"45aedf43-efe6-4c39-8da2-10491e2ae33f","Type":"ContainerStarted","Data":"d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b"} Jul 07 00:01:25.539790 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:25.539771 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:25.564622 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:25.564572 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" podStartSLOduration=1.71222846 podStartE2EDuration="6.564550352s" totalImagesPullingTime="4.852321892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:25.563212141 +0000 UTC m=+324.424383883" watchObservedRunningTime="2026-07-07 00:01:25.564550352 +0000 UTC m=+324.425722093" Jul 07 00:01:26.547063 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:26.547030 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-lcvh5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 00:01:26.547560 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:26.547090 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" podUID="45aedf43-efe6-4c39-8da2-10491e2ae33f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 00:01:27.457798 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.457768 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf"] Jul 07 00:01:27.461175 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.461160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.467036 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.467012 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k74sl\"" Jul 07 00:01:27.498800 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.498761 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf"] Jul 07 00:01:27.550741 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.550716 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:27.616016 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.615980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616016 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrflt\" (UniqueName: \"kubernetes.io/projected/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-kube-api-access-mrflt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616286 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616286 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616286 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616286 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616286 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616551 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.616551 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.616327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.717736 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.717621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.717736 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.717681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.717736 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.717705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718012 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.717746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718012 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.717768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrflt\" (UniqueName: \"kubernetes.io/projected/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-kube-api-access-mrflt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718142 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.717937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718142 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718104 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718258 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718258 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718258 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718398 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718603 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718603 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.718603 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.718623 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.720249 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.720222 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.720460 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.720444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.739717 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.739681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrflt\" (UniqueName: \"kubernetes.io/projected/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-kube-api-access-mrflt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.741543 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.741509 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f707f0-e4e4-48a7-9085-f1c4a2532a5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4tvxnf\" (UID: \"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.770920 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.770882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:27.940733 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:01:27.940699 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f707f0_e4e4_48a7_9085_f1c4a2532a5c.slice/crio-228cf53997e6e4b4e43a2b0ca0df5de461bc3c1441dc8e8a9de5e525a7c9e115 WatchSource:0}: Error finding container 228cf53997e6e4b4e43a2b0ca0df5de461bc3c1441dc8e8a9de5e525a7c9e115: Status 404 returned error can't find the container with id 228cf53997e6e4b4e43a2b0ca0df5de461bc3c1441dc8e8a9de5e525a7c9e115 Jul 07 00:01:27.941065 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:27.941038 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf"] Jul 07 00:01:28.556412 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:28.556378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" event={"ID":"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c","Type":"ContainerStarted","Data":"228cf53997e6e4b4e43a2b0ca0df5de461bc3c1441dc8e8a9de5e525a7c9e115"} Jul 07 00:01:31.092429 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.092388 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:01:31.092740 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.092458 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:01:31.092740 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.092487 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:01:31.583156 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.583110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" event={"ID":"f6f707f0-e4e4-48a7-9085-f1c4a2532a5c","Type":"ContainerStarted","Data":"2293c53f7f47e946a73d91d4c9c4117938117aee37f8ca1dc8dff195669b9e74"} Jul 07 00:01:31.641463 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.641413 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" podStartSLOduration=1.492307329 podStartE2EDuration="4.641394474s" totalImagesPullingTime="3.149087145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:31.629157914 +0000 UTC m=+330.490329654" watchObservedRunningTime="2026-07-07 00:01:31.641394474 +0000 UTC m=+330.502566215" Jul 07 00:01:31.750914 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.750878 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-td967"] Jul 07 00:01:31.754629 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.754612 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:31.757863 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.757842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 00:01:31.758068 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.758049 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wmd4f\"" Jul 07 00:01:31.771193 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.771158 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:31.774312 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.774286 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n"] Jul 07 00:01:31.777946 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.777918 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:31.779632 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.778386 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-td967"] Jul 07 00:01:31.813391 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.813048 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 00:01:31.818045 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.818023 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-95gkx\"" Jul 07 00:01:31.824272 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.824246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n"] Jul 07 00:01:31.859058 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.858973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tr67n\" (UID: \"14fd7593-ff3d-4523-bc8a-a0c2dff2048b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:31.859058 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.859012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cfcd36d-8cc3-4074-a236-698a8ea80141-cert\") pod \"kserve-controller-manager-d6f4b65b8-td967\" (UID: \"0cfcd36d-8cc3-4074-a236-698a8ea80141\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:31.859357 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.859102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vzd\" (UniqueName: \"kubernetes.io/projected/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-kube-api-access-m7vzd\") pod \"llmisvc-controller-manager-777c6bd7d5-tr67n\" (UID: \"14fd7593-ff3d-4523-bc8a-a0c2dff2048b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:31.859357 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.859205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg9rn\" (UniqueName: \"kubernetes.io/projected/0cfcd36d-8cc3-4074-a236-698a8ea80141-kube-api-access-dg9rn\") pod \"kserve-controller-manager-d6f4b65b8-td967\" (UID: \"0cfcd36d-8cc3-4074-a236-698a8ea80141\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:31.960494 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.960451 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cfcd36d-8cc3-4074-a236-698a8ea80141-cert\") pod \"kserve-controller-manager-d6f4b65b8-td967\" (UID: \"0cfcd36d-8cc3-4074-a236-698a8ea80141\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:31.960693 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.960516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vzd\" (UniqueName: \"kubernetes.io/projected/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-kube-api-access-m7vzd\") pod \"llmisvc-controller-manager-777c6bd7d5-tr67n\" (UID: \"14fd7593-ff3d-4523-bc8a-a0c2dff2048b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:31.960693 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.960554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg9rn\" (UniqueName: \"kubernetes.io/projected/0cfcd36d-8cc3-4074-a236-698a8ea80141-kube-api-access-dg9rn\") pod \"kserve-controller-manager-d6f4b65b8-td967\" (UID: \"0cfcd36d-8cc3-4074-a236-698a8ea80141\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:31.960693 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.960591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tr67n\" (UID: \"14fd7593-ff3d-4523-bc8a-a0c2dff2048b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:31.960891 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:31.960698 2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 00:01:31.960891 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:31.960760 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-cert podName:14fd7593-ff3d-4523-bc8a-a0c2dff2048b nodeName:}" failed. No retries permitted until 2026-07-07 00:01:32.460741039 +0000 UTC m=+331.321912775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-cert") pod "llmisvc-controller-manager-777c6bd7d5-tr67n" (UID: "14fd7593-ff3d-4523-bc8a-a0c2dff2048b") : secret "llmisvc-webhook-server-cert" not found Jul 07 00:01:31.963151 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.963126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cfcd36d-8cc3-4074-a236-698a8ea80141-cert\") pod \"kserve-controller-manager-d6f4b65b8-td967\" (UID: \"0cfcd36d-8cc3-4074-a236-698a8ea80141\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:31.979853 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.979812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg9rn\" (UniqueName: \"kubernetes.io/projected/0cfcd36d-8cc3-4074-a236-698a8ea80141-kube-api-access-dg9rn\") pod \"kserve-controller-manager-d6f4b65b8-td967\" (UID: \"0cfcd36d-8cc3-4074-a236-698a8ea80141\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:31.980003 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:31.979945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vzd\" (UniqueName: \"kubernetes.io/projected/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-kube-api-access-m7vzd\") pod \"llmisvc-controller-manager-777c6bd7d5-tr67n\" (UID: \"14fd7593-ff3d-4523-bc8a-a0c2dff2048b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:32.064370 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.064332 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:32.280839 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.280811 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-td967"] Jul 07 00:01:32.281883 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:01:32.281852 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfcd36d_8cc3_4074_a236_698a8ea80141.slice/crio-958cff23f135523e894813bbb401afcadd7d808351fd8940371a8d5eade6d113 WatchSource:0}: Error finding container 958cff23f135523e894813bbb401afcadd7d808351fd8940371a8d5eade6d113: Status 404 returned error can't find the container with id 958cff23f135523e894813bbb401afcadd7d808351fd8940371a8d5eade6d113 Jul 07 00:01:32.464775 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.464729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tr67n\" (UID: \"14fd7593-ff3d-4523-bc8a-a0c2dff2048b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:32.467479 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.467449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14fd7593-ff3d-4523-bc8a-a0c2dff2048b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tr67n\" (UID: \"14fd7593-ff3d-4523-bc8a-a0c2dff2048b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:32.589406 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.589367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" event={"ID":"0cfcd36d-8cc3-4074-a236-698a8ea80141","Type":"ContainerStarted","Data":"958cff23f135523e894813bbb401afcadd7d808351fd8940371a8d5eade6d113"} Jul 07 00:01:32.697350 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.697313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:32.776459 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.776434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:32.862616 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:32.862582 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n"] Jul 07 00:01:32.865597 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:01:32.865565 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod14fd7593_ff3d_4523_bc8a_a0c2dff2048b.slice/crio-6312341ce3260e2f04270a3055064c7daea447871ed36be91a9922388e17d438 WatchSource:0}: Error finding container 6312341ce3260e2f04270a3055064c7daea447871ed36be91a9922388e17d438: Status 404 returned error can't find the container with id 6312341ce3260e2f04270a3055064c7daea447871ed36be91a9922388e17d438 Jul 07 00:01:33.597305 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:33.597268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" event={"ID":"14fd7593-ff3d-4523-bc8a-a0c2dff2048b","Type":"ContainerStarted","Data":"6312341ce3260e2f04270a3055064c7daea447871ed36be91a9922388e17d438"} Jul 07 00:01:33.597717 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:33.597615 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:33.598533 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:33.598511 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4tvxnf" Jul 07 00:01:35.012234 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.012195 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5"] Jul 07 00:01:35.012742 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.012475 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" podUID="45aedf43-efe6-4c39-8da2-10491e2ae33f" containerName="discovery" containerID="cri-o://d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b" gracePeriod=30 Jul 07 00:01:35.532879 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.532855 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:35.542095 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.542066 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jm67q" Jul 07 00:01:35.544317 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.544296 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-85wgw" Jul 07 00:01:35.614549 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.614470 2559 generic.go:356] "Generic (PLEG): container finished" podID="45aedf43-efe6-4c39-8da2-10491e2ae33f" containerID="d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b" exitCode=0 Jul 07 00:01:35.614549 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.614522 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" Jul 07 00:01:35.614809 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.614553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" event={"ID":"45aedf43-efe6-4c39-8da2-10491e2ae33f","Type":"ContainerDied","Data":"d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b"} Jul 07 00:01:35.614809 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.614594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5" event={"ID":"45aedf43-efe6-4c39-8da2-10491e2ae33f","Type":"ContainerDied","Data":"8e2387069239ee46d1e06832d83e4215a109f3d5c3ef56e94c77feba08f39287"} Jul 07 00:01:35.614809 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.614608 2559 scope.go:117] "RemoveContainer" containerID="d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b" Jul 07 00:01:35.698735 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.698711 2559 scope.go:117] "RemoveContainer" containerID="d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b" Jul 07 00:01:35.698910 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.698882 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-token\") pod \"45aedf43-efe6-4c39-8da2-10491e2ae33f\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " Jul 07 00:01:35.699030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.698939 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-ca-configmap\") pod \"45aedf43-efe6-4c39-8da2-10491e2ae33f\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " Jul 07 00:01:35.699030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.698980 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45aedf43-efe6-4c39-8da2-10491e2ae33f-local-certs\") pod \"45aedf43-efe6-4c39-8da2-10491e2ae33f\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " Jul 07 00:01:35.699030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.699026 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-cacerts\") pod \"45aedf43-efe6-4c39-8da2-10491e2ae33f\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " Jul 07 00:01:35.699190 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.699111 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-dns-cert\") pod \"45aedf43-efe6-4c39-8da2-10491e2ae33f\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " Jul 07 00:01:35.699190 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.699166 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-kubeconfig\") pod \"45aedf43-efe6-4c39-8da2-10491e2ae33f\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " Jul 07 00:01:35.699336 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.699203 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltz6r\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-kube-api-access-ltz6r\") pod \"45aedf43-efe6-4c39-8da2-10491e2ae33f\" (UID: \"45aedf43-efe6-4c39-8da2-10491e2ae33f\") " Jul 07 00:01:35.699336 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:01:35.699317 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b\": container with ID starting with d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b not found: ID does not exist" containerID="d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b" Jul 07 00:01:35.699435 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.699361 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b"} err="failed to get container status \"d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b\": rpc error: code = NotFound desc = could not find container \"d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b\": container with ID starting with d011600dd11dd88dc5afc35cdb287c8032b4607bc1a90c4084dca66b3976642b not found: ID does not exist" Jul 07 00:01:35.701739 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.700076 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "45aedf43-efe6-4c39-8da2-10491e2ae33f" (UID: "45aedf43-efe6-4c39-8da2-10491e2ae33f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:01:35.701739 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.701588 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-ca-configmap\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:01:35.705047 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.705008 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-cacerts" (OuterVolumeSpecName: "cacerts") pod "45aedf43-efe6-4c39-8da2-10491e2ae33f" (UID: "45aedf43-efe6-4c39-8da2-10491e2ae33f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:35.714696 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.714621 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "45aedf43-efe6-4c39-8da2-10491e2ae33f" (UID: "45aedf43-efe6-4c39-8da2-10491e2ae33f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:35.716200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.715559 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45aedf43-efe6-4c39-8da2-10491e2ae33f-local-certs" (OuterVolumeSpecName: "local-certs") pod "45aedf43-efe6-4c39-8da2-10491e2ae33f" (UID: "45aedf43-efe6-4c39-8da2-10491e2ae33f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:01:35.716200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.715718 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-token" (OuterVolumeSpecName: "istio-token") pod "45aedf43-efe6-4c39-8da2-10491e2ae33f" (UID: "45aedf43-efe6-4c39-8da2-10491e2ae33f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:01:35.716713 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.716665 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-kube-api-access-ltz6r" (OuterVolumeSpecName: "kube-api-access-ltz6r") pod "45aedf43-efe6-4c39-8da2-10491e2ae33f" (UID: "45aedf43-efe6-4c39-8da2-10491e2ae33f"). InnerVolumeSpecName "kube-api-access-ltz6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:01:35.717196 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.717162 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "45aedf43-efe6-4c39-8da2-10491e2ae33f" (UID: "45aedf43-efe6-4c39-8da2-10491e2ae33f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:01:35.802663 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.802619 2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-cacerts\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:01:35.802663 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.802666 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-csr-dns-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:01:35.802837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.802682 2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-kubeconfig\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:01:35.802837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.802692 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltz6r\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-kube-api-access-ltz6r\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:01:35.802837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.802703 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45aedf43-efe6-4c39-8da2-10491e2ae33f-istio-token\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:01:35.802837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.802711 2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45aedf43-efe6-4c39-8da2-10491e2ae33f-local-certs\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:01:35.958888 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.958853 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5"] Jul 07 00:01:35.963611 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:35.963579 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lcvh5"] Jul 07 00:01:36.622097 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:36.622060 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" event={"ID":"0cfcd36d-8cc3-4074-a236-698a8ea80141","Type":"ContainerStarted","Data":"ee6ed9299cc07a963f73efa2dc2131ab27217f3ebd20cc6d38b7d331df797371"} Jul 07 00:01:36.622513 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:36.622165 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:01:36.623668 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:36.623623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" event={"ID":"14fd7593-ff3d-4523-bc8a-a0c2dff2048b","Type":"ContainerStarted","Data":"6d2ce04f33cc20d8726402091f8779ae6a708dc8ba509a6e0bc4c80f6bbbf0cd"} Jul 07 00:01:36.623825 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:36.623701 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:01:36.660719 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:36.660609 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" podStartSLOduration=2.393962755 podStartE2EDuration="5.660593391s" totalImagesPullingTime="3.266630636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:36.659262948 +0000 UTC m=+335.520434694" watchObservedRunningTime="2026-07-07 00:01:36.660593391 +0000 UTC m=+335.521765132" Jul 07 00:01:36.722784 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:36.722727 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" podStartSLOduration=2.143010814 podStartE2EDuration="5.722710429s" totalImagesPullingTime="3.579699615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:36.720033705 +0000 UTC m=+335.581205446" watchObservedRunningTime="2026-07-07 00:01:36.722710429 +0000 UTC m=+335.583882170" Jul 07 00:01:37.665022 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:01:37.664988 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45aedf43-efe6-4c39-8da2-10491e2ae33f" path="/var/lib/kubelet/pods/45aedf43-efe6-4c39-8da2-10491e2ae33f/volumes" Jul 07 00:02:07.631395 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:07.631363 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tr67n" Jul 07 00:02:07.634557 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:07.634536 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-td967" Jul 07 00:02:18.690259 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.690222 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gndcx"] Jul 07 00:02:18.690635 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.690592 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45aedf43-efe6-4c39-8da2-10491e2ae33f" containerName="discovery" Jul 07 00:02:18.690635 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.690603 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="45aedf43-efe6-4c39-8da2-10491e2ae33f" containerName="discovery" Jul 07 00:02:18.690787 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.690680 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="45aedf43-efe6-4c39-8da2-10491e2ae33f" containerName="discovery" Jul 07 00:02:18.705155 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.705114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" Jul 07 00:02:18.705419 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.705122 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gndcx"] Jul 07 00:02:18.707979 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.707946 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wsth5\"" Jul 07 00:02:18.708133 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.707960 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 00:02:18.708942 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.708925 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 00:02:18.784078 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.784041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47tg\" (UniqueName: \"kubernetes.io/projected/6d476706-ed84-42fe-a6df-0d940c491e50-kube-api-access-r47tg\") pod \"kuadrant-operator-catalog-gndcx\" (UID: \"6d476706-ed84-42fe-a6df-0d940c491e50\") " pod="kuadrant-system/kuadrant-operator-catalog-gndcx" Jul 07 00:02:18.885133 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.885100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47tg\" (UniqueName: \"kubernetes.io/projected/6d476706-ed84-42fe-a6df-0d940c491e50-kube-api-access-r47tg\") pod \"kuadrant-operator-catalog-gndcx\" (UID: \"6d476706-ed84-42fe-a6df-0d940c491e50\") " pod="kuadrant-system/kuadrant-operator-catalog-gndcx" Jul 07 00:02:18.893545 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:18.893517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47tg\" (UniqueName: \"kubernetes.io/projected/6d476706-ed84-42fe-a6df-0d940c491e50-kube-api-access-r47tg\") pod \"kuadrant-operator-catalog-gndcx\" (UID: \"6d476706-ed84-42fe-a6df-0d940c491e50\") " pod="kuadrant-system/kuadrant-operator-catalog-gndcx" Jul 07 00:02:19.017701 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.017577 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" Jul 07 00:02:19.056019 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.055966 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gndcx"] Jul 07 00:02:19.159326 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.159304 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gndcx"] Jul 07 00:02:19.160999 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:19.160973 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d476706_ed84_42fe_a6df_0d940c491e50.slice/crio-68d7426020afca5743cf67eaf133c7bb78a3a4d9bca1c35f52de022cf560a3fd WatchSource:0}: Error finding container 68d7426020afca5743cf67eaf133c7bb78a3a4d9bca1c35f52de022cf560a3fd: Status 404 returned error can't find the container with id 68d7426020afca5743cf67eaf133c7bb78a3a4d9bca1c35f52de022cf560a3fd Jul 07 00:02:19.267943 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.267861 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vp88m"] Jul 07 00:02:19.270881 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.270865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:19.280561 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.280534 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vp88m"] Jul 07 00:02:19.389311 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.389280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65wbq\" (UniqueName: \"kubernetes.io/projected/a338c1f8-44b5-4fe4-be5f-4807c0c585c5-kube-api-access-65wbq\") pod \"kuadrant-operator-catalog-vp88m\" (UID: \"a338c1f8-44b5-4fe4-be5f-4807c0c585c5\") " pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:19.490043 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.490008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65wbq\" (UniqueName: \"kubernetes.io/projected/a338c1f8-44b5-4fe4-be5f-4807c0c585c5-kube-api-access-65wbq\") pod \"kuadrant-operator-catalog-vp88m\" (UID: \"a338c1f8-44b5-4fe4-be5f-4807c0c585c5\") " pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:19.500259 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.500223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65wbq\" (UniqueName: \"kubernetes.io/projected/a338c1f8-44b5-4fe4-be5f-4807c0c585c5-kube-api-access-65wbq\") pod \"kuadrant-operator-catalog-vp88m\" (UID: \"a338c1f8-44b5-4fe4-be5f-4807c0c585c5\") " pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:19.581563 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.581478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:19.735007 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.734977 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vp88m"] Jul 07 00:02:19.788261 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:19.788225 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda338c1f8_44b5_4fe4_be5f_4807c0c585c5.slice/crio-ef7c78171b9cb639bfe9559dbdf3ea4a3af5d39c33cd64009521d4e04da3e031 WatchSource:0}: Error finding container ef7c78171b9cb639bfe9559dbdf3ea4a3af5d39c33cd64009521d4e04da3e031: Status 404 returned error can't find the container with id ef7c78171b9cb639bfe9559dbdf3ea4a3af5d39c33cd64009521d4e04da3e031 Jul 07 00:02:19.848041 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.847961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" event={"ID":"6d476706-ed84-42fe-a6df-0d940c491e50","Type":"ContainerStarted","Data":"68d7426020afca5743cf67eaf133c7bb78a3a4d9bca1c35f52de022cf560a3fd"} Jul 07 00:02:19.849216 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:19.849190 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" event={"ID":"a338c1f8-44b5-4fe4-be5f-4807c0c585c5","Type":"ContainerStarted","Data":"ef7c78171b9cb639bfe9559dbdf3ea4a3af5d39c33cd64009521d4e04da3e031"} Jul 07 00:02:21.861811 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:21.861762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" event={"ID":"6d476706-ed84-42fe-a6df-0d940c491e50","Type":"ContainerStarted","Data":"4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e"} Jul 07 00:02:21.862226 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:21.861816 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" podUID="6d476706-ed84-42fe-a6df-0d940c491e50" containerName="registry-server" containerID="cri-o://4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e" gracePeriod=2 Jul 07 00:02:21.863459 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:21.863433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" event={"ID":"a338c1f8-44b5-4fe4-be5f-4807c0c585c5","Type":"ContainerStarted","Data":"fdc6def6a1127ba2bddb6de6aded5a02b1390a4ce9465c2927f5c74a4483e840"} Jul 07 00:02:21.877129 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:21.876784 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" podStartSLOduration=1.6893616150000001 podStartE2EDuration="3.876765769s" totalImagesPullingTime="2.187404154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:21.875792319 +0000 UTC m=+380.736964061" watchObservedRunningTime="2026-07-07 00:02:21.876765769 +0000 UTC m=+380.737937513" Jul 07 00:02:21.890922 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:21.890880 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" podStartSLOduration=1.327707249 podStartE2EDuration="2.890864799s" totalImagesPullingTime="1.56315755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:21.889405996 +0000 UTC m=+380.750577741" watchObservedRunningTime="2026-07-07 00:02:21.890864799 +0000 UTC m=+380.752036544" Jul 07 00:02:22.114065 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.114006 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" Jul 07 00:02:22.215212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.215174 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r47tg\" (UniqueName: \"kubernetes.io/projected/6d476706-ed84-42fe-a6df-0d940c491e50-kube-api-access-r47tg\") pod \"6d476706-ed84-42fe-a6df-0d940c491e50\" (UID: \"6d476706-ed84-42fe-a6df-0d940c491e50\") " Jul 07 00:02:22.217605 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.217576 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d476706-ed84-42fe-a6df-0d940c491e50-kube-api-access-r47tg" (OuterVolumeSpecName: "kube-api-access-r47tg") pod "6d476706-ed84-42fe-a6df-0d940c491e50" (UID: "6d476706-ed84-42fe-a6df-0d940c491e50"). InnerVolumeSpecName "kube-api-access-r47tg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:02:22.316533 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.316494 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r47tg\" (UniqueName: \"kubernetes.io/projected/6d476706-ed84-42fe-a6df-0d940c491e50-kube-api-access-r47tg\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:22.870435 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.870409 2559 generic.go:356] "Generic (PLEG): container finished" podID="6d476706-ed84-42fe-a6df-0d940c491e50" containerID="4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e" exitCode=0 Jul 07 00:02:22.870870 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.870455 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" Jul 07 00:02:22.870870 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.870508 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" event={"ID":"6d476706-ed84-42fe-a6df-0d940c491e50","Type":"ContainerDied","Data":"4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e"} Jul 07 00:02:22.870870 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.870564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gndcx" event={"ID":"6d476706-ed84-42fe-a6df-0d940c491e50","Type":"ContainerDied","Data":"68d7426020afca5743cf67eaf133c7bb78a3a4d9bca1c35f52de022cf560a3fd"} Jul 07 00:02:22.870870 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.870592 2559 scope.go:117] "RemoveContainer" containerID="4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e" Jul 07 00:02:22.880190 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.880170 2559 scope.go:117] "RemoveContainer" containerID="4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e" Jul 07 00:02:22.880504 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:02:22.880486 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e\": container with ID starting with 4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e not found: ID does not exist" containerID="4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e" Jul 07 00:02:22.880564 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.880516 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e"} err="failed to get container status \"4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e\": rpc error: code = NotFound desc = could not find container \"4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e\": container with ID starting with 4f26631899287f5535f9d7fd01d545f4b09814b9a47ba587ac9f742440e76a5e not found: ID does not exist" Jul 07 00:02:22.892743 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.892714 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gndcx"] Jul 07 00:02:22.896959 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:22.896935 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gndcx"] Jul 07 00:02:23.665440 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:23.665411 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d476706-ed84-42fe-a6df-0d940c491e50" path="/var/lib/kubelet/pods/6d476706-ed84-42fe-a6df-0d940c491e50/volumes" Jul 07 00:02:29.582629 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:29.582594 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:29.583059 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:29.582828 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:29.606570 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:29.606546 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:29.930367 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:29.930337 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vp88m" Jul 07 00:02:34.300474 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.300436 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr"] Jul 07 00:02:34.301014 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.300927 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d476706-ed84-42fe-a6df-0d940c491e50" containerName="registry-server" Jul 07 00:02:34.301014 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.300946 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d476706-ed84-42fe-a6df-0d940c491e50" containerName="registry-server" Jul 07 00:02:34.301119 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.301042 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d476706-ed84-42fe-a6df-0d940c491e50" containerName="registry-server" Jul 07 00:02:34.306038 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.306021 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.309553 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.309436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cjtgc\"" Jul 07 00:02:34.311323 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.311290 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr"] Jul 07 00:02:34.421675 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.421619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.421865 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.421684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-864nj\" (UniqueName: \"kubernetes.io/projected/3b88e754-fd29-4037-b841-dee29955e6a3-kube-api-access-864nj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.421865 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.421761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.522867 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.522824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.523064 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.522879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-864nj\" (UniqueName: \"kubernetes.io/projected/3b88e754-fd29-4037-b841-dee29955e6a3-kube-api-access-864nj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.523064 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.522948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.523246 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.523223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.523322 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.523300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.531756 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.531723 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-864nj\" (UniqueName: \"kubernetes.io/projected/3b88e754-fd29-4037-b841-dee29955e6a3-kube-api-access-864nj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.617333 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.617300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:34.762885 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.762859 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr"] Jul 07 00:02:34.764621 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:34.764594 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b88e754_fd29_4037_b841_dee29955e6a3.slice/crio-30025486dd3aaf1d2ce873a4a82f1498f3df08079188232f65d83c372406861b WatchSource:0}: Error finding container 30025486dd3aaf1d2ce873a4a82f1498f3df08079188232f65d83c372406861b: Status 404 returned error can't find the container with id 30025486dd3aaf1d2ce873a4a82f1498f3df08079188232f65d83c372406861b Jul 07 00:02:34.900771 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.900737 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2"] Jul 07 00:02:34.904807 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.904787 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:34.912728 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.912700 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2"] Jul 07 00:02:34.935162 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.935133 2559 generic.go:356] "Generic (PLEG): container finished" podID="3b88e754-fd29-4037-b841-dee29955e6a3" containerID="99a6da2b789ff023fd57d2358bec4b47f5c0b6b6e6e1f6663971eacdf886b6b5" exitCode=0 Jul 07 00:02:34.935321 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.935186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" event={"ID":"3b88e754-fd29-4037-b841-dee29955e6a3","Type":"ContainerDied","Data":"99a6da2b789ff023fd57d2358bec4b47f5c0b6b6e6e1f6663971eacdf886b6b5"} Jul 07 00:02:34.935321 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:34.935221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" event={"ID":"3b88e754-fd29-4037-b841-dee29955e6a3","Type":"ContainerStarted","Data":"30025486dd3aaf1d2ce873a4a82f1498f3df08079188232f65d83c372406861b"} Jul 07 00:02:35.027325 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.027289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.027512 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.027336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cll\" (UniqueName: \"kubernetes.io/projected/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-kube-api-access-g6cll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.027512 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.027369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.128200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.128105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.128200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.128157 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cll\" (UniqueName: \"kubernetes.io/projected/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-kube-api-access-g6cll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.128200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.128182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.128630 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.128612 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.128713 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.128638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.136792 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.136769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cll\" (UniqueName: \"kubernetes.io/projected/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-kube-api-access-g6cll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.221509 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.221469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:35.359680 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.359628 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2"] Jul 07 00:02:35.361254 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:35.361233 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8ee3e6_6c7c_4212_bef9_0199bade38e4.slice/crio-1c5df4b1aa39870e42fcb505168839c545b2dbe27e5f60a0f28227394edd5809 WatchSource:0}: Error finding container 1c5df4b1aa39870e42fcb505168839c545b2dbe27e5f60a0f28227394edd5809: Status 404 returned error can't find the container with id 1c5df4b1aa39870e42fcb505168839c545b2dbe27e5f60a0f28227394edd5809 Jul 07 00:02:35.500442 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.500408 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb"] Jul 07 00:02:35.504195 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.504178 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.512540 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.512514 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb"] Jul 07 00:02:35.633624 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.633588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.633624 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.633635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc7zd\" (UniqueName: \"kubernetes.io/projected/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-kube-api-access-qc7zd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.633878 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.633715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.735282 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.735199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.735282 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.735241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc7zd\" (UniqueName: \"kubernetes.io/projected/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-kube-api-access-qc7zd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.735282 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.735270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.735606 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.735585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.735644 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.735601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.743560 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.743530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc7zd\" (UniqueName: \"kubernetes.io/projected/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-kube-api-access-qc7zd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.814735 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.814687 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:35.903002 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.902925 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9"] Jul 07 00:02:35.908430 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.908404 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:35.915556 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.915532 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9"] Jul 07 00:02:35.945291 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.945254 2559 generic.go:356] "Generic (PLEG): container finished" podID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerID="cd30930407a6572a1e9bfc8446311f3dab98d45874d2e12bf140ed3f92c2f6a2" exitCode=0 Jul 07 00:02:35.945454 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.945331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" event={"ID":"0b8ee3e6-6c7c-4212-bef9-0199bade38e4","Type":"ContainerDied","Data":"cd30930407a6572a1e9bfc8446311f3dab98d45874d2e12bf140ed3f92c2f6a2"} Jul 07 00:02:35.945454 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.945382 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" event={"ID":"0b8ee3e6-6c7c-4212-bef9-0199bade38e4","Type":"ContainerStarted","Data":"1c5df4b1aa39870e42fcb505168839c545b2dbe27e5f60a0f28227394edd5809"} Jul 07 00:02:35.963220 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:35.963199 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb"] Jul 07 00:02:35.964521 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:35.964495 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa46c87a_b4ec_42c1_9a0f_a201db26c1f3.slice/crio-341fad7f3c69a999850909b6409283cf6a720a46f8a31041e0b38c1b26a1813c WatchSource:0}: Error finding container 341fad7f3c69a999850909b6409283cf6a720a46f8a31041e0b38c1b26a1813c: Status 404 returned error can't find the container with id 341fad7f3c69a999850909b6409283cf6a720a46f8a31041e0b38c1b26a1813c Jul 07 00:02:36.037530 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.037502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.037689 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.037611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9ptx\" (UniqueName: \"kubernetes.io/projected/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-kube-api-access-x9ptx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.037689 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.037637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.138432 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.138401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9ptx\" (UniqueName: \"kubernetes.io/projected/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-kube-api-access-x9ptx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.138432 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.138436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.138806 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.138495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.138951 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.138927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.138985 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.138955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.146850 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.146817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9ptx\" (UniqueName: \"kubernetes.io/projected/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-kube-api-access-x9ptx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.221756 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.221734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:36.368143 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.368116 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9"] Jul 07 00:02:36.369505 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:36.369471 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a7d892_e8a9_48cb_945b_42dd7e112c2a.slice/crio-14620924247f937f958d466ac1ee6085932c6eb17b25175b9e2ae850dc749567 WatchSource:0}: Error finding container 14620924247f937f958d466ac1ee6085932c6eb17b25175b9e2ae850dc749567: Status 404 returned error can't find the container with id 14620924247f937f958d466ac1ee6085932c6eb17b25175b9e2ae850dc749567 Jul 07 00:02:36.954001 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.953968 2559 generic.go:356] "Generic (PLEG): container finished" podID="3b88e754-fd29-4037-b841-dee29955e6a3" containerID="92ad077f70abde76eb56574da552981e3185d35d870899509f273d313c3a71c2" exitCode=0 Jul 07 00:02:36.954168 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.954059 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" event={"ID":"3b88e754-fd29-4037-b841-dee29955e6a3","Type":"ContainerDied","Data":"92ad077f70abde76eb56574da552981e3185d35d870899509f273d313c3a71c2"} Jul 07 00:02:36.955805 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.955777 2559 generic.go:356] "Generic (PLEG): container finished" podID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerID="df28e1e49d87620acbaba650a5b65f110af95f90dedabb30d36325a71a25b30a" exitCode=0 Jul 07 00:02:36.955912 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.955886 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" event={"ID":"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3","Type":"ContainerDied","Data":"df28e1e49d87620acbaba650a5b65f110af95f90dedabb30d36325a71a25b30a"} Jul 07 00:02:36.955984 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.955951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" event={"ID":"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3","Type":"ContainerStarted","Data":"341fad7f3c69a999850909b6409283cf6a720a46f8a31041e0b38c1b26a1813c"} Jul 07 00:02:36.958116 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.958091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" event={"ID":"0b8ee3e6-6c7c-4212-bef9-0199bade38e4","Type":"ContainerStarted","Data":"25154bcfa5493c1e0b189a894873b3877880fb23c51c3a425d5d23a3c9c36d7d"} Jul 07 00:02:36.959823 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.959797 2559 generic.go:356] "Generic (PLEG): container finished" podID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerID="6304d1898a7bb522ab2511a383f9f89dfcf7feb4db8e3fd6cd5a77fd079b4b70" exitCode=0 Jul 07 00:02:36.959933 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.959885 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" event={"ID":"a5a7d892-e8a9-48cb-945b-42dd7e112c2a","Type":"ContainerDied","Data":"6304d1898a7bb522ab2511a383f9f89dfcf7feb4db8e3fd6cd5a77fd079b4b70"} Jul 07 00:02:36.959933 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:36.959918 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" event={"ID":"a5a7d892-e8a9-48cb-945b-42dd7e112c2a","Type":"ContainerStarted","Data":"14620924247f937f958d466ac1ee6085932c6eb17b25175b9e2ae850dc749567"} Jul 07 00:02:37.967892 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:37.967868 2559 generic.go:356] "Generic (PLEG): container finished" podID="3b88e754-fd29-4037-b841-dee29955e6a3" containerID="dde85b69b42cc4fc520f6d5b979fe0edeb208a97d75e201ddffd07fa6c76781d" exitCode=0 Jul 07 00:02:37.968205 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:37.967947 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" event={"ID":"3b88e754-fd29-4037-b841-dee29955e6a3","Type":"ContainerDied","Data":"dde85b69b42cc4fc520f6d5b979fe0edeb208a97d75e201ddffd07fa6c76781d"} Jul 07 00:02:37.969695 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:37.969670 2559 generic.go:356] "Generic (PLEG): container finished" podID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerID="7c7f7280548eddeb1572ae708046b9e008b1722c7cb91e398c6d6d0dba4b4e98" exitCode=0 Jul 07 00:02:37.969815 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:37.969748 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" event={"ID":"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3","Type":"ContainerDied","Data":"7c7f7280548eddeb1572ae708046b9e008b1722c7cb91e398c6d6d0dba4b4e98"} Jul 07 00:02:37.971602 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:37.971578 2559 generic.go:356] "Generic (PLEG): container finished" podID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerID="25154bcfa5493c1e0b189a894873b3877880fb23c51c3a425d5d23a3c9c36d7d" exitCode=0 Jul 07 00:02:37.971702 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:37.971676 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" event={"ID":"0b8ee3e6-6c7c-4212-bef9-0199bade38e4","Type":"ContainerDied","Data":"25154bcfa5493c1e0b189a894873b3877880fb23c51c3a425d5d23a3c9c36d7d"} Jul 07 00:02:37.973667 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:37.973625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" event={"ID":"a5a7d892-e8a9-48cb-945b-42dd7e112c2a","Type":"ContainerStarted","Data":"9cfc482838749cf00b886395425ffbd0228aaa8a249d728f35a6fd6e6f1030a6"} Jul 07 00:02:38.981423 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.981388 2559 generic.go:356] "Generic (PLEG): container finished" podID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerID="f01e92fee2260a32494a8be047d93a5e26e15c8f83a5010e3a43cad7151e4d08" exitCode=0 Jul 07 00:02:38.981912 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.981476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" event={"ID":"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3","Type":"ContainerDied","Data":"f01e92fee2260a32494a8be047d93a5e26e15c8f83a5010e3a43cad7151e4d08"} Jul 07 00:02:38.983746 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.983722 2559 generic.go:356] "Generic (PLEG): container finished" podID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerID="6a2c56e58fb0335bcc2a79b9803873988faaeda05c920a0f4d521edb18f137a7" exitCode=0 Jul 07 00:02:38.983858 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.983806 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" event={"ID":"0b8ee3e6-6c7c-4212-bef9-0199bade38e4","Type":"ContainerDied","Data":"6a2c56e58fb0335bcc2a79b9803873988faaeda05c920a0f4d521edb18f137a7"} Jul 07 00:02:38.985873 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.985852 2559 generic.go:356] "Generic (PLEG): container finished" podID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerID="9cfc482838749cf00b886395425ffbd0228aaa8a249d728f35a6fd6e6f1030a6" exitCode=0 Jul 07 00:02:38.985873 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.985871 2559 generic.go:356] "Generic (PLEG): container finished" podID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerID="04ebe559bcbc7f89e1b683772b45ae855c322e2e9974d5d3c305b506b83ca339" exitCode=0 Jul 07 00:02:38.986019 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.985932 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" event={"ID":"a5a7d892-e8a9-48cb-945b-42dd7e112c2a","Type":"ContainerDied","Data":"9cfc482838749cf00b886395425ffbd0228aaa8a249d728f35a6fd6e6f1030a6"} Jul 07 00:02:38.986019 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:38.985968 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" event={"ID":"a5a7d892-e8a9-48cb-945b-42dd7e112c2a","Type":"ContainerDied","Data":"04ebe559bcbc7f89e1b683772b45ae855c322e2e9974d5d3c305b506b83ca339"} Jul 07 00:02:39.131727 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.131702 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:39.267569 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.267529 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-util\") pod \"3b88e754-fd29-4037-b841-dee29955e6a3\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " Jul 07 00:02:39.267773 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.267582 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-864nj\" (UniqueName: \"kubernetes.io/projected/3b88e754-fd29-4037-b841-dee29955e6a3-kube-api-access-864nj\") pod \"3b88e754-fd29-4037-b841-dee29955e6a3\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " Jul 07 00:02:39.267773 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.267616 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-bundle\") pod \"3b88e754-fd29-4037-b841-dee29955e6a3\" (UID: \"3b88e754-fd29-4037-b841-dee29955e6a3\") " Jul 07 00:02:39.268134 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.268106 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-bundle" (OuterVolumeSpecName: "bundle") pod "3b88e754-fd29-4037-b841-dee29955e6a3" (UID: "3b88e754-fd29-4037-b841-dee29955e6a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:39.269931 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.269909 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b88e754-fd29-4037-b841-dee29955e6a3-kube-api-access-864nj" (OuterVolumeSpecName: "kube-api-access-864nj") pod "3b88e754-fd29-4037-b841-dee29955e6a3" (UID: "3b88e754-fd29-4037-b841-dee29955e6a3"). InnerVolumeSpecName "kube-api-access-864nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:02:39.273097 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.273073 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-util" (OuterVolumeSpecName: "util") pod "3b88e754-fd29-4037-b841-dee29955e6a3" (UID: "3b88e754-fd29-4037-b841-dee29955e6a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:39.369306 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.369272 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-util\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:39.369306 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.369308 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-864nj\" (UniqueName: \"kubernetes.io/projected/3b88e754-fd29-4037-b841-dee29955e6a3-kube-api-access-864nj\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:39.369499 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.369319 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b88e754-fd29-4037-b841-dee29955e6a3-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:39.994598 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.994510 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" Jul 07 00:02:39.994598 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.994539 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr" event={"ID":"3b88e754-fd29-4037-b841-dee29955e6a3","Type":"ContainerDied","Data":"30025486dd3aaf1d2ce873a4a82f1498f3df08079188232f65d83c372406861b"} Jul 07 00:02:39.994598 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:39.994598 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30025486dd3aaf1d2ce873a4a82f1498f3df08079188232f65d83c372406861b" Jul 07 00:02:40.161274 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.161248 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:40.199905 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.199868 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:40.202952 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.202930 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:40.278884 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.278795 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-bundle\") pod \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " Jul 07 00:02:40.278884 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.278829 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-util\") pod \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " Jul 07 00:02:40.279069 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.278887 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc7zd\" (UniqueName: \"kubernetes.io/projected/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-kube-api-access-qc7zd\") pod \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\" (UID: \"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3\") " Jul 07 00:02:40.279428 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.279399 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-bundle" (OuterVolumeSpecName: "bundle") pod "aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" (UID: "aa46c87a-b4ec-42c1-9a0f-a201db26c1f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:40.281207 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.281177 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-kube-api-access-qc7zd" (OuterVolumeSpecName: "kube-api-access-qc7zd") pod "aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" (UID: "aa46c87a-b4ec-42c1-9a0f-a201db26c1f3"). InnerVolumeSpecName "kube-api-access-qc7zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:02:40.284530 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.284502 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-util" (OuterVolumeSpecName: "util") pod "aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" (UID: "aa46c87a-b4ec-42c1-9a0f-a201db26c1f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:40.380237 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380188 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9ptx\" (UniqueName: \"kubernetes.io/projected/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-kube-api-access-x9ptx\") pod \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " Jul 07 00:02:40.380443 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380284 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-bundle\") pod \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " Jul 07 00:02:40.380443 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380303 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-util\") pod \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " Jul 07 00:02:40.380443 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380321 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-bundle\") pod \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\" (UID: \"a5a7d892-e8a9-48cb-945b-42dd7e112c2a\") " Jul 07 00:02:40.380443 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380344 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-util\") pod \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " Jul 07 00:02:40.380443 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380372 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6cll\" (UniqueName: \"kubernetes.io/projected/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-kube-api-access-g6cll\") pod \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\" (UID: \"0b8ee3e6-6c7c-4212-bef9-0199bade38e4\") " Jul 07 00:02:40.380750 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380609 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc7zd\" (UniqueName: \"kubernetes.io/projected/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-kube-api-access-qc7zd\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.380750 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380630 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.380750 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380645 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa46c87a-b4ec-42c1-9a0f-a201db26c1f3-util\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.380948 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.380906 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-bundle" (OuterVolumeSpecName: "bundle") pod "a5a7d892-e8a9-48cb-945b-42dd7e112c2a" (UID: "a5a7d892-e8a9-48cb-945b-42dd7e112c2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:40.381042 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.381015 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-bundle" (OuterVolumeSpecName: "bundle") pod "0b8ee3e6-6c7c-4212-bef9-0199bade38e4" (UID: "0b8ee3e6-6c7c-4212-bef9-0199bade38e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:40.383206 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.383177 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-kube-api-access-g6cll" (OuterVolumeSpecName: "kube-api-access-g6cll") pod "0b8ee3e6-6c7c-4212-bef9-0199bade38e4" (UID: "0b8ee3e6-6c7c-4212-bef9-0199bade38e4"). InnerVolumeSpecName "kube-api-access-g6cll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:02:40.383304 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.383262 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-kube-api-access-x9ptx" (OuterVolumeSpecName: "kube-api-access-x9ptx") pod "a5a7d892-e8a9-48cb-945b-42dd7e112c2a" (UID: "a5a7d892-e8a9-48cb-945b-42dd7e112c2a"). InnerVolumeSpecName "kube-api-access-x9ptx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:02:40.388975 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.388950 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-util" (OuterVolumeSpecName: "util") pod "0b8ee3e6-6c7c-4212-bef9-0199bade38e4" (UID: "0b8ee3e6-6c7c-4212-bef9-0199bade38e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:40.389340 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.389323 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-util" (OuterVolumeSpecName: "util") pod "a5a7d892-e8a9-48cb-945b-42dd7e112c2a" (UID: "a5a7d892-e8a9-48cb-945b-42dd7e112c2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:02:40.482092 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.482041 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-util\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.482092 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.482085 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6cll\" (UniqueName: \"kubernetes.io/projected/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-kube-api-access-g6cll\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.482092 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.482097 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9ptx\" (UniqueName: \"kubernetes.io/projected/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-kube-api-access-x9ptx\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.482092 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.482107 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b8ee3e6-6c7c-4212-bef9-0199bade38e4-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.482092 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.482114 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-util\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:40.482398 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:40.482122 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5a7d892-e8a9-48cb-945b-42dd7e112c2a-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:02:41.001413 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.001384 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" Jul 07 00:02:41.001413 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.001396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9" event={"ID":"a5a7d892-e8a9-48cb-945b-42dd7e112c2a","Type":"ContainerDied","Data":"14620924247f937f958d466ac1ee6085932c6eb17b25175b9e2ae850dc749567"} Jul 07 00:02:41.001919 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.001438 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14620924247f937f958d466ac1ee6085932c6eb17b25175b9e2ae850dc749567" Jul 07 00:02:41.003480 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.003460 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" Jul 07 00:02:41.003600 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.003481 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb" event={"ID":"aa46c87a-b4ec-42c1-9a0f-a201db26c1f3","Type":"ContainerDied","Data":"341fad7f3c69a999850909b6409283cf6a720a46f8a31041e0b38c1b26a1813c"} Jul 07 00:02:41.003600 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.003517 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="341fad7f3c69a999850909b6409283cf6a720a46f8a31041e0b38c1b26a1813c" Jul 07 00:02:41.005421 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.005400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" event={"ID":"0b8ee3e6-6c7c-4212-bef9-0199bade38e4","Type":"ContainerDied","Data":"1c5df4b1aa39870e42fcb505168839c545b2dbe27e5f60a0f28227394edd5809"} Jul 07 00:02:41.005505 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.005434 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2" Jul 07 00:02:41.005559 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:41.005437 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c5df4b1aa39870e42fcb505168839c545b2dbe27e5f60a0f28227394edd5809" Jul 07 00:02:52.322442 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322402 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg"] Jul 07 00:02:52.322871 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322815 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b88e754-fd29-4037-b841-dee29955e6a3" containerName="util" Jul 07 00:02:52.322871 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322827 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b88e754-fd29-4037-b841-dee29955e6a3" containerName="util" Jul 07 00:02:52.322871 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322838 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerName="util" Jul 07 00:02:52.322871 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322847 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerName="util" Jul 07 00:02:52.322871 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322857 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerName="extract" Jul 07 00:02:52.322871 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322863 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerName="extract" Jul 07 00:02:52.322871 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322874 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b88e754-fd29-4037-b841-dee29955e6a3" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322879 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b88e754-fd29-4037-b841-dee29955e6a3" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322889 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerName="util" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322894 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerName="util" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322900 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322904 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322917 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322927 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322935 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322940 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322948 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322955 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322966 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b88e754-fd29-4037-b841-dee29955e6a3" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322971 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b88e754-fd29-4037-b841-dee29955e6a3" containerName="pull" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322976 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322981 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322986 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerName="util" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.322992 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerName="util" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.323060 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b8ee3e6-6c7c-4212-bef9-0199bade38e4" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.323068 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b88e754-fd29-4037-b841-dee29955e6a3" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.323077 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa46c87a-b4ec-42c1-9a0f-a201db26c1f3" containerName="extract" Jul 07 00:02:52.323149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.323087 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5a7d892-e8a9-48cb-945b-42dd7e112c2a" containerName="extract" Jul 07 00:02:52.325941 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.325925 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.329493 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.329470 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lxsr7\"" Jul 07 00:02:52.339944 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.339919 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg"] Jul 07 00:02:52.384260 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.384226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf45x\" (UniqueName: \"kubernetes.io/projected/8af23978-7f8c-4874-a0aa-2bdd68f1f245-kube-api-access-pf45x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.384418 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.384285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af23978-7f8c-4874-a0aa-2bdd68f1f245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.485493 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.485455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf45x\" (UniqueName: \"kubernetes.io/projected/8af23978-7f8c-4874-a0aa-2bdd68f1f245-kube-api-access-pf45x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.485697 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.485571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af23978-7f8c-4874-a0aa-2bdd68f1f245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.486034 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.486015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af23978-7f8c-4874-a0aa-2bdd68f1f245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.516212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.516170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf45x\" (UniqueName: \"kubernetes.io/projected/8af23978-7f8c-4874-a0aa-2bdd68f1f245-kube-api-access-pf45x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.635931 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.635905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:02:52.820639 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:52.820605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg"] Jul 07 00:02:52.822129 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:52.822094 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af23978_7f8c_4874_a0aa_2bdd68f1f245.slice/crio-689818a608327c9f2b976733efb45f95e560c8a55b83b2dc546cc3853d67fd4a WatchSource:0}: Error finding container 689818a608327c9f2b976733efb45f95e560c8a55b83b2dc546cc3853d67fd4a: Status 404 returned error can't find the container with id 689818a608327c9f2b976733efb45f95e560c8a55b83b2dc546cc3853d67fd4a Jul 07 00:02:53.083520 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:53.083428 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" event={"ID":"8af23978-7f8c-4874-a0aa-2bdd68f1f245","Type":"ContainerStarted","Data":"689818a608327c9f2b976733efb45f95e560c8a55b83b2dc546cc3853d67fd4a"} Jul 07 00:02:54.808367 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.808331 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-698645b9fd-n92nr"] Jul 07 00:02:54.816787 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.816761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:54.852102 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.852070 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698645b9fd-n92nr"] Jul 07 00:02:54.913449 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.913418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-config\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:54.913622 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.913459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-trusted-ca-bundle\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:54.913622 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.913490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-serving-cert\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:54.913622 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.913554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhz9\" (UniqueName: \"kubernetes.io/projected/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-kube-api-access-5jhz9\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:54.913622 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.913589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-oauth-config\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:54.913622 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.913619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-oauth-serving-cert\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:54.913819 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:54.913700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-service-ca\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.015075 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.015031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-oauth-serving-cert\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.015363 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.015086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-service-ca\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.015363 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.015136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-config\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.015363 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.015168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-trusted-ca-bundle\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.015363 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.015202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-serving-cert\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.015363 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.015257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhz9\" (UniqueName: \"kubernetes.io/projected/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-kube-api-access-5jhz9\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.015363 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.015287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-oauth-config\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.016185 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.016135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-service-ca\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.016345 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.016318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-oauth-serving-cert\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.016464 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.016370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-config\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.016464 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.016388 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-trusted-ca-bundle\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.018120 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.018097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-serving-cert\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.018120 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.018111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-console-oauth-config\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.035510 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.035484 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhz9\" (UniqueName: \"kubernetes.io/projected/f8ce9a63-b72c-41fb-b96b-49377b52fe4a-kube-api-access-5jhz9\") pod \"console-698645b9fd-n92nr\" (UID: \"f8ce9a63-b72c-41fb-b96b-49377b52fe4a\") " pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.071323 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.071240 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6"] Jul 07 00:02:55.076935 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.076912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" Jul 07 00:02:55.079594 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.079573 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jlzwk\"" Jul 07 00:02:55.091807 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.091780 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6"] Jul 07 00:02:55.115863 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.115832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddd7f\" (UniqueName: \"kubernetes.io/projected/d04f11e4-d00d-4ac2-8793-925baac22247-kube-api-access-ddd7f\") pod \"authorino-operator-75cc8d5cb7-hxfb6\" (UID: \"d04f11e4-d00d-4ac2-8793-925baac22247\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" Jul 07 00:02:55.126294 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.126259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:02:55.217962 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.217925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddd7f\" (UniqueName: \"kubernetes.io/projected/d04f11e4-d00d-4ac2-8793-925baac22247-kube-api-access-ddd7f\") pod \"authorino-operator-75cc8d5cb7-hxfb6\" (UID: \"d04f11e4-d00d-4ac2-8793-925baac22247\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" Jul 07 00:02:55.229727 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.229702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddd7f\" (UniqueName: \"kubernetes.io/projected/d04f11e4-d00d-4ac2-8793-925baac22247-kube-api-access-ddd7f\") pod \"authorino-operator-75cc8d5cb7-hxfb6\" (UID: \"d04f11e4-d00d-4ac2-8793-925baac22247\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" Jul 07 00:02:55.294794 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.294765 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698645b9fd-n92nr"] Jul 07 00:02:55.296534 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:55.296512 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ce9a63_b72c_41fb_b96b_49377b52fe4a.slice/crio-78117566c4d27b24aaf5285d315739696407a8158e647f664a076eae0991fb26 WatchSource:0}: Error finding container 78117566c4d27b24aaf5285d315739696407a8158e647f664a076eae0991fb26: Status 404 returned error can't find the container with id 78117566c4d27b24aaf5285d315739696407a8158e647f664a076eae0991fb26 Jul 07 00:02:55.387267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.387233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" Jul 07 00:02:55.585640 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:55.585608 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6"] Jul 07 00:02:55.588031 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:55.588003 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04f11e4_d00d_4ac2_8793_925baac22247.slice/crio-2dc34fe915157154e9fa01028b6492a51d7f85da00d1ff80ca7e8d807160e746 WatchSource:0}: Error finding container 2dc34fe915157154e9fa01028b6492a51d7f85da00d1ff80ca7e8d807160e746: Status 404 returned error can't find the container with id 2dc34fe915157154e9fa01028b6492a51d7f85da00d1ff80ca7e8d807160e746 Jul 07 00:02:56.104311 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:56.104269 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698645b9fd-n92nr" event={"ID":"f8ce9a63-b72c-41fb-b96b-49377b52fe4a","Type":"ContainerStarted","Data":"9213ee7dc9d7ab1d43a21a48742025742af6d2818e1f02208938c2aa54ae57ee"} Jul 07 00:02:56.104838 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:56.104331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698645b9fd-n92nr" event={"ID":"f8ce9a63-b72c-41fb-b96b-49377b52fe4a","Type":"ContainerStarted","Data":"78117566c4d27b24aaf5285d315739696407a8158e647f664a076eae0991fb26"} Jul 07 00:02:56.105521 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:56.105497 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" event={"ID":"d04f11e4-d00d-4ac2-8793-925baac22247","Type":"ContainerStarted","Data":"2dc34fe915157154e9fa01028b6492a51d7f85da00d1ff80ca7e8d807160e746"} Jul 07 00:02:56.137360 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:56.137298 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-698645b9fd-n92nr" podStartSLOduration=2.137279679 podStartE2EDuration="2.137279679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:56.134095837 +0000 UTC m=+414.995267580" watchObservedRunningTime="2026-07-07 00:02:56.137279679 +0000 UTC m=+414.998451420" Jul 07 00:02:57.234634 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.234588 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg"] Jul 07 00:02:57.239087 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.239060 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" Jul 07 00:02:57.243193 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.243165 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 00:02:57.243340 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.243198 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m2q5h\"" Jul 07 00:02:57.255863 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.255833 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg"] Jul 07 00:02:57.339753 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.339707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5kqk\" (UniqueName: \"kubernetes.io/projected/f7b042b2-fd02-46cc-8258-823cf7004a80-kube-api-access-f5kqk\") pod \"dns-operator-controller-manager-864dd78c4c-7h5bg\" (UID: \"f7b042b2-fd02-46cc-8258-823cf7004a80\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" Jul 07 00:02:57.440918 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.440870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5kqk\" (UniqueName: \"kubernetes.io/projected/f7b042b2-fd02-46cc-8258-823cf7004a80-kube-api-access-f5kqk\") pod \"dns-operator-controller-manager-864dd78c4c-7h5bg\" (UID: \"f7b042b2-fd02-46cc-8258-823cf7004a80\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" Jul 07 00:02:57.457568 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.457537 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5kqk\" (UniqueName: \"kubernetes.io/projected/f7b042b2-fd02-46cc-8258-823cf7004a80-kube-api-access-f5kqk\") pod \"dns-operator-controller-manager-864dd78c4c-7h5bg\" (UID: \"f7b042b2-fd02-46cc-8258-823cf7004a80\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" Jul 07 00:02:57.551328 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:57.551241 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" Jul 07 00:02:59.343983 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:59.343951 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b042b2_fd02_46cc_8258_823cf7004a80.slice/crio-2a50409b6ffaee40c56fa47dd8d2066aeb400506db794b455563e8f1b17a3b8c WatchSource:0}: Error finding container 2a50409b6ffaee40c56fa47dd8d2066aeb400506db794b455563e8f1b17a3b8c: Status 404 returned error can't find the container with id 2a50409b6ffaee40c56fa47dd8d2066aeb400506db794b455563e8f1b17a3b8c Jul 07 00:02:59.344836 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.344813 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg"] Jul 07 00:02:59.471926 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.471843 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt"] Jul 07 00:02:59.475737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.475718 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:02:59.478605 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.478583 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fcbsw\"" Jul 07 00:02:59.491195 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.491165 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt"] Jul 07 00:02:59.562685 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.562635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r4d8\" (UniqueName: \"kubernetes.io/projected/d1e11846-f94f-4e76-86a3-afde9a690988-kube-api-access-6r4d8\") pod \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" (UID: \"d1e11846-f94f-4e76-86a3-afde9a690988\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:02:59.663644 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.663607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r4d8\" (UniqueName: \"kubernetes.io/projected/d1e11846-f94f-4e76-86a3-afde9a690988-kube-api-access-6r4d8\") pod \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" (UID: \"d1e11846-f94f-4e76-86a3-afde9a690988\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:02:59.673316 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.673290 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r4d8\" (UniqueName: \"kubernetes.io/projected/d1e11846-f94f-4e76-86a3-afde9a690988-kube-api-access-6r4d8\") pod \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" (UID: \"d1e11846-f94f-4e76-86a3-afde9a690988\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:02:59.786250 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.786148 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:02:59.955136 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:02:59.955112 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt"] Jul 07 00:02:59.956702 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:02:59.956673 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e11846_f94f_4e76_86a3_afde9a690988.slice/crio-2d13f4e6dc3bc5e1df9e27439f1121740a1fb4f1f0a46f55a4dedaec025f3e69 WatchSource:0}: Error finding container 2d13f4e6dc3bc5e1df9e27439f1121740a1fb4f1f0a46f55a4dedaec025f3e69: Status 404 returned error can't find the container with id 2d13f4e6dc3bc5e1df9e27439f1121740a1fb4f1f0a46f55a4dedaec025f3e69 Jul 07 00:03:00.132601 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.132567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" event={"ID":"d1e11846-f94f-4e76-86a3-afde9a690988","Type":"ContainerStarted","Data":"2d13f4e6dc3bc5e1df9e27439f1121740a1fb4f1f0a46f55a4dedaec025f3e69"} Jul 07 00:03:00.134288 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.134264 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" event={"ID":"8af23978-7f8c-4874-a0aa-2bdd68f1f245","Type":"ContainerStarted","Data":"87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a"} Jul 07 00:03:00.134426 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.134389 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:00.135556 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.135533 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" event={"ID":"f7b042b2-fd02-46cc-8258-823cf7004a80","Type":"ContainerStarted","Data":"2a50409b6ffaee40c56fa47dd8d2066aeb400506db794b455563e8f1b17a3b8c"} Jul 07 00:03:00.137027 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.137008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" event={"ID":"d04f11e4-d00d-4ac2-8793-925baac22247","Type":"ContainerStarted","Data":"8ca99fccc53541f905e5f5ae0341b54febd2881a1f391fcd172424c7f0cca1e3"} Jul 07 00:03:00.137139 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.137128 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" Jul 07 00:03:00.160440 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.160398 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" podStartSLOduration=1.81160832 podStartE2EDuration="8.160384344s" totalImagesPullingTime="6.348776024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:00.157611572 +0000 UTC m=+419.018783314" watchObservedRunningTime="2026-07-07 00:03:00.160384344 +0000 UTC m=+419.021556084" Jul 07 00:03:00.182412 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:00.182360 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" podStartSLOduration=1.6137987169999999 podStartE2EDuration="5.182344003s" totalImagesPullingTime="3.568545286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:00.181913037 +0000 UTC m=+419.043084777" watchObservedRunningTime="2026-07-07 00:03:00.182344003 +0000 UTC m=+419.043515744" Jul 07 00:03:02.754706 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:02.754680 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 00:03:03.162963 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:03.162924 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" event={"ID":"f7b042b2-fd02-46cc-8258-823cf7004a80","Type":"ContainerStarted","Data":"b91f2b4966c53f2f14d39c6fae9ed1a3595c993d5383eb4be15552607d13c906"} Jul 07 00:03:03.163144 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:03.163114 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" Jul 07 00:03:03.164721 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:03.164681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" event={"ID":"d1e11846-f94f-4e76-86a3-afde9a690988","Type":"ContainerStarted","Data":"187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7"} Jul 07 00:03:03.164867 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:03.164745 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:03.197222 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:03.197169 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" podStartSLOduration=2.791810151 podStartE2EDuration="6.197151423s" totalImagesPullingTime="3.405341272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:03.195838337 +0000 UTC m=+422.057010079" watchObservedRunningTime="2026-07-07 00:03:03.197151423 +0000 UTC m=+422.058323164" Jul 07 00:03:03.222066 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:03.222015 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" podStartSLOduration=1.426626024 podStartE2EDuration="4.221999253s" totalImagesPullingTime="2.795373229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:03.220392467 +0000 UTC m=+422.081564208" watchObservedRunningTime="2026-07-07 00:03:03.221999253 +0000 UTC m=+422.083170993" Jul 07 00:03:05.126797 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:05.126756 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:03:05.127282 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:05.126820 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:03:05.132340 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:05.132313 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:03:05.180389 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:05.180362 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-698645b9fd-n92nr" Jul 07 00:03:05.241313 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:05.241274 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d8f958b8-s9kfb"] Jul 07 00:03:11.147167 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:11.147131 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hxfb6" Jul 07 00:03:11.147687 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:11.147217 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:13.311532 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.311494 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg"] Jul 07 00:03:13.312115 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.311745 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" containerName="manager" containerID="cri-o://87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a" gracePeriod=2 Jul 07 00:03:13.324937 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.324905 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg"] Jul 07 00:03:13.350763 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.350731 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt"] Jul 07 00:03:13.350966 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.350940 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" containerName="manager" containerID="cri-o://187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7" gracePeriod=2 Jul 07 00:03:13.352867 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.352844 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:13.353525 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.353445 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:13.355392 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.355364 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k"] Jul 07 00:03:13.356019 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.355996 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" containerName="manager" Jul 07 00:03:13.356109 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.356021 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" containerName="manager" Jul 07 00:03:13.356175 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.356168 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" containerName="manager" Jul 07 00:03:13.359718 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.359696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.368608 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.368580 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt"] Jul 07 00:03:13.383228 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.383188 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d1e11846-f94f-4e76-86a3-afde9a690988\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-mwqlt\": pods \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:13.385923 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.385890 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:13.389519 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.389482 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:13.406348 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.406306 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k"] Jul 07 00:03:13.419799 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.419768 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l"] Jul 07 00:03:13.420190 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.420176 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" containerName="manager" Jul 07 00:03:13.420190 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.420191 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" containerName="manager" Jul 07 00:03:13.420276 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.420257 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" containerName="manager" Jul 07 00:03:13.423606 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.423585 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" Jul 07 00:03:13.445216 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.445191 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l"] Jul 07 00:03:13.483446 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.483397 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:13.487572 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.487531 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:13.499953 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.499919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crz6k\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.500110 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.499970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jln\" (UniqueName: \"kubernetes.io/projected/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-kube-api-access-q9jln\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crz6k\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.601393 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.601362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvhpg\" (UniqueName: \"kubernetes.io/projected/319f909d-7790-4539-ac68-b35ca813005f-kube-api-access-bvhpg\") pod \"limitador-operator-controller-manager-859d7b78bd-b279l\" (UID: \"319f909d-7790-4539-ac68-b35ca813005f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" Jul 07 00:03:13.601486 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.601455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crz6k\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.601548 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.601525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jln\" (UniqueName: \"kubernetes.io/projected/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-kube-api-access-q9jln\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crz6k\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.601908 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.601886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crz6k\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.615705 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.615676 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:13.618505 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.618476 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:13.618703 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.618691 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:13.620959 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.620933 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:13.623712 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.623688 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tb8hg\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:13.625779 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:13.625753 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mwqlt\" is forbidden: User \"system:node:ip-10-0-131-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-246.ec2.internal' and this object" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:13.626592 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.626575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jln\" (UniqueName: \"kubernetes.io/projected/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-kube-api-access-q9jln\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crz6k\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.703081 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.703044 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af23978-7f8c-4874-a0aa-2bdd68f1f245-extensions-socket-volume\") pod \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " Jul 07 00:03:13.703277 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.703107 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf45x\" (UniqueName: \"kubernetes.io/projected/8af23978-7f8c-4874-a0aa-2bdd68f1f245-kube-api-access-pf45x\") pod \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\" (UID: \"8af23978-7f8c-4874-a0aa-2bdd68f1f245\") " Jul 07 00:03:13.703277 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.703158 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r4d8\" (UniqueName: \"kubernetes.io/projected/d1e11846-f94f-4e76-86a3-afde9a690988-kube-api-access-6r4d8\") pod \"d1e11846-f94f-4e76-86a3-afde9a690988\" (UID: \"d1e11846-f94f-4e76-86a3-afde9a690988\") " Jul 07 00:03:13.703393 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.703301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvhpg\" (UniqueName: \"kubernetes.io/projected/319f909d-7790-4539-ac68-b35ca813005f-kube-api-access-bvhpg\") pod \"limitador-operator-controller-manager-859d7b78bd-b279l\" (UID: \"319f909d-7790-4539-ac68-b35ca813005f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" Jul 07 00:03:13.703507 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.703482 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af23978-7f8c-4874-a0aa-2bdd68f1f245-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8af23978-7f8c-4874-a0aa-2bdd68f1f245" (UID: "8af23978-7f8c-4874-a0aa-2bdd68f1f245"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:03:13.705422 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.705391 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e11846-f94f-4e76-86a3-afde9a690988-kube-api-access-6r4d8" (OuterVolumeSpecName: "kube-api-access-6r4d8") pod "d1e11846-f94f-4e76-86a3-afde9a690988" (UID: "d1e11846-f94f-4e76-86a3-afde9a690988"). InnerVolumeSpecName "kube-api-access-6r4d8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:03:13.705534 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.705436 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af23978-7f8c-4874-a0aa-2bdd68f1f245-kube-api-access-pf45x" (OuterVolumeSpecName: "kube-api-access-pf45x") pod "8af23978-7f8c-4874-a0aa-2bdd68f1f245" (UID: "8af23978-7f8c-4874-a0aa-2bdd68f1f245"). InnerVolumeSpecName "kube-api-access-pf45x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:03:13.715613 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.715585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvhpg\" (UniqueName: \"kubernetes.io/projected/319f909d-7790-4539-ac68-b35ca813005f-kube-api-access-bvhpg\") pod \"limitador-operator-controller-manager-859d7b78bd-b279l\" (UID: \"319f909d-7790-4539-ac68-b35ca813005f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" Jul 07 00:03:13.750055 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.750013 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:13.755255 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.755228 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" Jul 07 00:03:13.804483 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.804405 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af23978-7f8c-4874-a0aa-2bdd68f1f245-extensions-socket-volume\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:13.804483 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.804440 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf45x\" (UniqueName: \"kubernetes.io/projected/8af23978-7f8c-4874-a0aa-2bdd68f1f245-kube-api-access-pf45x\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:13.804483 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.804456 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r4d8\" (UniqueName: \"kubernetes.io/projected/d1e11846-f94f-4e76-86a3-afde9a690988-kube-api-access-6r4d8\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:13.913914 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:03:13.913882 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc502c7_43a0_431c_bbb4_f16c8d6a3fbd.slice/crio-3f507bafc11658d36971ea88d4cb9e06c0e45ec3e89929f613834bf5f90f64b4 WatchSource:0}: Error finding container 3f507bafc11658d36971ea88d4cb9e06c0e45ec3e89929f613834bf5f90f64b4: Status 404 returned error can't find the container with id 3f507bafc11658d36971ea88d4cb9e06c0e45ec3e89929f613834bf5f90f64b4 Jul 07 00:03:13.914042 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.913994 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k"] Jul 07 00:03:13.943537 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:13.943511 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l"] Jul 07 00:03:13.948863 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:03:13.948837 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319f909d_7790_4539_ac68_b35ca813005f.slice/crio-07ea7ed1967111acdc386e9af6723b7d94118bd7d32a808171bef23a35245052 WatchSource:0}: Error finding container 07ea7ed1967111acdc386e9af6723b7d94118bd7d32a808171bef23a35245052: Status 404 returned error can't find the container with id 07ea7ed1967111acdc386e9af6723b7d94118bd7d32a808171bef23a35245052 Jul 07 00:03:14.172844 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.172807 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7h5bg" Jul 07 00:03:14.232135 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.232094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" event={"ID":"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd","Type":"ContainerStarted","Data":"2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb"} Jul 07 00:03:14.232319 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.232162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" event={"ID":"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd","Type":"ContainerStarted","Data":"3f507bafc11658d36971ea88d4cb9e06c0e45ec3e89929f613834bf5f90f64b4"} Jul 07 00:03:14.232319 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.232190 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:14.233580 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.233557 2559 generic.go:356] "Generic (PLEG): container finished" podID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" containerID="87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a" exitCode=0 Jul 07 00:03:14.233713 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.233606 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tb8hg" Jul 07 00:03:14.234683 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.233679 2559 scope.go:117] "RemoveContainer" containerID="87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a" Jul 07 00:03:14.235532 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.235506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" event={"ID":"319f909d-7790-4539-ac68-b35ca813005f","Type":"ContainerStarted","Data":"60e8ca503b771a93cdd6c6a26a5f83d674d71529533912fc7fc6b1d300d30b57"} Jul 07 00:03:14.235670 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.235559 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" event={"ID":"319f909d-7790-4539-ac68-b35ca813005f","Type":"ContainerStarted","Data":"07ea7ed1967111acdc386e9af6723b7d94118bd7d32a808171bef23a35245052"} Jul 07 00:03:14.235670 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.235587 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" Jul 07 00:03:14.237195 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.237172 2559 generic.go:356] "Generic (PLEG): container finished" podID="d1e11846-f94f-4e76-86a3-afde9a690988" containerID="187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7" exitCode=0 Jul 07 00:03:14.237291 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.237215 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mwqlt" Jul 07 00:03:14.245793 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.245773 2559 scope.go:117] "RemoveContainer" containerID="87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a" Jul 07 00:03:14.246123 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:14.246071 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a\": container with ID starting with 87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a not found: ID does not exist" containerID="87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a" Jul 07 00:03:14.246206 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.246110 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a"} err="failed to get container status \"87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a\": rpc error: code = NotFound desc = could not find container \"87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a\": container with ID starting with 87c50f5b284ae799de8f46d56bb8a38537cf54ec5d04742d29ac49c25a737b8a not found: ID does not exist" Jul 07 00:03:14.246206 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.246136 2559 scope.go:117] "RemoveContainer" containerID="187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7" Jul 07 00:03:14.255439 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.255417 2559 scope.go:117] "RemoveContainer" containerID="187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7" Jul 07 00:03:14.255834 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:14.255802 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7\": container with ID starting with 187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7 not found: ID does not exist" containerID="187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7" Jul 07 00:03:14.255949 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.255842 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7"} err="failed to get container status \"187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7\": rpc error: code = NotFound desc = could not find container \"187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7\": container with ID starting with 187810f704376147789c33da0fed61f1087402c0b0c5bcc82037a4b0aa8239c7 not found: ID does not exist" Jul 07 00:03:14.293495 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.293441 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" podStartSLOduration=1.293420223 podStartE2EDuration="1.293420223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:14.289902763 +0000 UTC m=+433.151074535" watchObservedRunningTime="2026-07-07 00:03:14.293420223 +0000 UTC m=+433.154591969" Jul 07 00:03:14.325145 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:14.325086 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" podStartSLOduration=1.325068567 podStartE2EDuration="1.325068567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:14.322373104 +0000 UTC m=+433.183544836" watchObservedRunningTime="2026-07-07 00:03:14.325068567 +0000 UTC m=+433.186240375" Jul 07 00:03:15.445766 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.445730 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf"] Jul 07 00:03:15.450698 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.450675 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.476834 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.476800 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf"] Jul 07 00:03:15.623904 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.623867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h52g\" (UniqueName: \"kubernetes.io/projected/aac9c728-7bdd-4fff-ae52-8454beeb2887-kube-api-access-7h52g\") pod \"kuadrant-operator-controller-manager-86878c769f-zr5xf\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.623904 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.623909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac9c728-7bdd-4fff-ae52-8454beeb2887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zr5xf\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.666037 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.666003 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8af23978-7f8c-4874-a0aa-2bdd68f1f245" path="/var/lib/kubelet/pods/8af23978-7f8c-4874-a0aa-2bdd68f1f245/volumes" Jul 07 00:03:15.666333 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.666321 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e11846-f94f-4e76-86a3-afde9a690988" path="/var/lib/kubelet/pods/d1e11846-f94f-4e76-86a3-afde9a690988/volumes" Jul 07 00:03:15.725156 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.725065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h52g\" (UniqueName: \"kubernetes.io/projected/aac9c728-7bdd-4fff-ae52-8454beeb2887-kube-api-access-7h52g\") pod \"kuadrant-operator-controller-manager-86878c769f-zr5xf\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.725156 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.725107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac9c728-7bdd-4fff-ae52-8454beeb2887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zr5xf\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.725446 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.725429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac9c728-7bdd-4fff-ae52-8454beeb2887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zr5xf\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.737658 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.737620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h52g\" (UniqueName: \"kubernetes.io/projected/aac9c728-7bdd-4fff-ae52-8454beeb2887-kube-api-access-7h52g\") pod \"kuadrant-operator-controller-manager-86878c769f-zr5xf\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.761237 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.761198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:15.931694 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:15.931660 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf"] Jul 07 00:03:15.932838 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:03:15.932806 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac9c728_7bdd_4fff_ae52_8454beeb2887.slice/crio-f5ef7db3b943d137419616cc532d73a05f5b2dccc0658f6ce138e1d4eaec40c2 WatchSource:0}: Error finding container f5ef7db3b943d137419616cc532d73a05f5b2dccc0658f6ce138e1d4eaec40c2: Status 404 returned error can't find the container with id f5ef7db3b943d137419616cc532d73a05f5b2dccc0658f6ce138e1d4eaec40c2 Jul 07 00:03:16.254153 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:16.254051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" event={"ID":"aac9c728-7bdd-4fff-ae52-8454beeb2887","Type":"ContainerStarted","Data":"eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16"} Jul 07 00:03:16.254153 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:16.254105 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" event={"ID":"aac9c728-7bdd-4fff-ae52-8454beeb2887","Type":"ContainerStarted","Data":"f5ef7db3b943d137419616cc532d73a05f5b2dccc0658f6ce138e1d4eaec40c2"} Jul 07 00:03:16.254153 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:16.254136 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:16.304903 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:16.304852 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" podStartSLOduration=1.3048362949999999 podStartE2EDuration="1.304836295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:16.301972636 +0000 UTC m=+435.163144379" watchObservedRunningTime="2026-07-07 00:03:16.304836295 +0000 UTC m=+435.166008036" Jul 07 00:03:25.247766 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:25.247666 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:25.247766 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:25.247752 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b279l" Jul 07 00:03:27.261947 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.261911 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:03:27.350778 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.350742 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k"] Jul 07 00:03:27.350991 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.350958 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" podUID="4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" containerName="manager" containerID="cri-o://2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb" gracePeriod=10 Jul 07 00:03:27.611703 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.611681 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:27.633081 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.633057 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-extensions-socket-volume\") pod \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " Jul 07 00:03:27.633270 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.633115 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9jln\" (UniqueName: \"kubernetes.io/projected/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-kube-api-access-q9jln\") pod \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\" (UID: \"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd\") " Jul 07 00:03:27.633512 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.633488 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" (UID: "4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:03:27.635425 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.635405 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-kube-api-access-q9jln" (OuterVolumeSpecName: "kube-api-access-q9jln") pod "4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" (UID: "4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd"). InnerVolumeSpecName "kube-api-access-q9jln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:03:27.733829 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.733795 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-extensions-socket-volume\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:27.733829 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:27.733822 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9jln\" (UniqueName: \"kubernetes.io/projected/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd-kube-api-access-q9jln\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:28.328474 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.328433 2559 generic.go:356] "Generic (PLEG): container finished" podID="4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" containerID="2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb" exitCode=0 Jul 07 00:03:28.328992 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.328483 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" Jul 07 00:03:28.328992 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.328522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" event={"ID":"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd","Type":"ContainerDied","Data":"2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb"} Jul 07 00:03:28.328992 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.328593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k" event={"ID":"4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd","Type":"ContainerDied","Data":"3f507bafc11658d36971ea88d4cb9e06c0e45ec3e89929f613834bf5f90f64b4"} Jul 07 00:03:28.328992 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.328628 2559 scope.go:117] "RemoveContainer" containerID="2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb" Jul 07 00:03:28.338585 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.338565 2559 scope.go:117] "RemoveContainer" containerID="2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb" Jul 07 00:03:28.338883 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:28.338863 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb\": container with ID starting with 2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb not found: ID does not exist" containerID="2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb" Jul 07 00:03:28.338956 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.338897 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb"} err="failed to get container status \"2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb\": rpc error: code = NotFound desc = could not find container \"2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb\": container with ID starting with 2fb876c68be3acecc9a0488efeeffaf6dfb6e4bece69eecd9603ac3a7ff51ebb not found: ID does not exist" Jul 07 00:03:28.388202 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.388171 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k"] Jul 07 00:03:28.395285 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:28.395255 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crz6k"] Jul 07 00:03:29.666514 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:29.666480 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" path="/var/lib/kubelet/pods/4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd/volumes" Jul 07 00:03:30.264362 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.264324 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74d8f958b8-s9kfb" podUID="7d24a949-4fb8-4482-8987-888c7688cbbb" containerName="console" containerID="cri-o://93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd" gracePeriod=15 Jul 07 00:03:30.559226 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.559199 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 07 00:03:30.654182 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654144 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-oauth-serving-cert\") pod \"7d24a949-4fb8-4482-8987-888c7688cbbb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " Jul 07 00:03:30.654182 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654184 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-console-config\") pod \"7d24a949-4fb8-4482-8987-888c7688cbbb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " Jul 07 00:03:30.654391 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654203 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-trusted-ca-bundle\") pod \"7d24a949-4fb8-4482-8987-888c7688cbbb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " Jul 07 00:03:30.654391 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654226 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-oauth-config\") pod \"7d24a949-4fb8-4482-8987-888c7688cbbb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " Jul 07 00:03:30.654391 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654255 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vfk9\" (UniqueName: \"kubernetes.io/projected/7d24a949-4fb8-4482-8987-888c7688cbbb-kube-api-access-4vfk9\") pod \"7d24a949-4fb8-4482-8987-888c7688cbbb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " Jul 07 00:03:30.654391 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654353 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-service-ca\") pod \"7d24a949-4fb8-4482-8987-888c7688cbbb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " Jul 07 00:03:30.654576 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654397 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-serving-cert\") pod \"7d24a949-4fb8-4482-8987-888c7688cbbb\" (UID: \"7d24a949-4fb8-4482-8987-888c7688cbbb\") " Jul 07 00:03:30.654684 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654636 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-console-config" (OuterVolumeSpecName: "console-config") pod "7d24a949-4fb8-4482-8987-888c7688cbbb" (UID: "7d24a949-4fb8-4482-8987-888c7688cbbb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:03:30.654789 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654756 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d24a949-4fb8-4482-8987-888c7688cbbb" (UID: "7d24a949-4fb8-4482-8987-888c7688cbbb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:03:30.654851 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654799 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d24a949-4fb8-4482-8987-888c7688cbbb" (UID: "7d24a949-4fb8-4482-8987-888c7688cbbb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:03:30.654908 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.654858 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d24a949-4fb8-4482-8987-888c7688cbbb" (UID: "7d24a949-4fb8-4482-8987-888c7688cbbb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:03:30.656763 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.656727 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d24a949-4fb8-4482-8987-888c7688cbbb-kube-api-access-4vfk9" (OuterVolumeSpecName: "kube-api-access-4vfk9") pod "7d24a949-4fb8-4482-8987-888c7688cbbb" (UID: "7d24a949-4fb8-4482-8987-888c7688cbbb"). InnerVolumeSpecName "kube-api-access-4vfk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:03:30.656763 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.656733 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d24a949-4fb8-4482-8987-888c7688cbbb" (UID: "7d24a949-4fb8-4482-8987-888c7688cbbb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:03:30.656969 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.656946 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d24a949-4fb8-4482-8987-888c7688cbbb" (UID: "7d24a949-4fb8-4482-8987-888c7688cbbb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:03:30.755916 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.755869 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-service-ca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:30.755916 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.755908 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:30.755916 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.755923 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-oauth-serving-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:30.756481 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.755938 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-console-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:30.756481 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.755952 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d24a949-4fb8-4482-8987-888c7688cbbb-trusted-ca-bundle\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:30.756481 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.755966 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d24a949-4fb8-4482-8987-888c7688cbbb-console-oauth-config\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:30.756481 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:30.755979 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vfk9\" (UniqueName: \"kubernetes.io/projected/7d24a949-4fb8-4482-8987-888c7688cbbb-kube-api-access-4vfk9\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:03:31.350154 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.350117 2559 generic.go:356] "Generic (PLEG): container finished" podID="7d24a949-4fb8-4482-8987-888c7688cbbb" containerID="93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd" exitCode=0 Jul 07 00:03:31.350353 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.350179 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f958b8-s9kfb" Jul 07 00:03:31.350353 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.350205 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f958b8-s9kfb" event={"ID":"7d24a949-4fb8-4482-8987-888c7688cbbb","Type":"ContainerDied","Data":"93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd"} Jul 07 00:03:31.350353 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.350262 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f958b8-s9kfb" event={"ID":"7d24a949-4fb8-4482-8987-888c7688cbbb","Type":"ContainerDied","Data":"f0f2df00ff8ddec5ec5bcd6a4682d12f52fd14c5bb2186b96e7db2660513b935"} Jul 07 00:03:31.350353 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.350282 2559 scope.go:117] "RemoveContainer" containerID="93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd" Jul 07 00:03:31.361267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.361250 2559 scope.go:117] "RemoveContainer" containerID="93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd" Jul 07 00:03:31.361584 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:03:31.361561 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd\": container with ID starting with 93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd not found: ID does not exist" containerID="93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd" Jul 07 00:03:31.361630 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.361595 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd"} err="failed to get container status \"93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd\": rpc error: code = NotFound desc = could not find container \"93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd\": container with ID starting with 93ca3309322adc1fb492b8d7830cbce78df28be2e57b85a6ad8211ed021cccbd not found: ID does not exist" Jul 07 00:03:31.380027 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.379996 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d8f958b8-s9kfb"] Jul 07 00:03:31.383664 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.383621 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d8f958b8-s9kfb"] Jul 07 00:03:31.667030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:31.667002 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d24a949-4fb8-4482-8987-888c7688cbbb" path="/var/lib/kubelet/pods/7d24a949-4fb8-4482-8987-888c7688cbbb/volumes" Jul 07 00:03:48.691500 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.691462 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:03:48.692122 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.692109 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" containerName="manager" Jul 07 00:03:48.692200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.692129 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" containerName="manager" Jul 07 00:03:48.692200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.692169 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d24a949-4fb8-4482-8987-888c7688cbbb" containerName="console" Jul 07 00:03:48.692200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.692180 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d24a949-4fb8-4482-8987-888c7688cbbb" containerName="console" Jul 07 00:03:48.692354 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.692290 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bc502c7-43a0-431c-bbb4-f16c8d6a3fbd" containerName="manager" Jul 07 00:03:48.692354 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.692304 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d24a949-4fb8-4482-8987-888c7688cbbb" containerName="console" Jul 07 00:03:48.696560 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.696537 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:48.699456 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.699435 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cjtgc\"" Jul 07 00:03:48.699591 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.699435 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 00:03:48.703420 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.703391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:03:48.726374 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.726341 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:03:48.821473 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.821432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4g6r\" (UniqueName: \"kubernetes.io/projected/9d3cb82a-7f93-41ae-86ec-56b49a1364d4-kube-api-access-v4g6r\") pod \"limitador-limitador-54d6d988d5-jkph7\" (UID: \"9d3cb82a-7f93-41ae-86ec-56b49a1364d4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:48.821634 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.821513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d3cb82a-7f93-41ae-86ec-56b49a1364d4-config-file\") pod \"limitador-limitador-54d6d988d5-jkph7\" (UID: \"9d3cb82a-7f93-41ae-86ec-56b49a1364d4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:48.922975 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.922936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4g6r\" (UniqueName: \"kubernetes.io/projected/9d3cb82a-7f93-41ae-86ec-56b49a1364d4-kube-api-access-v4g6r\") pod \"limitador-limitador-54d6d988d5-jkph7\" (UID: \"9d3cb82a-7f93-41ae-86ec-56b49a1364d4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:48.923154 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.923028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d3cb82a-7f93-41ae-86ec-56b49a1364d4-config-file\") pod \"limitador-limitador-54d6d988d5-jkph7\" (UID: \"9d3cb82a-7f93-41ae-86ec-56b49a1364d4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:48.923801 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.923783 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9d3cb82a-7f93-41ae-86ec-56b49a1364d4-config-file\") pod \"limitador-limitador-54d6d988d5-jkph7\" (UID: \"9d3cb82a-7f93-41ae-86ec-56b49a1364d4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:48.936324 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:48.936290 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4g6r\" (UniqueName: \"kubernetes.io/projected/9d3cb82a-7f93-41ae-86ec-56b49a1364d4-kube-api-access-v4g6r\") pod \"limitador-limitador-54d6d988d5-jkph7\" (UID: \"9d3cb82a-7f93-41ae-86ec-56b49a1364d4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:49.009180 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.009080 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:49.161272 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:03:49.161244 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3cb82a_7f93_41ae_86ec_56b49a1364d4.slice/crio-22fc9ad0394a75962f7e92e62d1a9ae3275a92af937deb7ea583835ecf7e3c98 WatchSource:0}: Error finding container 22fc9ad0394a75962f7e92e62d1a9ae3275a92af937deb7ea583835ecf7e3c98: Status 404 returned error can't find the container with id 22fc9ad0394a75962f7e92e62d1a9ae3275a92af937deb7ea583835ecf7e3c98 Jul 07 00:03:49.165634 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.165608 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:03:49.365888 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.365808 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zxwkp"] Jul 07 00:03:49.369212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.369195 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zxwkp" Jul 07 00:03:49.372219 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.372193 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f6mp6\"" Jul 07 00:03:49.378885 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.378858 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zxwkp"] Jul 07 00:03:49.427025 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.426990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr5dg\" (UniqueName: \"kubernetes.io/projected/f51e9800-4ad4-441d-890e-bf7730362697-kube-api-access-lr5dg\") pod \"authorino-75d556bd77-zxwkp\" (UID: \"f51e9800-4ad4-441d-890e-bf7730362697\") " pod="kuadrant-system/authorino-75d556bd77-zxwkp" Jul 07 00:03:49.474556 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.474527 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" event={"ID":"9d3cb82a-7f93-41ae-86ec-56b49a1364d4","Type":"ContainerStarted","Data":"22fc9ad0394a75962f7e92e62d1a9ae3275a92af937deb7ea583835ecf7e3c98"} Jul 07 00:03:49.528456 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.528421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr5dg\" (UniqueName: \"kubernetes.io/projected/f51e9800-4ad4-441d-890e-bf7730362697-kube-api-access-lr5dg\") pod \"authorino-75d556bd77-zxwkp\" (UID: \"f51e9800-4ad4-441d-890e-bf7730362697\") " pod="kuadrant-system/authorino-75d556bd77-zxwkp" Jul 07 00:03:49.537777 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.537748 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr5dg\" (UniqueName: \"kubernetes.io/projected/f51e9800-4ad4-441d-890e-bf7730362697-kube-api-access-lr5dg\") pod \"authorino-75d556bd77-zxwkp\" (UID: \"f51e9800-4ad4-441d-890e-bf7730362697\") " pod="kuadrant-system/authorino-75d556bd77-zxwkp" Jul 07 00:03:49.679259 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.679229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zxwkp" Jul 07 00:03:49.822778 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:49.822745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zxwkp"] Jul 07 00:03:49.823806 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:03:49.823777 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf51e9800_4ad4_441d_890e_bf7730362697.slice/crio-c92d28bc3797419ced39ed7da5d0f5a81de6ff919bb36a5d6a7764aa69b004ae WatchSource:0}: Error finding container c92d28bc3797419ced39ed7da5d0f5a81de6ff919bb36a5d6a7764aa69b004ae: Status 404 returned error can't find the container with id c92d28bc3797419ced39ed7da5d0f5a81de6ff919bb36a5d6a7764aa69b004ae Jul 07 00:03:50.491228 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:50.491188 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zxwkp" event={"ID":"f51e9800-4ad4-441d-890e-bf7730362697","Type":"ContainerStarted","Data":"c92d28bc3797419ced39ed7da5d0f5a81de6ff919bb36a5d6a7764aa69b004ae"} Jul 07 00:03:54.524748 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:54.524705 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zxwkp" event={"ID":"f51e9800-4ad4-441d-890e-bf7730362697","Type":"ContainerStarted","Data":"5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2"} Jul 07 00:03:54.526303 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:54.526280 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" event={"ID":"9d3cb82a-7f93-41ae-86ec-56b49a1364d4","Type":"ContainerStarted","Data":"9d3b834108a5b5f36d4c9ec806645f2d3bf341f03608939d51f5262d8b99ac5e"} Jul 07 00:03:54.526420 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:54.526410 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:03:54.541810 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:54.541763 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zxwkp" podStartSLOduration=1.6244269980000001 podStartE2EDuration="5.541745666s" totalImagesPullingTime="3.917318668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:54.540125221 +0000 UTC m=+473.401297054" watchObservedRunningTime="2026-07-07 00:03:54.541745666 +0000 UTC m=+473.402917410" Jul 07 00:03:54.561445 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:03:54.561383 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" podStartSLOduration=1.982072696 podStartE2EDuration="6.561360636s" totalImagesPullingTime="4.57928794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:54.558466298 +0000 UTC m=+473.419638040" watchObservedRunningTime="2026-07-07 00:03:54.561360636 +0000 UTC m=+473.422532378" Jul 07 00:04:05.533328 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:05.533298 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jkph7" Jul 07 00:04:29.048452 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.048416 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cjmcm"] Jul 07 00:04:29.051298 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.051277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" Jul 07 00:04:29.057059 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.057032 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cjmcm"] Jul 07 00:04:29.097712 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.097641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klv6j\" (UniqueName: \"kubernetes.io/projected/70f54405-72d8-466a-ad44-d541d6278231-kube-api-access-klv6j\") pod \"authorino-5d4b67c446-cjmcm\" (UID: \"70f54405-72d8-466a-ad44-d541d6278231\") " pod="kuadrant-system/authorino-5d4b67c446-cjmcm" Jul 07 00:04:29.198417 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.198380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klv6j\" (UniqueName: \"kubernetes.io/projected/70f54405-72d8-466a-ad44-d541d6278231-kube-api-access-klv6j\") pod \"authorino-5d4b67c446-cjmcm\" (UID: \"70f54405-72d8-466a-ad44-d541d6278231\") " pod="kuadrant-system/authorino-5d4b67c446-cjmcm" Jul 07 00:04:29.208467 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.208436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klv6j\" (UniqueName: \"kubernetes.io/projected/70f54405-72d8-466a-ad44-d541d6278231-kube-api-access-klv6j\") pod \"authorino-5d4b67c446-cjmcm\" (UID: \"70f54405-72d8-466a-ad44-d541d6278231\") " pod="kuadrant-system/authorino-5d4b67c446-cjmcm" Jul 07 00:04:29.294926 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.294889 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cjmcm"] Jul 07 00:04:29.295181 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.295169 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" Jul 07 00:04:29.328398 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.328363 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64b6bc7698-49d9m"] Jul 07 00:04:29.331487 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.331461 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6bc7698-49d9m" Jul 07 00:04:29.338096 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.338070 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64b6bc7698-49d9m"] Jul 07 00:04:29.400386 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.400348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5pt\" (UniqueName: \"kubernetes.io/projected/63327be6-e84f-4c72-a996-e72c2753a45b-kube-api-access-8s5pt\") pod \"authorino-64b6bc7698-49d9m\" (UID: \"63327be6-e84f-4c72-a996-e72c2753a45b\") " pod="kuadrant-system/authorino-64b6bc7698-49d9m" Jul 07 00:04:29.443345 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.443319 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cjmcm"] Jul 07 00:04:29.445829 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:04:29.445803 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70f54405_72d8_466a_ad44_d541d6278231.slice/crio-0c729302126a4db59f647eff33d1a2fc82a7ed8aac0797619cf73245e469fc27 WatchSource:0}: Error finding container 0c729302126a4db59f647eff33d1a2fc82a7ed8aac0797619cf73245e469fc27: Status 404 returned error can't find the container with id 0c729302126a4db59f647eff33d1a2fc82a7ed8aac0797619cf73245e469fc27 Jul 07 00:04:29.500890 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.500857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5pt\" (UniqueName: \"kubernetes.io/projected/63327be6-e84f-4c72-a996-e72c2753a45b-kube-api-access-8s5pt\") pod \"authorino-64b6bc7698-49d9m\" (UID: \"63327be6-e84f-4c72-a996-e72c2753a45b\") " pod="kuadrant-system/authorino-64b6bc7698-49d9m" Jul 07 00:04:29.510296 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.510267 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5pt\" (UniqueName: \"kubernetes.io/projected/63327be6-e84f-4c72-a996-e72c2753a45b-kube-api-access-8s5pt\") pod \"authorino-64b6bc7698-49d9m\" (UID: \"63327be6-e84f-4c72-a996-e72c2753a45b\") " pod="kuadrant-system/authorino-64b6bc7698-49d9m" Jul 07 00:04:29.644597 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.644562 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6bc7698-49d9m" Jul 07 00:04:29.740906 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.740864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" event={"ID":"70f54405-72d8-466a-ad44-d541d6278231","Type":"ContainerStarted","Data":"0c729302126a4db59f647eff33d1a2fc82a7ed8aac0797619cf73245e469fc27"} Jul 07 00:04:29.783997 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.783967 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64b6bc7698-49d9m"] Jul 07 00:04:29.785981 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:04:29.785940 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63327be6_e84f_4c72_a996_e72c2753a45b.slice/crio-c4621c0466a28851ad9664e8c23a3d49246c2569ed4ae08384d28316c4a494d6 WatchSource:0}: Error finding container c4621c0466a28851ad9664e8c23a3d49246c2569ed4ae08384d28316c4a494d6: Status 404 returned error can't find the container with id c4621c0466a28851ad9664e8c23a3d49246c2569ed4ae08384d28316c4a494d6 Jul 07 00:04:29.822870 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.822840 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64b6bc7698-49d9m"] Jul 07 00:04:29.847375 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.847347 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-cj84l"] Jul 07 00:04:29.850353 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.850334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:29.852872 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.852853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 00:04:29.859091 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.859068 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-cj84l"] Jul 07 00:04:29.906938 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.906912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-tls-cert\") pod \"authorino-5c88c8cf66-cj84l\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:29.907070 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:29.907045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvw6m\" (UniqueName: \"kubernetes.io/projected/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-kube-api-access-dvw6m\") pod \"authorino-5c88c8cf66-cj84l\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:30.008008 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.007968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvw6m\" (UniqueName: \"kubernetes.io/projected/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-kube-api-access-dvw6m\") pod \"authorino-5c88c8cf66-cj84l\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:30.008215 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.008071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-tls-cert\") pod \"authorino-5c88c8cf66-cj84l\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:30.010616 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.010592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-tls-cert\") pod \"authorino-5c88c8cf66-cj84l\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:30.016823 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.016792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvw6m\" (UniqueName: \"kubernetes.io/projected/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-kube-api-access-dvw6m\") pod \"authorino-5c88c8cf66-cj84l\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:30.197930 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.197847 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:04:30.347294 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.347266 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-cj84l"] Jul 07 00:04:30.349358 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:04:30.349333 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8da78b7c_aa6e_4fec_a30f_bf5bbdf0a4f5.slice/crio-c11f7d7b4d8522d8bd1696107307707a28f9ceae6e650f877f9041b2a4b02c24 WatchSource:0}: Error finding container c11f7d7b4d8522d8bd1696107307707a28f9ceae6e650f877f9041b2a4b02c24: Status 404 returned error can't find the container with id c11f7d7b4d8522d8bd1696107307707a28f9ceae6e650f877f9041b2a4b02c24 Jul 07 00:04:30.749196 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.749160 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" event={"ID":"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5","Type":"ContainerStarted","Data":"c11f7d7b4d8522d8bd1696107307707a28f9ceae6e650f877f9041b2a4b02c24"} Jul 07 00:04:30.750783 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.750758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6bc7698-49d9m" event={"ID":"63327be6-e84f-4c72-a996-e72c2753a45b","Type":"ContainerStarted","Data":"bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531"} Jul 07 00:04:30.750906 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.750793 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6bc7698-49d9m" event={"ID":"63327be6-e84f-4c72-a996-e72c2753a45b","Type":"ContainerStarted","Data":"c4621c0466a28851ad9664e8c23a3d49246c2569ed4ae08384d28316c4a494d6"} Jul 07 00:04:30.750906 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.750788 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-64b6bc7698-49d9m" podUID="63327be6-e84f-4c72-a996-e72c2753a45b" containerName="authorino" containerID="cri-o://bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531" gracePeriod=30 Jul 07 00:04:30.752473 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.752441 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" event={"ID":"70f54405-72d8-466a-ad44-d541d6278231","Type":"ContainerStarted","Data":"ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb"} Jul 07 00:04:30.752575 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.752550 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" podUID="70f54405-72d8-466a-ad44-d541d6278231" containerName="authorino" containerID="cri-o://ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb" gracePeriod=30 Jul 07 00:04:30.769887 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.769816 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64b6bc7698-49d9m" podStartSLOduration=1.487690538 podStartE2EDuration="1.769795736s" totalImagesPullingTime="282.105198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:30.765949293 +0000 UTC m=+509.627121038" watchObservedRunningTime="2026-07-07 00:04:30.769795736 +0000 UTC m=+509.630967478" Jul 07 00:04:30.783702 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:30.783610 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" podStartSLOduration=1.397663549 podStartE2EDuration="1.783595961s" totalImagesPullingTime="385.932412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:30.781724029 +0000 UTC m=+509.642895771" watchObservedRunningTime="2026-07-07 00:04:30.783595961 +0000 UTC m=+509.644767702" Jul 07 00:04:31.026434 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.026396 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6bc7698-49d9m" Jul 07 00:04:31.035574 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.035554 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" Jul 07 00:04:31.118628 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.118599 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s5pt\" (UniqueName: \"kubernetes.io/projected/63327be6-e84f-4c72-a996-e72c2753a45b-kube-api-access-8s5pt\") pod \"63327be6-e84f-4c72-a996-e72c2753a45b\" (UID: \"63327be6-e84f-4c72-a996-e72c2753a45b\") " Jul 07 00:04:31.118806 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.118672 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klv6j\" (UniqueName: \"kubernetes.io/projected/70f54405-72d8-466a-ad44-d541d6278231-kube-api-access-klv6j\") pod \"70f54405-72d8-466a-ad44-d541d6278231\" (UID: \"70f54405-72d8-466a-ad44-d541d6278231\") " Jul 07 00:04:31.120890 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.120853 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63327be6-e84f-4c72-a996-e72c2753a45b-kube-api-access-8s5pt" (OuterVolumeSpecName: "kube-api-access-8s5pt") pod "63327be6-e84f-4c72-a996-e72c2753a45b" (UID: "63327be6-e84f-4c72-a996-e72c2753a45b"). InnerVolumeSpecName "kube-api-access-8s5pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:04:31.120890 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.120865 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f54405-72d8-466a-ad44-d541d6278231-kube-api-access-klv6j" (OuterVolumeSpecName: "kube-api-access-klv6j") pod "70f54405-72d8-466a-ad44-d541d6278231" (UID: "70f54405-72d8-466a-ad44-d541d6278231"). InnerVolumeSpecName "kube-api-access-klv6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:04:31.219781 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.219749 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s5pt\" (UniqueName: \"kubernetes.io/projected/63327be6-e84f-4c72-a996-e72c2753a45b-kube-api-access-8s5pt\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:04:31.219781 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.219780 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klv6j\" (UniqueName: \"kubernetes.io/projected/70f54405-72d8-466a-ad44-d541d6278231-kube-api-access-klv6j\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:04:31.761509 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.761467 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" event={"ID":"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5","Type":"ContainerStarted","Data":"e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d"} Jul 07 00:04:31.762760 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.762730 2559 generic.go:356] "Generic (PLEG): container finished" podID="63327be6-e84f-4c72-a996-e72c2753a45b" containerID="bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531" exitCode=0 Jul 07 00:04:31.762909 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.762827 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64b6bc7698-49d9m" Jul 07 00:04:31.762909 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.762871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6bc7698-49d9m" event={"ID":"63327be6-e84f-4c72-a996-e72c2753a45b","Type":"ContainerDied","Data":"bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531"} Jul 07 00:04:31.763034 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.762921 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64b6bc7698-49d9m" event={"ID":"63327be6-e84f-4c72-a996-e72c2753a45b","Type":"ContainerDied","Data":"c4621c0466a28851ad9664e8c23a3d49246c2569ed4ae08384d28316c4a494d6"} Jul 07 00:04:31.763034 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.762944 2559 scope.go:117] "RemoveContainer" containerID="bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531" Jul 07 00:04:31.764325 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.764303 2559 generic.go:356] "Generic (PLEG): container finished" podID="70f54405-72d8-466a-ad44-d541d6278231" containerID="ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb" exitCode=0 Jul 07 00:04:31.764392 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.764349 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" event={"ID":"70f54405-72d8-466a-ad44-d541d6278231","Type":"ContainerDied","Data":"ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb"} Jul 07 00:04:31.764392 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.764365 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" Jul 07 00:04:31.764392 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.764379 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cjmcm" event={"ID":"70f54405-72d8-466a-ad44-d541d6278231","Type":"ContainerDied","Data":"0c729302126a4db59f647eff33d1a2fc82a7ed8aac0797619cf73245e469fc27"} Jul 07 00:04:31.773566 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.773538 2559 scope.go:117] "RemoveContainer" containerID="bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531" Jul 07 00:04:31.773860 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:04:31.773842 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531\": container with ID starting with bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531 not found: ID does not exist" containerID="bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531" Jul 07 00:04:31.773909 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.773870 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531"} err="failed to get container status \"bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531\": rpc error: code = NotFound desc = could not find container \"bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531\": container with ID starting with bbe12ca7cfa7b8c6ef6e40c4556f3ddedf17f67533c3f7f8c1d1f73cb760f531 not found: ID does not exist" Jul 07 00:04:31.773909 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.773893 2559 scope.go:117] "RemoveContainer" containerID="ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb" Jul 07 00:04:31.778822 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.778784 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" podStartSLOduration=2.396709579 podStartE2EDuration="2.778771825s" totalImagesPullingTime="382.062246ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:31.776636759 +0000 UTC m=+510.637808511" watchObservedRunningTime="2026-07-07 00:04:31.778771825 +0000 UTC m=+510.639943579" Jul 07 00:04:31.783584 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.783562 2559 scope.go:117] "RemoveContainer" containerID="ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb" Jul 07 00:04:31.783839 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:04:31.783819 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb\": container with ID starting with ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb not found: ID does not exist" containerID="ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb" Jul 07 00:04:31.783914 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.783845 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb"} err="failed to get container status \"ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb\": rpc error: code = NotFound desc = could not find container \"ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb\": container with ID starting with ca191da0e5da7f988b779b75810b96e72f6fa5bcdc4e5369bbd7a4a423c8cfeb not found: ID does not exist" Jul 07 00:04:31.793404 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.793370 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cjmcm"] Jul 07 00:04:31.796072 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.796045 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cjmcm"] Jul 07 00:04:31.804289 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.804261 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zxwkp"] Jul 07 00:04:31.804499 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.804473 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zxwkp" podUID="f51e9800-4ad4-441d-890e-bf7730362697" containerName="authorino" containerID="cri-o://5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2" gracePeriod=30 Jul 07 00:04:31.809201 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.809173 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64b6bc7698-49d9m"] Jul 07 00:04:31.815177 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:31.815153 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64b6bc7698-49d9m"] Jul 07 00:04:32.062602 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.062580 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zxwkp" Jul 07 00:04:32.128732 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.128696 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr5dg\" (UniqueName: \"kubernetes.io/projected/f51e9800-4ad4-441d-890e-bf7730362697-kube-api-access-lr5dg\") pod \"f51e9800-4ad4-441d-890e-bf7730362697\" (UID: \"f51e9800-4ad4-441d-890e-bf7730362697\") " Jul 07 00:04:32.131061 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.131025 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f51e9800-4ad4-441d-890e-bf7730362697-kube-api-access-lr5dg" (OuterVolumeSpecName: "kube-api-access-lr5dg") pod "f51e9800-4ad4-441d-890e-bf7730362697" (UID: "f51e9800-4ad4-441d-890e-bf7730362697"). InnerVolumeSpecName "kube-api-access-lr5dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:04:32.230318 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.230234 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr5dg\" (UniqueName: \"kubernetes.io/projected/f51e9800-4ad4-441d-890e-bf7730362697-kube-api-access-lr5dg\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:04:32.772769 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.772732 2559 generic.go:356] "Generic (PLEG): container finished" podID="f51e9800-4ad4-441d-890e-bf7730362697" containerID="5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2" exitCode=0 Jul 07 00:04:32.772769 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.772770 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zxwkp" Jul 07 00:04:32.773002 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.772821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zxwkp" event={"ID":"f51e9800-4ad4-441d-890e-bf7730362697","Type":"ContainerDied","Data":"5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2"} Jul 07 00:04:32.773002 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.772859 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zxwkp" event={"ID":"f51e9800-4ad4-441d-890e-bf7730362697","Type":"ContainerDied","Data":"c92d28bc3797419ced39ed7da5d0f5a81de6ff919bb36a5d6a7764aa69b004ae"} Jul 07 00:04:32.773002 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.772881 2559 scope.go:117] "RemoveContainer" containerID="5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2" Jul 07 00:04:32.782389 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.782370 2559 scope.go:117] "RemoveContainer" containerID="5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2" Jul 07 00:04:32.782689 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:04:32.782668 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2\": container with ID starting with 5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2 not found: ID does not exist" containerID="5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2" Jul 07 00:04:32.782766 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.782703 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2"} err="failed to get container status \"5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2\": rpc error: code = NotFound desc = could not find container \"5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2\": container with ID starting with 5cc35d9b27b636db93716de42754eedbb0e735ef6d7eed84182aba6f97ab59c2 not found: ID does not exist" Jul 07 00:04:32.797200 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.797176 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zxwkp"] Jul 07 00:04:32.801356 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:32.801332 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zxwkp"] Jul 07 00:04:33.666872 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:33.666838 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63327be6-e84f-4c72-a996-e72c2753a45b" path="/var/lib/kubelet/pods/63327be6-e84f-4c72-a996-e72c2753a45b/volumes" Jul 07 00:04:33.667246 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:33.667144 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f54405-72d8-466a-ad44-d541d6278231" path="/var/lib/kubelet/pods/70f54405-72d8-466a-ad44-d541d6278231/volumes" Jul 07 00:04:33.667446 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:04:33.667432 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f51e9800-4ad4-441d-890e-bf7730362697" path="/var/lib/kubelet/pods/f51e9800-4ad4-441d-890e-bf7730362697/volumes" Jul 07 00:05:11.510755 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:05:11.510721 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:05:31.866153 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:05:31.866108 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:05:37.772924 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:05:37.772889 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:05:43.762680 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:05:43.762627 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:05:50.875027 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:05:50.874988 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:05:55.162420 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:05:55.162384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:06:01.607266 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:01.607238 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:06:01.607740 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:01.607645 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:06:01.964876 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:01.964842 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:06:34.097527 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.097437 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d947bf65f-fctlx"] Jul 07 00:06:34.098160 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098140 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f51e9800-4ad4-441d-890e-bf7730362697" containerName="authorino" Jul 07 00:06:34.098205 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098162 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f51e9800-4ad4-441d-890e-bf7730362697" containerName="authorino" Jul 07 00:06:34.098205 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098175 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f54405-72d8-466a-ad44-d541d6278231" containerName="authorino" Jul 07 00:06:34.098205 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098185 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f54405-72d8-466a-ad44-d541d6278231" containerName="authorino" Jul 07 00:06:34.098304 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098207 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63327be6-e84f-4c72-a996-e72c2753a45b" containerName="authorino" Jul 07 00:06:34.098304 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098216 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63327be6-e84f-4c72-a996-e72c2753a45b" containerName="authorino" Jul 07 00:06:34.098366 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098309 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f51e9800-4ad4-441d-890e-bf7730362697" containerName="authorino" Jul 07 00:06:34.098366 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098321 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63327be6-e84f-4c72-a996-e72c2753a45b" containerName="authorino" Jul 07 00:06:34.098366 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.098336 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f54405-72d8-466a-ad44-d541d6278231" containerName="authorino" Jul 07 00:06:34.103903 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.102387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.113481 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.113441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d947bf65f-fctlx"] Jul 07 00:06:34.256062 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.256021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ppxz\" (UniqueName: \"kubernetes.io/projected/bb3b7be7-4638-45f5-93c0-68c73f9582d3-kube-api-access-5ppxz\") pod \"authorino-5d947bf65f-fctlx\" (UID: \"bb3b7be7-4638-45f5-93c0-68c73f9582d3\") " pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.256220 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.256085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb3b7be7-4638-45f5-93c0-68c73f9582d3-tls-cert\") pod \"authorino-5d947bf65f-fctlx\" (UID: \"bb3b7be7-4638-45f5-93c0-68c73f9582d3\") " pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.357312 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.357219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ppxz\" (UniqueName: \"kubernetes.io/projected/bb3b7be7-4638-45f5-93c0-68c73f9582d3-kube-api-access-5ppxz\") pod \"authorino-5d947bf65f-fctlx\" (UID: \"bb3b7be7-4638-45f5-93c0-68c73f9582d3\") " pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.357312 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.357279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb3b7be7-4638-45f5-93c0-68c73f9582d3-tls-cert\") pod \"authorino-5d947bf65f-fctlx\" (UID: \"bb3b7be7-4638-45f5-93c0-68c73f9582d3\") " pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.360265 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.360238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb3b7be7-4638-45f5-93c0-68c73f9582d3-tls-cert\") pod \"authorino-5d947bf65f-fctlx\" (UID: \"bb3b7be7-4638-45f5-93c0-68c73f9582d3\") " pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.369188 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.369162 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ppxz\" (UniqueName: \"kubernetes.io/projected/bb3b7be7-4638-45f5-93c0-68c73f9582d3-kube-api-access-5ppxz\") pod \"authorino-5d947bf65f-fctlx\" (UID: \"bb3b7be7-4638-45f5-93c0-68c73f9582d3\") " pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.419587 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.419552 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d947bf65f-fctlx" Jul 07 00:06:34.564442 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.564413 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d947bf65f-fctlx"] Jul 07 00:06:34.566441 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:06:34.566409 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb3b7be7_4638_45f5_93c0_68c73f9582d3.slice/crio-e390a759a8753757b35ba9a0dd759046edf7b4fed1162e47b31165fd82dc895c WatchSource:0}: Error finding container e390a759a8753757b35ba9a0dd759046edf7b4fed1162e47b31165fd82dc895c: Status 404 returned error can't find the container with id e390a759a8753757b35ba9a0dd759046edf7b4fed1162e47b31165fd82dc895c Jul 07 00:06:34.567899 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:34.567876 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:06:35.509890 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:35.509853 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d947bf65f-fctlx" event={"ID":"bb3b7be7-4638-45f5-93c0-68c73f9582d3","Type":"ContainerStarted","Data":"e390a759a8753757b35ba9a0dd759046edf7b4fed1162e47b31165fd82dc895c"} Jul 07 00:06:36.521945 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.521906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d947bf65f-fctlx" event={"ID":"bb3b7be7-4638-45f5-93c0-68c73f9582d3","Type":"ContainerStarted","Data":"e73674d5bfa7474c27e3f242880b7bad6a0e7d5fa9aa9ee08e82a44a4f2a33d2"} Jul 07 00:06:36.539690 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.539599 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d947bf65f-fctlx" podStartSLOduration=1.4720789779999999 podStartE2EDuration="2.539575439s" totalImagesPullingTime="1.067496461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:36.537447817 +0000 UTC m=+635.398619559" watchObservedRunningTime="2026-07-07 00:06:36.539575439 +0000 UTC m=+635.400747220" Jul 07 00:06:36.570083 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.570047 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-cj84l"] Jul 07 00:06:36.570918 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.570609 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" podUID="8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" containerName="authorino" containerID="cri-o://e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d" gracePeriod=30 Jul 07 00:06:36.850959 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.850927 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:06:36.877219 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.875924 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-tls-cert\") pod \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " Jul 07 00:06:36.877219 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.876701 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvw6m\" (UniqueName: \"kubernetes.io/projected/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-kube-api-access-dvw6m\") pod \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\" (UID: \"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5\") " Jul 07 00:06:36.879693 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.879664 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-kube-api-access-dvw6m" (OuterVolumeSpecName: "kube-api-access-dvw6m") pod "8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" (UID: "8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5"). InnerVolumeSpecName "kube-api-access-dvw6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:06:36.891343 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.891296 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" (UID: "8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:06:36.977999 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.977964 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvw6m\" (UniqueName: \"kubernetes.io/projected/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-kube-api-access-dvw6m\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:06:36.977999 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:36.977995 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5-tls-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:06:37.530279 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.530251 2559 generic.go:356] "Generic (PLEG): container finished" podID="8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" containerID="e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d" exitCode=0 Jul 07 00:06:37.530793 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.530307 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" Jul 07 00:06:37.530793 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.530349 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" event={"ID":"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5","Type":"ContainerDied","Data":"e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d"} Jul 07 00:06:37.530793 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.530399 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-cj84l" event={"ID":"8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5","Type":"ContainerDied","Data":"c11f7d7b4d8522d8bd1696107307707a28f9ceae6e650f877f9041b2a4b02c24"} Jul 07 00:06:37.530793 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.530423 2559 scope.go:117] "RemoveContainer" containerID="e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d" Jul 07 00:06:37.545157 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.544666 2559 scope.go:117] "RemoveContainer" containerID="e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d" Jul 07 00:06:37.545157 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:06:37.545006 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d\": container with ID starting with e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d not found: ID does not exist" containerID="e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d" Jul 07 00:06:37.545157 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.545034 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d"} err="failed to get container status \"e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d\": rpc error: code = NotFound desc = could not find container \"e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d\": container with ID starting with e34078350d7092133fb0798ffa29f4cb8ed23cecaafee0c20adce2a845962a6d not found: ID does not exist" Jul 07 00:06:37.553981 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.553944 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-cj84l"] Jul 07 00:06:37.556961 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.556940 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-cj84l"] Jul 07 00:06:37.672258 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:06:37.672214 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" path="/var/lib/kubelet/pods/8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5/volumes" Jul 07 00:07:03.384175 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:07:03.384137 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:07:13.560848 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:07:13.560812 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:07:24.558937 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:07:24.558900 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:07:33.465295 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:07:33.465253 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:07:44.054257 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:07:44.054222 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:08:11.248435 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:08:11.248393 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:08:23.156453 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:08:23.156413 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:08:56.754348 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:08:56.754286 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:09:06.751471 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:09:06.751436 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:09:15.358678 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:09:15.357808 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:09:27.854062 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:09:27.853978 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:09:37.148187 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:09:37.148146 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:09:48.360211 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:09:48.360172 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:09:58.752783 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:09:58.752744 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:10:08.449424 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:10:08.449384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:10:30.250974 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:10:30.250938 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:10:40.455449 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:10:40.455412 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:11:01.654775 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:11:01.654742 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:11:01.657214 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:11:01.657189 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:11:04.379930 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:11:04.379896 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:11:17.053141 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:11:17.053102 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:11:32.655517 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:11:32.655483 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:11:41.757321 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:11:41.757285 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:11:51.459560 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:11:51.459522 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:12:00.958016 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:00.957979 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:12:10.064929 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:10.064887 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:12:36.469716 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:36.469605 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf"] Jul 07 00:12:36.470312 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:36.469858 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" podUID="aac9c728-7bdd-4fff-ae52-8454beeb2887" containerName="manager" containerID="cri-o://eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16" gracePeriod=10 Jul 07 00:12:39.936461 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:39.936433 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:12:40.051899 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.051791 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h52g\" (UniqueName: \"kubernetes.io/projected/aac9c728-7bdd-4fff-ae52-8454beeb2887-kube-api-access-7h52g\") pod \"aac9c728-7bdd-4fff-ae52-8454beeb2887\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " Jul 07 00:12:40.051899 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.051864 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac9c728-7bdd-4fff-ae52-8454beeb2887-extensions-socket-volume\") pod \"aac9c728-7bdd-4fff-ae52-8454beeb2887\" (UID: \"aac9c728-7bdd-4fff-ae52-8454beeb2887\") " Jul 07 00:12:40.052239 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.052214 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac9c728-7bdd-4fff-ae52-8454beeb2887-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aac9c728-7bdd-4fff-ae52-8454beeb2887" (UID: "aac9c728-7bdd-4fff-ae52-8454beeb2887"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:12:40.054057 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.054034 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac9c728-7bdd-4fff-ae52-8454beeb2887-kube-api-access-7h52g" (OuterVolumeSpecName: "kube-api-access-7h52g") pod "aac9c728-7bdd-4fff-ae52-8454beeb2887" (UID: "aac9c728-7bdd-4fff-ae52-8454beeb2887"). InnerVolumeSpecName "kube-api-access-7h52g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:12:40.152674 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.152625 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h52g\" (UniqueName: \"kubernetes.io/projected/aac9c728-7bdd-4fff-ae52-8454beeb2887-kube-api-access-7h52g\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:12:40.152674 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.152676 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac9c728-7bdd-4fff-ae52-8454beeb2887-extensions-socket-volume\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:12:40.751423 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.751388 2559 generic.go:356] "Generic (PLEG): container finished" podID="aac9c728-7bdd-4fff-ae52-8454beeb2887" containerID="eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16" exitCode=0 Jul 07 00:12:40.751604 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.751430 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" Jul 07 00:12:40.751604 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.751463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" event={"ID":"aac9c728-7bdd-4fff-ae52-8454beeb2887","Type":"ContainerDied","Data":"eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16"} Jul 07 00:12:40.751604 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.751521 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf" event={"ID":"aac9c728-7bdd-4fff-ae52-8454beeb2887","Type":"ContainerDied","Data":"f5ef7db3b943d137419616cc532d73a05f5b2dccc0658f6ce138e1d4eaec40c2"} Jul 07 00:12:40.751604 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.751550 2559 scope.go:117] "RemoveContainer" containerID="eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16" Jul 07 00:12:40.762697 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.762676 2559 scope.go:117] "RemoveContainer" containerID="eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16" Jul 07 00:12:40.762980 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:12:40.762952 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16\": container with ID starting with eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16 not found: ID does not exist" containerID="eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16" Jul 07 00:12:40.763083 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.762994 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16"} err="failed to get container status \"eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16\": rpc error: code = NotFound desc = could not find container \"eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16\": container with ID starting with eab890ec1cdcf4c79517c3283cd2a28a8be08f89c757150f75a770d5c5b88f16 not found: ID does not exist" Jul 07 00:12:40.776869 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.776841 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf"] Jul 07 00:12:40.780915 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:40.780892 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zr5xf"] Jul 07 00:12:41.666397 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:12:41.666361 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac9c728-7bdd-4fff-ae52-8454beeb2887" path="/var/lib/kubelet/pods/aac9c728-7bdd-4fff-ae52-8454beeb2887/volumes" Jul 07 00:13:37.599320 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.599278 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf"] Jul 07 00:13:37.599837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.599745 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" containerName="authorino" Jul 07 00:13:37.599837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.599758 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" containerName="authorino" Jul 07 00:13:37.599837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.599785 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9c728-7bdd-4fff-ae52-8454beeb2887" containerName="manager" Jul 07 00:13:37.599837 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.599790 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9c728-7bdd-4fff-ae52-8454beeb2887" containerName="manager" Jul 07 00:13:37.599977 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.599857 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da78b7c-aa6e-4fec-a30f-bf5bbdf0a4f5" containerName="authorino" Jul 07 00:13:37.599977 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.599865 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac9c728-7bdd-4fff-ae52-8454beeb2887" containerName="manager" Jul 07 00:13:37.603151 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.603134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:37.605868 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.605846 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lxsr7\"" Jul 07 00:13:37.615119 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.615095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf"] Jul 07 00:13:37.680128 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.680089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8bz\" (UniqueName: \"kubernetes.io/projected/17fae05a-a2d0-4159-9fa2-da7aaceef7f5-kube-api-access-9m8bz\") pod \"kuadrant-operator-controller-manager-86878c769f-w7rvf\" (UID: \"17fae05a-a2d0-4159-9fa2-da7aaceef7f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:37.680128 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.680132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17fae05a-a2d0-4159-9fa2-da7aaceef7f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7rvf\" (UID: \"17fae05a-a2d0-4159-9fa2-da7aaceef7f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:37.781470 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.781433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8bz\" (UniqueName: \"kubernetes.io/projected/17fae05a-a2d0-4159-9fa2-da7aaceef7f5-kube-api-access-9m8bz\") pod \"kuadrant-operator-controller-manager-86878c769f-w7rvf\" (UID: \"17fae05a-a2d0-4159-9fa2-da7aaceef7f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:37.781686 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.781507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17fae05a-a2d0-4159-9fa2-da7aaceef7f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7rvf\" (UID: \"17fae05a-a2d0-4159-9fa2-da7aaceef7f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:37.782254 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.782228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17fae05a-a2d0-4159-9fa2-da7aaceef7f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7rvf\" (UID: \"17fae05a-a2d0-4159-9fa2-da7aaceef7f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:37.790302 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.790283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8bz\" (UniqueName: \"kubernetes.io/projected/17fae05a-a2d0-4159-9fa2-da7aaceef7f5-kube-api-access-9m8bz\") pod \"kuadrant-operator-controller-manager-86878c769f-w7rvf\" (UID: \"17fae05a-a2d0-4159-9fa2-da7aaceef7f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:37.913544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:37.913512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:38.066564 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:38.066530 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf"] Jul 07 00:13:38.067995 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:13:38.067964 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fae05a_a2d0_4159_9fa2_da7aaceef7f5.slice/crio-59f08e40b18682816c7349bd6c17d25dcb561e58b2cf5fa70ab536743709500f WatchSource:0}: Error finding container 59f08e40b18682816c7349bd6c17d25dcb561e58b2cf5fa70ab536743709500f: Status 404 returned error can't find the container with id 59f08e40b18682816c7349bd6c17d25dcb561e58b2cf5fa70ab536743709500f Jul 07 00:13:38.102797 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:38.102766 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" event={"ID":"17fae05a-a2d0-4159-9fa2-da7aaceef7f5","Type":"ContainerStarted","Data":"59f08e40b18682816c7349bd6c17d25dcb561e58b2cf5fa70ab536743709500f"} Jul 07 00:13:39.111226 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:39.111183 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" event={"ID":"17fae05a-a2d0-4159-9fa2-da7aaceef7f5","Type":"ContainerStarted","Data":"ecc5847073548b906da42494d17c30699c4d78d116a75f806473115374bd0c40"} Jul 07 00:13:39.111711 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:39.111268 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:39.135878 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:39.135829 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" podStartSLOduration=2.135812973 podStartE2EDuration="2.135812973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:13:39.133362145 +0000 UTC m=+1057.994533886" watchObservedRunningTime="2026-07-07 00:13:39.135812973 +0000 UTC m=+1057.996984714" Jul 07 00:13:50.120209 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:50.120177 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7rvf" Jul 07 00:13:58.446674 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:13:58.446572 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:14:09.751838 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:14:09.751796 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:14:18.479084 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:14:18.479049 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:14:30.858643 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:14:30.858601 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:14:42.755748 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:14:42.755710 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:14:52.249791 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:14:52.249750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:15:00.147402 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.147368 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-5vbkg"] Jul 07 00:15:00.151075 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.151054 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" Jul 07 00:15:00.154523 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.154504 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gxc75\"" Jul 07 00:15:00.160499 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.160473 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-5vbkg"] Jul 07 00:15:00.250999 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.250949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc57m\" (UniqueName: \"kubernetes.io/projected/5d8b2434-df7c-4d9f-9a1b-c9985706341f-kube-api-access-vc57m\") pod \"maas-api-key-cleanup-29723055-5vbkg\" (UID: \"5d8b2434-df7c-4d9f-9a1b-c9985706341f\") " pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" Jul 07 00:15:00.351966 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.351920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc57m\" (UniqueName: \"kubernetes.io/projected/5d8b2434-df7c-4d9f-9a1b-c9985706341f-kube-api-access-vc57m\") pod \"maas-api-key-cleanup-29723055-5vbkg\" (UID: \"5d8b2434-df7c-4d9f-9a1b-c9985706341f\") " pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" Jul 07 00:15:00.361157 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.361132 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc57m\" (UniqueName: \"kubernetes.io/projected/5d8b2434-df7c-4d9f-9a1b-c9985706341f-kube-api-access-vc57m\") pod \"maas-api-key-cleanup-29723055-5vbkg\" (UID: \"5d8b2434-df7c-4d9f-9a1b-c9985706341f\") " pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" Jul 07 00:15:00.463155 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.463052 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" Jul 07 00:15:00.608563 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.608532 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-5vbkg"] Jul 07 00:15:00.609618 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:15:00.609594 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8b2434_df7c_4d9f_9a1b_c9985706341f.slice/crio-9a79843bd86e74a83cfabaf4c594bd1aaea314634b155b5a0e4f9289577e452e WatchSource:0}: Error finding container 9a79843bd86e74a83cfabaf4c594bd1aaea314634b155b5a0e4f9289577e452e: Status 404 returned error can't find the container with id 9a79843bd86e74a83cfabaf4c594bd1aaea314634b155b5a0e4f9289577e452e Jul 07 00:15:00.611810 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.611783 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:15:00.957597 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:00.957562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:15:01.609227 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:01.609194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" event={"ID":"5d8b2434-df7c-4d9f-9a1b-c9985706341f","Type":"ContainerStarted","Data":"9a79843bd86e74a83cfabaf4c594bd1aaea314634b155b5a0e4f9289577e452e"} Jul 07 00:15:03.624373 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:03.624337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" event={"ID":"5d8b2434-df7c-4d9f-9a1b-c9985706341f","Type":"ContainerStarted","Data":"7093ac7221a693db28b28df39f7751591d9424cd8bb81d4be30b43a5f87640c0"} Jul 07 00:15:03.644130 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:03.644076 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" podStartSLOduration=0.952044186 podStartE2EDuration="3.644057901s" totalImagesPullingTime="2.692013715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:03.642019229 +0000 UTC m=+1142.503190970" watchObservedRunningTime="2026-07-07 00:15:03.644057901 +0000 UTC m=+1142.505229642" Jul 07 00:15:04.632879 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:04.632844 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d8b2434-df7c-4d9f-9a1b-c9985706341f" containerID="7093ac7221a693db28b28df39f7751591d9424cd8bb81d4be30b43a5f87640c0" exitCode=0 Jul 07 00:15:04.633313 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:04.632940 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" event={"ID":"5d8b2434-df7c-4d9f-9a1b-c9985706341f","Type":"ContainerDied","Data":"7093ac7221a693db28b28df39f7751591d9424cd8bb81d4be30b43a5f87640c0"} Jul 07 00:15:05.780310 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:05.780284 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" Jul 07 00:15:05.904750 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:05.904640 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc57m\" (UniqueName: \"kubernetes.io/projected/5d8b2434-df7c-4d9f-9a1b-c9985706341f-kube-api-access-vc57m\") pod \"5d8b2434-df7c-4d9f-9a1b-c9985706341f\" (UID: \"5d8b2434-df7c-4d9f-9a1b-c9985706341f\") " Jul 07 00:15:05.906972 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:05.906942 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d8b2434-df7c-4d9f-9a1b-c9985706341f-kube-api-access-vc57m" (OuterVolumeSpecName: "kube-api-access-vc57m") pod "5d8b2434-df7c-4d9f-9a1b-c9985706341f" (UID: "5d8b2434-df7c-4d9f-9a1b-c9985706341f"). InnerVolumeSpecName "kube-api-access-vc57m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:06.005503 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:06.005464 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc57m\" (UniqueName: \"kubernetes.io/projected/5d8b2434-df7c-4d9f-9a1b-c9985706341f-kube-api-access-vc57m\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:15:06.647033 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:06.647003 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" Jul 07 00:15:06.647210 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:06.647045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-5vbkg" event={"ID":"5d8b2434-df7c-4d9f-9a1b-c9985706341f","Type":"ContainerDied","Data":"9a79843bd86e74a83cfabaf4c594bd1aaea314634b155b5a0e4f9289577e452e"} Jul 07 00:15:06.647210 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:06.647093 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a79843bd86e74a83cfabaf4c594bd1aaea314634b155b5a0e4f9289577e452e" Jul 07 00:15:11.856680 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:11.853899 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:15:22.661791 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:22.661706 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:15:32.554074 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:32.554039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:15:45.862638 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:15:45.862598 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:16:01.693353 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:01.693324 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:16:01.698607 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:01.698578 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:16:07.260033 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:07.259995 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:16:14.558758 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:14.558720 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:16:24.752597 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:24.752564 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:16:34.050078 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:34.050039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:16:40.451264 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:40.451220 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:16:56.160733 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:16:56.160630 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:17:07.451069 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:17:07.451034 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:17:16.949397 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:17:16.949352 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:17:26.650822 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:17:26.650783 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:17:35.852402 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:17:35.852328 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:17:44.985013 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:17:44.984978 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:17:57.761831 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:17:57.761790 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:18:07.668060 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:18:07.668030 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:18:17.267100 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:18:17.267052 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:18:26.956554 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:18:26.956469 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:18:39.758411 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:18:39.758367 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:18:48.556347 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:18:48.556308 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:19:00.858233 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:19:00.858193 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:19:12.161951 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:19:12.161913 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:19:24.853287 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:19:24.853246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:19:33.757059 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:19:33.757017 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:19:42.949902 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:19:42.949863 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:19:54.165676 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:19:54.165571 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:20:04.846597 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:20:04.846559 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:20:12.955794 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:20:12.955708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:20:35.159255 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:20:35.159218 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:20:43.370978 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:20:43.370945 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:21:01.737092 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:21:01.737065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:21:01.748769 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:21:01.748742 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:22:05.067957 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:22:05.067920 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:22:13.804631 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:22:13.804584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:22:25.854332 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:22:25.854279 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:22:37.351232 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:22:37.351192 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:23:11.651000 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:23:11.650957 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:23:19.870881 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:23:19.870843 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:23:36.152818 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:23:36.152778 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:23:45.875547 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:23:45.875506 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:23:57.252786 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:23:57.252748 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:24:32.452462 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:24:32.452367 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:24:41.752069 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:24:41.752029 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:24:53.450373 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:24:53.450335 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:25:38.710977 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.710943 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64"] Jul 07 00:25:38.711618 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.711601 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8b2434-df7c-4d9f-9a1b-c9985706341f" containerName="cleanup" Jul 07 00:25:38.711737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.711621 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8b2434-df7c-4d9f-9a1b-c9985706341f" containerName="cleanup" Jul 07 00:25:38.711737 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.711725 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8b2434-df7c-4d9f-9a1b-c9985706341f" containerName="cleanup" Jul 07 00:25:38.714961 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.714939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.717779 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.717759 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-58927c-openshift-default-dockercfg-k2rfp\"" Jul 07 00:25:38.731338 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.731308 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64"] Jul 07 00:25:38.902961 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.902923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95223618-738c-466c-9dba-8b247c147cf4-istiod-ca-cert\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.902961 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.902972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjn4\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-kube-api-access-5hjn4\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.903187 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.902992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-socket\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.903187 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.903063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-istio-token\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.903187 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.903093 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-credential-socket\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.903187 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.903120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95223618-738c-466c-9dba-8b247c147cf4-istio-podinfo\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.903331 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.903189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-certs\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.903331 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.903206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-data\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:38.903331 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:38.903230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-envoy\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.004972 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.004881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-envoy\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005154 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.004974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95223618-738c-466c-9dba-8b247c147cf4-istiod-ca-cert\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005154 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjn4\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-kube-api-access-5hjn4\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005154 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-socket\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005326 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005160 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-istio-token\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005326 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-credential-socket\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005326 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95223618-738c-466c-9dba-8b247c147cf4-istio-podinfo\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005487 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-certs\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005487 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-data\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005487 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-socket\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005753 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005730 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-data\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005856 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005795 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-certs\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.005904 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.005853 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-credential-socket\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.006202 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.006178 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95223618-738c-466c-9dba-8b247c147cf4-istiod-ca-cert\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.007453 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.007420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-envoy\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.008036 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.008018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95223618-738c-466c-9dba-8b247c147cf4-istio-podinfo\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.013099 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.013076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-istio-token\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.013438 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.013418 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjn4\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-kube-api-access-5hjn4\") pod \"e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.026191 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.026166 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:39.177407 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.177378 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64"] Jul 07 00:25:39.179812 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:25:39.179784 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95223618_738c_466c_9dba_8b247c147cf4.slice/crio-b590cf51bca0bb72f9c1feb40105fc59ff3f68c8270ab972309dee5788c5a971 WatchSource:0}: Error finding container b590cf51bca0bb72f9c1feb40105fc59ff3f68c8270ab972309dee5788c5a971: Status 404 returned error can't find the container with id b590cf51bca0bb72f9c1feb40105fc59ff3f68c8270ab972309dee5788c5a971 Jul 07 00:25:39.182057 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.181993 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:25:39.182149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.182098 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:25:39.182149 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.182138 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:25:39.485497 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.485463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" event={"ID":"95223618-738c-466c-9dba-8b247c147cf4","Type":"ContainerStarted","Data":"c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e"} Jul 07 00:25:39.485733 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.485514 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" event={"ID":"95223618-738c-466c-9dba-8b247c147cf4","Type":"ContainerStarted","Data":"b590cf51bca0bb72f9c1feb40105fc59ff3f68c8270ab972309dee5788c5a971"} Jul 07 00:25:39.510435 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:39.510384 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" podStartSLOduration=1.510363276 podStartE2EDuration="1.510363276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:25:39.508348624 +0000 UTC m=+1778.369520383" watchObservedRunningTime="2026-07-07 00:25:39.510363276 +0000 UTC m=+1778.371535019" Jul 07 00:25:40.026388 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:40.026360 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:40.031322 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:40.031299 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:40.493233 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:40.493203 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:40.494263 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:40.494239 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:40.855663 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:40.855566 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:25:52.370575 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:52.370532 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:25:55.495602 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.495564 2559 patch_prober.go:28] interesting pod/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 07 00:25:55.496303 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.495682 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 07 00:25:55.589308 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.589270 2559 generic.go:356] "Generic (PLEG): container finished" podID="95223618-738c-466c-9dba-8b247c147cf4" containerID="c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e" exitCode=0 Jul 07 00:25:55.589494 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.589350 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" event={"ID":"95223618-738c-466c-9dba-8b247c147cf4","Type":"ContainerDied","Data":"c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e"} Jul 07 00:25:55.589829 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.589815 2559 scope.go:117] "RemoveContainer" containerID="c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e" Jul 07 00:25:55.590838 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.590812 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:25:55.590899 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.590875 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:25:55.590970 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:55.590957 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 00:25:56.602663 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:56.602597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" event={"ID":"95223618-738c-466c-9dba-8b247c147cf4","Type":"ContainerStarted","Data":"41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2"} Jul 07 00:25:57.027171 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:57.027130 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:25:57.027412 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:57.027391 2559 patch_prober.go:28] interesting pod/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 07 00:25:57.027463 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:57.027438 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 07 00:25:58.027398 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:58.027362 2559 patch_prober.go:28] interesting pod/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 07 00:25:58.027849 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:58.027431 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 07 00:25:59.026693 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:59.026632 2559 patch_prober.go:28] interesting pod/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 07 00:25:59.026861 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:25:59.026717 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 07 00:26:00.026945 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:00.026851 2559 patch_prober.go:28] interesting pod/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 07 00:26:00.026945 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:00.026920 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 07 00:26:01.031810 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:01.031782 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:26:01.032185 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:01.032132 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:26:01.032888 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:01.032872 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:26:01.782301 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:01.782264 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:26:01.789830 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:01.789801 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:26:13.165366 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:13.165327 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:26:23.361101 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:23.361064 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:26:33.955156 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:26:33.955109 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:27:09.376131 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:27:09.376087 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:27:52.449116 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:27:52.449075 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:27:55.436401 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:27:55.436369 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64"] Jul 07 00:27:55.436865 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:27:55.436567 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" containerID="cri-o://41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2" gracePeriod=30 Jul 07 00:28:00.698071 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.698003 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:28:00.754215 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754173 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-data\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754215 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754216 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-envoy\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754252 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-credential-socket\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754275 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-socket\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754310 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hjn4\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-kube-api-access-5hjn4\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754329 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-istio-token\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754355 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-certs\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754416 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95223618-738c-466c-9dba-8b247c147cf4-istiod-ca-cert\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754544 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754479 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95223618-738c-466c-9dba-8b247c147cf4-istio-podinfo\") pod \"95223618-738c-466c-9dba-8b247c147cf4\" (UID: \"95223618-738c-466c-9dba-8b247c147cf4\") " Jul 07 00:28:00.754951 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754569 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:28:00.754951 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754707 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:28:00.754951 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754744 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:28:00.754951 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754930 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95223618-738c-466c-9dba-8b247c147cf4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:28:00.755155 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.754993 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-credential-socket\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.755155 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.755012 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-socket\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.755155 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.755027 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-workload-certs\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.755155 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.755042 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95223618-738c-466c-9dba-8b247c147cf4-istiod-ca-cert\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.755155 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.755091 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-data" (OuterVolumeSpecName: "istio-data") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:28:00.756682 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.756626 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:28:00.757242 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.757222 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95223618-738c-466c-9dba-8b247c147cf4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:28:00.757423 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.757399 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-kube-api-access-5hjn4" (OuterVolumeSpecName: "kube-api-access-5hjn4") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "kube-api-access-5hjn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:28:00.757423 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.757415 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-istio-token" (OuterVolumeSpecName: "istio-token") pod "95223618-738c-466c-9dba-8b247c147cf4" (UID: "95223618-738c-466c-9dba-8b247c147cf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:28:00.855765 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.855726 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95223618-738c-466c-9dba-8b247c147cf4-istio-podinfo\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.855765 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.855761 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-data\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.855765 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.855771 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95223618-738c-466c-9dba-8b247c147cf4-istio-envoy\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.856030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.855779 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hjn4\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-kube-api-access-5hjn4\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:00.856030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:00.855789 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95223618-738c-466c-9dba-8b247c147cf4-istio-token\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:01.385946 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.385912 2559 generic.go:356] "Generic (PLEG): container finished" podID="95223618-738c-466c-9dba-8b247c147cf4" containerID="41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2" exitCode=0 Jul 07 00:28:01.386126 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.385962 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" Jul 07 00:28:01.386126 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.385997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" event={"ID":"95223618-738c-466c-9dba-8b247c147cf4","Type":"ContainerDied","Data":"41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2"} Jul 07 00:28:01.386126 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.386051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64" event={"ID":"95223618-738c-466c-9dba-8b247c147cf4","Type":"ContainerDied","Data":"b590cf51bca0bb72f9c1feb40105fc59ff3f68c8270ab972309dee5788c5a971"} Jul 07 00:28:01.386126 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.386076 2559 scope.go:117] "RemoveContainer" containerID="41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2" Jul 07 00:28:01.396698 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.396672 2559 scope.go:117] "RemoveContainer" containerID="c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e" Jul 07 00:28:01.406342 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.406323 2559 scope.go:117] "RemoveContainer" containerID="41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2" Jul 07 00:28:01.406639 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:28:01.406618 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2\": container with ID starting with 41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2 not found: ID does not exist" containerID="41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2" Jul 07 00:28:01.406755 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.406675 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2"} err="failed to get container status \"41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2\": rpc error: code = NotFound desc = could not find container \"41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2\": container with ID starting with 41d9dad41d620c3eae8df2736bbe67057147aca1f4d334f477fea223768067d2 not found: ID does not exist" Jul 07 00:28:01.406755 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.406693 2559 scope.go:117] "RemoveContainer" containerID="c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e" Jul 07 00:28:01.406965 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:28:01.406945 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e\": container with ID starting with c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e not found: ID does not exist" containerID="c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e" Jul 07 00:28:01.407031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.406982 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e"} err="failed to get container status \"c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e\": rpc error: code = NotFound desc = could not find container \"c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e\": container with ID starting with c66501c77f0ce76526ee8d4057d5902d83f940fc61e560a26ed8c8e56b880b1e not found: ID does not exist" Jul 07 00:28:01.425131 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.425096 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64"] Jul 07 00:28:01.436960 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.436927 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-58927c-openshift-default-74b4956d4c-jcz64"] Jul 07 00:28:01.666004 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:01.665929 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95223618-738c-466c-9dba-8b247c147cf4" path="/var/lib/kubelet/pods/95223618-738c-466c-9dba-8b247c147cf4/volumes" Jul 07 00:28:07.265771 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.265728 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:28:07.519512 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.519415 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2"] Jul 07 00:28:07.520000 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.519969 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" Jul 07 00:28:07.520000 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.520003 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" Jul 07 00:28:07.520110 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.520023 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" Jul 07 00:28:07.520110 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.520029 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" Jul 07 00:28:07.520110 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.520107 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" Jul 07 00:28:07.520217 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.520115 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="95223618-738c-466c-9dba-8b247c147cf4" containerName="istio-proxy" Jul 07 00:28:07.523224 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.523201 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.525839 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.525811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-c1149c-serving-cert\"" Jul 07 00:28:07.525957 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.525850 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gxc75\"" Jul 07 00:28:07.533319 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.533287 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2"] Jul 07 00:28:07.617623 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.617579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7ntb\" (UniqueName: \"kubernetes.io/projected/382b3883-c408-4142-a062-4a5cc97d6790-kube-api-access-n7ntb\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.617838 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.617729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.617838 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.617766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/382b3883-c408-4142-a062-4a5cc97d6790-openshift-service-ca\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.718773 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.718730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ntb\" (UniqueName: \"kubernetes.io/projected/382b3883-c408-4142-a062-4a5cc97d6790-kube-api-access-n7ntb\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.718970 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.718854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.718970 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.718903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/382b3883-c408-4142-a062-4a5cc97d6790-openshift-service-ca\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.719051 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:28:07.719018 2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-c1149c-serving-cert: secret "maas-api-e2e-api-b-c1149c-serving-cert" not found Jul 07 00:28:07.719103 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:28:07.719092 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls podName:382b3883-c408-4142-a062-4a5cc97d6790 nodeName:}" failed. No retries permitted until 2026-07-07 00:28:08.219076454 +0000 UTC m=+1927.080248178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls") pod "maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" (UID: "382b3883-c408-4142-a062-4a5cc97d6790") : secret "maas-api-e2e-api-b-c1149c-serving-cert" not found Jul 07 00:28:07.719533 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.719515 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/382b3883-c408-4142-a062-4a5cc97d6790-openshift-service-ca\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:07.728037 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:07.728003 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7ntb\" (UniqueName: \"kubernetes.io/projected/382b3883-c408-4142-a062-4a5cc97d6790-kube-api-access-n7ntb\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:08.223813 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:08.223775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:08.226389 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:08.226364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls\") pod \"maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:08.435891 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:08.435858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:08.580067 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:08.580041 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2"] Jul 07 00:28:08.581955 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:28:08.581922 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382b3883_c408_4142_a062_4a5cc97d6790.slice/crio-3cea1a6aa6c5ad8ab314960f12b48686d38cc0d0885afbb58806d35228647a57 WatchSource:0}: Error finding container 3cea1a6aa6c5ad8ab314960f12b48686d38cc0d0885afbb58806d35228647a57: Status 404 returned error can't find the container with id 3cea1a6aa6c5ad8ab314960f12b48686d38cc0d0885afbb58806d35228647a57 Jul 07 00:28:08.586519 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:08.586498 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:28:09.443089 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:09.443052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" event={"ID":"382b3883-c408-4142-a062-4a5cc97d6790","Type":"ContainerStarted","Data":"3cea1a6aa6c5ad8ab314960f12b48686d38cc0d0885afbb58806d35228647a57"} Jul 07 00:28:10.452273 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:10.452238 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" event={"ID":"382b3883-c408-4142-a062-4a5cc97d6790","Type":"ContainerStarted","Data":"ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c"} Jul 07 00:28:10.452721 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:10.452321 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:10.470734 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:10.470682 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" podStartSLOduration=1.6803314230000002 podStartE2EDuration="3.470637632s" totalImagesPullingTime="1.790306209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:10.4700214 +0000 UTC m=+1929.331193141" watchObservedRunningTime="2026-07-07 00:28:10.470637632 +0000 UTC m=+1929.331809373" Jul 07 00:28:16.464026 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:16.463991 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:22.869768 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:22.869728 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:28:27.518256 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.518221 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2"] Jul 07 00:28:27.518863 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.518478 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" podUID="382b3883-c408-4142-a062-4a5cc97d6790" containerName="maas-api" containerID="cri-o://ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c" gracePeriod=30 Jul 07 00:28:27.776326 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.776255 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:27.918532 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.918492 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls\") pod \"382b3883-c408-4142-a062-4a5cc97d6790\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " Jul 07 00:28:27.918745 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.918600 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7ntb\" (UniqueName: \"kubernetes.io/projected/382b3883-c408-4142-a062-4a5cc97d6790-kube-api-access-n7ntb\") pod \"382b3883-c408-4142-a062-4a5cc97d6790\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " Jul 07 00:28:27.918745 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.918626 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/382b3883-c408-4142-a062-4a5cc97d6790-openshift-service-ca\") pod \"382b3883-c408-4142-a062-4a5cc97d6790\" (UID: \"382b3883-c408-4142-a062-4a5cc97d6790\") " Jul 07 00:28:27.919050 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.919021 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382b3883-c408-4142-a062-4a5cc97d6790-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "382b3883-c408-4142-a062-4a5cc97d6790" (UID: "382b3883-c408-4142-a062-4a5cc97d6790"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:28:27.920803 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.920778 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "382b3883-c408-4142-a062-4a5cc97d6790" (UID: "382b3883-c408-4142-a062-4a5cc97d6790"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:28:27.920882 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:27.920795 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382b3883-c408-4142-a062-4a5cc97d6790-kube-api-access-n7ntb" (OuterVolumeSpecName: "kube-api-access-n7ntb") pod "382b3883-c408-4142-a062-4a5cc97d6790" (UID: "382b3883-c408-4142-a062-4a5cc97d6790"). InnerVolumeSpecName "kube-api-access-n7ntb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:28:28.019640 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.019604 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7ntb\" (UniqueName: \"kubernetes.io/projected/382b3883-c408-4142-a062-4a5cc97d6790-kube-api-access-n7ntb\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:28.019640 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.019634 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/382b3883-c408-4142-a062-4a5cc97d6790-openshift-service-ca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:28.019878 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.019644 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/382b3883-c408-4142-a062-4a5cc97d6790-maas-api-tls\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:28:28.566363 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.566327 2559 generic.go:356] "Generic (PLEG): container finished" podID="382b3883-c408-4142-a062-4a5cc97d6790" containerID="ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c" exitCode=0 Jul 07 00:28:28.566800 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.566379 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" Jul 07 00:28:28.566800 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.566411 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" event={"ID":"382b3883-c408-4142-a062-4a5cc97d6790","Type":"ContainerDied","Data":"ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c"} Jul 07 00:28:28.566800 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.566469 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2" event={"ID":"382b3883-c408-4142-a062-4a5cc97d6790","Type":"ContainerDied","Data":"3cea1a6aa6c5ad8ab314960f12b48686d38cc0d0885afbb58806d35228647a57"} Jul 07 00:28:28.566800 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.566491 2559 scope.go:117] "RemoveContainer" containerID="ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c" Jul 07 00:28:28.576936 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.576919 2559 scope.go:117] "RemoveContainer" containerID="ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c" Jul 07 00:28:28.577193 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:28:28.577174 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c\": container with ID starting with ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c not found: ID does not exist" containerID="ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c" Jul 07 00:28:28.577253 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.577200 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c"} err="failed to get container status \"ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c\": rpc error: code = NotFound desc = could not find container \"ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c\": container with ID starting with ca1b8e6eb1fb67e03ce79bb823aa20c89283cdfdd032d0f80b260688b2ac501c not found: ID does not exist" Jul 07 00:28:28.589596 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.589571 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2"] Jul 07 00:28:28.593697 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:28.593671 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c1149c-76b76cf4b-lzsf2"] Jul 07 00:28:29.666107 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:29.666076 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382b3883-c408-4142-a062-4a5cc97d6790" path="/var/lib/kubelet/pods/382b3883-c408-4142-a062-4a5cc97d6790/volumes" Jul 07 00:28:36.834828 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.834788 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks"] Jul 07 00:28:36.835220 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.835207 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382b3883-c408-4142-a062-4a5cc97d6790" containerName="maas-api" Jul 07 00:28:36.835220 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.835221 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="382b3883-c408-4142-a062-4a5cc97d6790" containerName="maas-api" Jul 07 00:28:36.835309 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.835286 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="382b3883-c408-4142-a062-4a5cc97d6790" containerName="maas-api" Jul 07 00:28:36.838604 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.838587 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:36.842148 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.842126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-f5f1a0-serving-cert\"" Jul 07 00:28:36.842491 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.842475 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gxc75\"" Jul 07 00:28:36.867020 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.866991 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks"] Jul 07 00:28:36.998683 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.998618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:36.998854 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.998712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7588178-239f-417b-bb5b-10994577c595-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:36.998854 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:36.998736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65ck4\" (UniqueName: \"kubernetes.io/projected/a7588178-239f-417b-bb5b-10994577c595-kube-api-access-65ck4\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.099950 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.099839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.099950 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.099938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7588178-239f-417b-bb5b-10994577c595-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.100199 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.099961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65ck4\" (UniqueName: \"kubernetes.io/projected/a7588178-239f-417b-bb5b-10994577c595-kube-api-access-65ck4\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.100199 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:28:37.100016 2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-f5f1a0-serving-cert: secret "maas-api-e2e-shared-a-f5f1a0-serving-cert" not found Jul 07 00:28:37.100199 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:28:37.100086 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls podName:a7588178-239f-417b-bb5b-10994577c595 nodeName:}" failed. No retries permitted until 2026-07-07 00:28:37.60006889 +0000 UTC m=+1956.461240609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls") pod "maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" (UID: "a7588178-239f-417b-bb5b-10994577c595") : secret "maas-api-e2e-shared-a-f5f1a0-serving-cert" not found Jul 07 00:28:37.100712 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.100692 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7588178-239f-417b-bb5b-10994577c595-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.114331 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.114304 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65ck4\" (UniqueName: \"kubernetes.io/projected/a7588178-239f-417b-bb5b-10994577c595-kube-api-access-65ck4\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.597852 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.597819 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:28:37.604631 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.604601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.607212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.607190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls\") pod \"maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.749102 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.749063 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:37.897914 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:37.897882 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks"] Jul 07 00:28:37.899402 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:28:37.899374 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7588178_239f_417b_bb5b_10994577c595.slice/crio-633fc3d7b02f7fa839704a552227cec947c368fe2ad8454a2b98bc594c66cf29 WatchSource:0}: Error finding container 633fc3d7b02f7fa839704a552227cec947c368fe2ad8454a2b98bc594c66cf29: Status 404 returned error can't find the container with id 633fc3d7b02f7fa839704a552227cec947c368fe2ad8454a2b98bc594c66cf29 Jul 07 00:28:38.633844 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:38.633804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" event={"ID":"a7588178-239f-417b-bb5b-10994577c595","Type":"ContainerStarted","Data":"21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf"} Jul 07 00:28:38.634037 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:38.633900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" event={"ID":"a7588178-239f-417b-bb5b-10994577c595","Type":"ContainerStarted","Data":"633fc3d7b02f7fa839704a552227cec947c368fe2ad8454a2b98bc594c66cf29"} Jul 07 00:28:38.634037 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:38.633929 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:38.655894 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:38.655843 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" podStartSLOduration=2.2688489020000002 podStartE2EDuration="2.65582893s" totalImagesPullingTime="386.980028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:38.653753532 +0000 UTC m=+1957.514925278" watchObservedRunningTime="2026-07-07 00:28:38.65582893 +0000 UTC m=+1957.517000703" Jul 07 00:28:44.645721 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:44.645691 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:28:50.362255 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:28:50.362205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:29:10.349401 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:29:10.349308 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:29:42.570763 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:29:42.570729 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:29:56.565132 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:29:56.565088 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:30:00.140724 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.140689 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723070-984jj"] Jul 07 00:30:00.144318 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.144302 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" Jul 07 00:30:00.158723 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.158687 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf"] Jul 07 00:30:00.162374 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.162348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" Jul 07 00:30:00.162723 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.162694 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp"] Jul 07 00:30:00.166386 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.166357 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723070-984jj"] Jul 07 00:30:00.166500 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.166451 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" Jul 07 00:30:00.187847 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.187823 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf"] Jul 07 00:30:00.194952 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.194922 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp"] Jul 07 00:30:00.274422 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.274382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqmrv\" (UniqueName: \"kubernetes.io/projected/336bdee7-1ab4-4e36-a46c-59e5663330fc-kube-api-access-wqmrv\") pod \"maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf\" (UID: \"336bdee7-1ab4-4e36-a46c-59e5663330fc\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" Jul 07 00:30:00.274422 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.274425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hm7x\" (UniqueName: \"kubernetes.io/projected/3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e-kube-api-access-5hm7x\") pod \"maas-api-key-cleanup-29723070-984jj\" (UID: \"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e\") " pod="opendatahub/maas-api-key-cleanup-29723070-984jj" Jul 07 00:30:00.274639 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.274448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5hzs\" (UniqueName: \"kubernetes.io/projected/4e64ec56-0d22-4fb0-80f0-684a0750273e-kube-api-access-c5hzs\") pod \"maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp\" (UID: \"4e64ec56-0d22-4fb0-80f0-684a0750273e\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" Jul 07 00:30:00.375954 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.375908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqmrv\" (UniqueName: \"kubernetes.io/projected/336bdee7-1ab4-4e36-a46c-59e5663330fc-kube-api-access-wqmrv\") pod \"maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf\" (UID: \"336bdee7-1ab4-4e36-a46c-59e5663330fc\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" Jul 07 00:30:00.375954 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.375956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hm7x\" (UniqueName: \"kubernetes.io/projected/3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e-kube-api-access-5hm7x\") pod \"maas-api-key-cleanup-29723070-984jj\" (UID: \"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e\") " pod="opendatahub/maas-api-key-cleanup-29723070-984jj" Jul 07 00:30:00.376224 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.375991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5hzs\" (UniqueName: \"kubernetes.io/projected/4e64ec56-0d22-4fb0-80f0-684a0750273e-kube-api-access-c5hzs\") pod \"maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp\" (UID: \"4e64ec56-0d22-4fb0-80f0-684a0750273e\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" Jul 07 00:30:00.386031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.385998 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5hzs\" (UniqueName: \"kubernetes.io/projected/4e64ec56-0d22-4fb0-80f0-684a0750273e-kube-api-access-c5hzs\") pod \"maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp\" (UID: \"4e64ec56-0d22-4fb0-80f0-684a0750273e\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" Jul 07 00:30:00.386222 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.386199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hm7x\" (UniqueName: \"kubernetes.io/projected/3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e-kube-api-access-5hm7x\") pod \"maas-api-key-cleanup-29723070-984jj\" (UID: \"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e\") " pod="opendatahub/maas-api-key-cleanup-29723070-984jj" Jul 07 00:30:00.386505 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.386488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqmrv\" (UniqueName: \"kubernetes.io/projected/336bdee7-1ab4-4e36-a46c-59e5663330fc-kube-api-access-wqmrv\") pod \"maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf\" (UID: \"336bdee7-1ab4-4e36-a46c-59e5663330fc\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" Jul 07 00:30:00.455019 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.454920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" Jul 07 00:30:00.474314 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.474275 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" Jul 07 00:30:00.481475 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.481448 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" Jul 07 00:30:00.630790 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.630745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723070-984jj"] Jul 07 00:30:00.634921 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:30:00.634882 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9c17c3_b47a_4538_b7b3_b8ba1f29b74e.slice/crio-7f2c361b336c3a2000aae5eefc35f3122e88e06086bc2fe71eb173cd61bc1f51 WatchSource:0}: Error finding container 7f2c361b336c3a2000aae5eefc35f3122e88e06086bc2fe71eb173cd61bc1f51: Status 404 returned error can't find the container with id 7f2c361b336c3a2000aae5eefc35f3122e88e06086bc2fe71eb173cd61bc1f51 Jul 07 00:30:00.876031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.874605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf"] Jul 07 00:30:00.894252 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:30:00.894223 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336bdee7_1ab4_4e36_a46c_59e5663330fc.slice/crio-04e6845243c93de2551b7db80a6c8eab19c0553558f42be20633ded01926d397 WatchSource:0}: Error finding container 04e6845243c93de2551b7db80a6c8eab19c0553558f42be20633ded01926d397: Status 404 returned error can't find the container with id 04e6845243c93de2551b7db80a6c8eab19c0553558f42be20633ded01926d397 Jul 07 00:30:00.898992 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:00.898964 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp"] Jul 07 00:30:00.900757 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:30:00.900731 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e64ec56_0d22_4fb0_80f0_684a0750273e.slice/crio-3ff6a6001fc201e9aa967bc4f78874b72329ab6a3a5178cac762623d6e6bae12 WatchSource:0}: Error finding container 3ff6a6001fc201e9aa967bc4f78874b72329ab6a3a5178cac762623d6e6bae12: Status 404 returned error can't find the container with id 3ff6a6001fc201e9aa967bc4f78874b72329ab6a3a5178cac762623d6e6bae12 Jul 07 00:30:01.125613 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:01.125565 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" event={"ID":"336bdee7-1ab4-4e36-a46c-59e5663330fc","Type":"ContainerStarted","Data":"04e6845243c93de2551b7db80a6c8eab19c0553558f42be20633ded01926d397"} Jul 07 00:30:01.126784 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:01.126761 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" event={"ID":"4e64ec56-0d22-4fb0-80f0-684a0750273e","Type":"ContainerStarted","Data":"3ff6a6001fc201e9aa967bc4f78874b72329ab6a3a5178cac762623d6e6bae12"} Jul 07 00:30:01.128348 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:01.128319 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" event={"ID":"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e","Type":"ContainerStarted","Data":"32387b36af5760a0252e8f9a929ebf778501e42d7bd429497faa0a1f64b583da"} Jul 07 00:30:01.128456 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:01.128368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" event={"ID":"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e","Type":"ContainerStarted","Data":"7f2c361b336c3a2000aae5eefc35f3122e88e06086bc2fe71eb173cd61bc1f51"} Jul 07 00:30:01.145834 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:01.145777 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" podStartSLOduration=1.145761075 podStartE2EDuration="1.145761075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:30:01.143807967 +0000 UTC m=+2040.004979709" watchObservedRunningTime="2026-07-07 00:30:01.145761075 +0000 UTC m=+2040.006932816" Jul 07 00:30:02.136077 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:02.136037 2559 generic.go:356] "Generic (PLEG): container finished" podID="336bdee7-1ab4-4e36-a46c-59e5663330fc" containerID="9c173af03451bc3ad74777fbef5cf79d66c67e9c2ce9f46a27a59ca17968121d" exitCode=0 Jul 07 00:30:02.136267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:02.136075 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" event={"ID":"336bdee7-1ab4-4e36-a46c-59e5663330fc","Type":"ContainerDied","Data":"9c173af03451bc3ad74777fbef5cf79d66c67e9c2ce9f46a27a59ca17968121d"} Jul 07 00:30:02.137670 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:02.137631 2559 generic.go:356] "Generic (PLEG): container finished" podID="4e64ec56-0d22-4fb0-80f0-684a0750273e" containerID="b14dbe1246a50b82e26afa8da4eb02378158a4705fe38fa327c91aad8593bdd4" exitCode=0 Jul 07 00:30:02.137792 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:02.137684 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" event={"ID":"4e64ec56-0d22-4fb0-80f0-684a0750273e","Type":"ContainerDied","Data":"b14dbe1246a50b82e26afa8da4eb02378158a4705fe38fa327c91aad8593bdd4"} Jul 07 00:30:02.139172 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:02.139150 2559 generic.go:356] "Generic (PLEG): container finished" podID="3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e" containerID="32387b36af5760a0252e8f9a929ebf778501e42d7bd429497faa0a1f64b583da" exitCode=0 Jul 07 00:30:02.139251 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:02.139230 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" event={"ID":"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e","Type":"ContainerDied","Data":"32387b36af5760a0252e8f9a929ebf778501e42d7bd429497faa0a1f64b583da"} Jul 07 00:30:03.346919 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.346891 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" Jul 07 00:30:03.373698 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.373635 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" Jul 07 00:30:03.377282 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.377261 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" Jul 07 00:30:03.507961 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.507864 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5hzs\" (UniqueName: \"kubernetes.io/projected/4e64ec56-0d22-4fb0-80f0-684a0750273e-kube-api-access-c5hzs\") pod \"4e64ec56-0d22-4fb0-80f0-684a0750273e\" (UID: \"4e64ec56-0d22-4fb0-80f0-684a0750273e\") " Jul 07 00:30:03.507961 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.507910 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hm7x\" (UniqueName: \"kubernetes.io/projected/3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e-kube-api-access-5hm7x\") pod \"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e\" (UID: \"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e\") " Jul 07 00:30:03.508205 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.508079 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqmrv\" (UniqueName: \"kubernetes.io/projected/336bdee7-1ab4-4e36-a46c-59e5663330fc-kube-api-access-wqmrv\") pod \"336bdee7-1ab4-4e36-a46c-59e5663330fc\" (UID: \"336bdee7-1ab4-4e36-a46c-59e5663330fc\") " Jul 07 00:30:03.510279 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.510241 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e-kube-api-access-5hm7x" (OuterVolumeSpecName: "kube-api-access-5hm7x") pod "3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e" (UID: "3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e"). InnerVolumeSpecName "kube-api-access-5hm7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:30:03.510407 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.510336 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336bdee7-1ab4-4e36-a46c-59e5663330fc-kube-api-access-wqmrv" (OuterVolumeSpecName: "kube-api-access-wqmrv") pod "336bdee7-1ab4-4e36-a46c-59e5663330fc" (UID: "336bdee7-1ab4-4e36-a46c-59e5663330fc"). InnerVolumeSpecName "kube-api-access-wqmrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:30:03.510488 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.510373 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e64ec56-0d22-4fb0-80f0-684a0750273e-kube-api-access-c5hzs" (OuterVolumeSpecName: "kube-api-access-c5hzs") pod "4e64ec56-0d22-4fb0-80f0-684a0750273e" (UID: "4e64ec56-0d22-4fb0-80f0-684a0750273e"). InnerVolumeSpecName "kube-api-access-c5hzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:30:03.609783 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.609747 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5hzs\" (UniqueName: \"kubernetes.io/projected/4e64ec56-0d22-4fb0-80f0-684a0750273e-kube-api-access-c5hzs\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:30:03.609783 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.609776 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hm7x\" (UniqueName: \"kubernetes.io/projected/3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e-kube-api-access-5hm7x\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:30:03.609783 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:03.609785 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqmrv\" (UniqueName: \"kubernetes.io/projected/336bdee7-1ab4-4e36-a46c-59e5663330fc-kube-api-access-wqmrv\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:30:04.153784 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.153748 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" Jul 07 00:30:04.153784 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.153769 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf" event={"ID":"336bdee7-1ab4-4e36-a46c-59e5663330fc","Type":"ContainerDied","Data":"04e6845243c93de2551b7db80a6c8eab19c0553558f42be20633ded01926d397"} Jul 07 00:30:04.154032 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.153820 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04e6845243c93de2551b7db80a6c8eab19c0553558f42be20633ded01926d397" Jul 07 00:30:04.155284 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.155257 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" Jul 07 00:30:04.155284 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.155269 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp" event={"ID":"4e64ec56-0d22-4fb0-80f0-684a0750273e","Type":"ContainerDied","Data":"3ff6a6001fc201e9aa967bc4f78874b72329ab6a3a5178cac762623d6e6bae12"} Jul 07 00:30:04.155487 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.155325 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ff6a6001fc201e9aa967bc4f78874b72329ab6a3a5178cac762623d6e6bae12" Jul 07 00:30:04.156828 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.156807 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" Jul 07 00:30:04.156953 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.156810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723070-984jj" event={"ID":"3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e","Type":"ContainerDied","Data":"7f2c361b336c3a2000aae5eefc35f3122e88e06086bc2fe71eb173cd61bc1f51"} Jul 07 00:30:04.156953 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:04.156936 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f2c361b336c3a2000aae5eefc35f3122e88e06086bc2fe71eb173cd61bc1f51" Jul 07 00:30:14.253853 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:14.253812 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:30:30.448178 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:30.448090 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:30:47.355089 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:30:47.355043 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:31:01.163212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:31:01.163176 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:31:01.828071 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:31:01.828039 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:31:01.837589 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:31:01.837563 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:31:17.648554 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:31:17.648517 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:31:32.847437 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:31:32.847399 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:31:47.472970 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:31:47.472927 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:31:59.153562 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:31:59.153473 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:32:15.057734 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:32:15.057694 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:32:33.952422 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:32:33.952379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:32:52.248413 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:32:52.248375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:33:10.248156 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:33:10.248119 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:33:30.860823 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:33:30.860739 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:33:44.460428 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:33:44.460391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:34:05.052462 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:05.052426 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:34:11.265926 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.265883 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks"] Jul 07 00:34:11.266572 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.266156 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" podUID="a7588178-239f-417b-bb5b-10994577c595" containerName="maas-api" containerID="cri-o://21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf" gracePeriod=30 Jul 07 00:34:11.294030 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.294001 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf"] Jul 07 00:34:11.296788 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.296759 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f5f1a0-29723070-vcfbf"] Jul 07 00:34:11.533713 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.533687 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:34:11.626129 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.626096 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65ck4\" (UniqueName: \"kubernetes.io/projected/a7588178-239f-417b-bb5b-10994577c595-kube-api-access-65ck4\") pod \"a7588178-239f-417b-bb5b-10994577c595\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " Jul 07 00:34:11.626316 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.626203 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7588178-239f-417b-bb5b-10994577c595-openshift-service-ca\") pod \"a7588178-239f-417b-bb5b-10994577c595\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " Jul 07 00:34:11.626316 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.626232 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls\") pod \"a7588178-239f-417b-bb5b-10994577c595\" (UID: \"a7588178-239f-417b-bb5b-10994577c595\") " Jul 07 00:34:11.626635 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.626608 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7588178-239f-417b-bb5b-10994577c595-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7588178-239f-417b-bb5b-10994577c595" (UID: "a7588178-239f-417b-bb5b-10994577c595"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:34:11.628453 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.628423 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7588178-239f-417b-bb5b-10994577c595" (UID: "a7588178-239f-417b-bb5b-10994577c595"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:34:11.628581 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.628533 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7588178-239f-417b-bb5b-10994577c595-kube-api-access-65ck4" (OuterVolumeSpecName: "kube-api-access-65ck4") pod "a7588178-239f-417b-bb5b-10994577c595" (UID: "a7588178-239f-417b-bb5b-10994577c595"). InnerVolumeSpecName "kube-api-access-65ck4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:34:11.666285 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.666254 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="336bdee7-1ab4-4e36-a46c-59e5663330fc" path="/var/lib/kubelet/pods/336bdee7-1ab4-4e36-a46c-59e5663330fc/volumes" Jul 07 00:34:11.684445 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.684413 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7588178-239f-417b-bb5b-10994577c595" containerID="21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf" exitCode=0 Jul 07 00:34:11.684625 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.684471 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" Jul 07 00:34:11.684625 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.684517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" event={"ID":"a7588178-239f-417b-bb5b-10994577c595","Type":"ContainerDied","Data":"21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf"} Jul 07 00:34:11.684625 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.684574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks" event={"ID":"a7588178-239f-417b-bb5b-10994577c595","Type":"ContainerDied","Data":"633fc3d7b02f7fa839704a552227cec947c368fe2ad8454a2b98bc594c66cf29"} Jul 07 00:34:11.684625 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.684602 2559 scope.go:117] "RemoveContainer" containerID="21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf" Jul 07 00:34:11.695481 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.695457 2559 scope.go:117] "RemoveContainer" containerID="21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf" Jul 07 00:34:11.695849 ip-10-0-131-246 kubenswrapper[2559]: E0707 00:34:11.695823 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf\": container with ID starting with 21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf not found: ID does not exist" containerID="21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf" Jul 07 00:34:11.695940 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.695859 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf"} err="failed to get container status \"21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf\": rpc error: code = NotFound desc = could not find container \"21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf\": container with ID starting with 21b42bf6240776ccdf4173b0569f898ad310e8ad27c8a729fe18361018e232bf not found: ID does not exist" Jul 07 00:34:11.702829 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.702808 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks"] Jul 07 00:34:11.705239 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.705218 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f5f1a0-c4bdbbf88-bj6ks"] Jul 07 00:34:11.727126 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.727091 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65ck4\" (UniqueName: \"kubernetes.io/projected/a7588178-239f-417b-bb5b-10994577c595-kube-api-access-65ck4\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:34:11.727126 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.727122 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7588178-239f-417b-bb5b-10994577c595-openshift-service-ca\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:34:11.727126 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:11.727133 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7588178-239f-417b-bb5b-10994577c595-maas-api-tls\") on node \"ip-10-0-131-246.ec2.internal\" DevicePath \"\"" Jul 07 00:34:13.666156 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:13.666119 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7588178-239f-417b-bb5b-10994577c595" path="/var/lib/kubelet/pods/a7588178-239f-417b-bb5b-10994577c595/volumes" Jul 07 00:34:19.555832 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:19.555787 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:34:54.578518 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:54.578431 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp"] Jul 07 00:34:54.581093 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:54.581066 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-ead650-29723070-9czqp"] Jul 07 00:34:55.665807 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:55.665776 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e64ec56-0d22-4fb0-80f0-684a0750273e" path="/var/lib/kubelet/pods/4e64ec56-0d22-4fb0-80f0-684a0750273e/volumes" Jul 07 00:34:57.061457 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:34:57.061417 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jkph7"] Jul 07 00:35:01.154557 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:01.154526 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d947bf65f-fctlx_bb3b7be7-4638-45f5-93c0-68c73f9582d3/authorino/0.log" Jul 07 00:35:05.587204 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:05.587155 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-td967_0cfcd36d-8cc3-4074-a236-698a8ea80141/manager/0.log" Jul 07 00:35:05.701969 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:05.701931 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tr67n_14fd7593-ff3d-4523-bc8a-a0c2dff2048b/manager/0.log" Jul 07 00:35:05.933197 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:05.933165 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-5vbkg_5d8b2434-df7c-4d9f-9a1b-c9985706341f/cleanup/0.log" Jul 07 00:35:06.041914 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:06.041887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723070-984jj_3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e/cleanup/0.log" Jul 07 00:35:06.272806 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:06.272727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-85wgw_36ac489d-577a-423d-8bb3-8fba2978028b/server/0.log" Jul 07 00:35:06.394429 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:06.394377 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jm67q_67fc2324-b6fe-4b12-83a3-d29e1185c630/manager/0.log" Jul 07 00:35:06.641059 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:06.641028 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-mgvn8_aecd5f50-e817-4d11-8156-93b71bd80530/copy-manifests/0.log" Jul 07 00:35:06.653802 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:06.653768 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-mgvn8_aecd5f50-e817-4d11-8156-93b71bd80530/manager/0.log" Jul 07 00:35:07.671366 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.671334 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9_a5a7d892-e8a9-48cb-945b-42dd7e112c2a/util/0.log" Jul 07 00:35:07.677796 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.677770 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9_a5a7d892-e8a9-48cb-945b-42dd7e112c2a/pull/0.log" Jul 07 00:35:07.684382 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.684363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9_a5a7d892-e8a9-48cb-945b-42dd7e112c2a/extract/0.log" Jul 07 00:35:07.791804 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.791776 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr_3b88e754-fd29-4037-b841-dee29955e6a3/util/0.log" Jul 07 00:35:07.797980 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.797955 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr_3b88e754-fd29-4037-b841-dee29955e6a3/pull/0.log" Jul 07 00:35:07.804252 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.804231 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr_3b88e754-fd29-4037-b841-dee29955e6a3/extract/0.log" Jul 07 00:35:07.912843 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.912813 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb_aa46c87a-b4ec-42c1-9a0f-a201db26c1f3/pull/0.log" Jul 07 00:35:07.919455 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.919426 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb_aa46c87a-b4ec-42c1-9a0f-a201db26c1f3/extract/0.log" Jul 07 00:35:07.926025 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:07.925954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb_aa46c87a-b4ec-42c1-9a0f-a201db26c1f3/util/0.log" Jul 07 00:35:08.037614 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.037580 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2_0b8ee3e6-6c7c-4212-bef9-0199bade38e4/util/0.log" Jul 07 00:35:08.044318 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.044294 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2_0b8ee3e6-6c7c-4212-bef9-0199bade38e4/pull/0.log" Jul 07 00:35:08.051176 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.051148 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2_0b8ee3e6-6c7c-4212-bef9-0199bade38e4/extract/0.log" Jul 07 00:35:08.168105 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.168065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d947bf65f-fctlx_bb3b7be7-4638-45f5-93c0-68c73f9582d3/authorino/0.log" Jul 07 00:35:08.282766 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.282685 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hxfb6_d04f11e4-d00d-4ac2-8793-925baac22247/manager/0.log" Jul 07 00:35:08.391592 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.391557 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7h5bg_f7b042b2-fd02-46cc-8258-823cf7004a80/manager/0.log" Jul 07 00:35:08.612259 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.612182 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vp88m_a338c1f8-44b5-4fe4-be5f-4807c0c585c5/registry-server/0.log" Jul 07 00:35:08.736291 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.736261 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w7rvf_17fae05a-a2d0-4159-9fa2-da7aaceef7f5/manager/0.log" Jul 07 00:35:08.851581 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.851548 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jkph7_9d3cb82a-7f93-41ae-86ec-56b49a1364d4/limitador/0.log" Jul 07 00:35:08.961427 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:08.961393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b279l_319f909d-7790-4539-ac68-b35ca813005f/manager/0.log" Jul 07 00:35:09.311140 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:09.311056 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tvxnf_f6f707f0-e4e4-48a7-9085-f1c4a2532a5c/istio-proxy/0.log" Jul 07 00:35:09.649563 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:09.649535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7697f65cb7-p4prc_61f266e3-31c0-4a2f-bb0b-5eacaafd8f87/kube-auth-proxy/0.log" Jul 07 00:35:10.117472 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:10.117434 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-574c44f6c5-xvvzs_65f6bf8a-7c32-460e-9a92-d148d6cda2f1/router/0.log" Jul 07 00:35:15.368513 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368467 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6khfq/must-gather-67hwt"] Jul 07 00:35:15.368920 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368888 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336bdee7-1ab4-4e36-a46c-59e5663330fc" containerName="cleanup" Jul 07 00:35:15.368920 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368901 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="336bdee7-1ab4-4e36-a46c-59e5663330fc" containerName="cleanup" Jul 07 00:35:15.368920 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368919 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7588178-239f-417b-bb5b-10994577c595" containerName="maas-api" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368925 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7588178-239f-417b-bb5b-10994577c595" containerName="maas-api" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368935 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e" containerName="cleanup" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368940 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e" containerName="cleanup" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368948 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e64ec56-0d22-4fb0-80f0-684a0750273e" containerName="cleanup" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.368954 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e64ec56-0d22-4fb0-80f0-684a0750273e" containerName="cleanup" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.369014 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="336bdee7-1ab4-4e36-a46c-59e5663330fc" containerName="cleanup" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.369022 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e64ec56-0d22-4fb0-80f0-684a0750273e" containerName="cleanup" Jul 07 00:35:15.369031 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.369029 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7588178-239f-417b-bb5b-10994577c595" containerName="maas-api" Jul 07 00:35:15.369267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.369036 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e" containerName="cleanup" Jul 07 00:35:15.372523 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.372500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.375054 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.375029 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khfq\"/\"openshift-service-ca.crt\"" Jul 07 00:35:15.376289 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.376263 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6khfq\"/\"default-dockercfg-hjcwq\"" Jul 07 00:35:15.376566 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.376550 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khfq\"/\"kube-root-ca.crt\"" Jul 07 00:35:15.380249 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.380224 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khfq/must-gather-67hwt"] Jul 07 00:35:15.414174 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.414135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb4wx\" (UniqueName: \"kubernetes.io/projected/84f5079b-166f-4f69-812c-2fefb0537bd3-kube-api-access-hb4wx\") pod \"must-gather-67hwt\" (UID: \"84f5079b-166f-4f69-812c-2fefb0537bd3\") " pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.414360 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.414260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84f5079b-166f-4f69-812c-2fefb0537bd3-must-gather-output\") pod \"must-gather-67hwt\" (UID: \"84f5079b-166f-4f69-812c-2fefb0537bd3\") " pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.515678 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.515614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84f5079b-166f-4f69-812c-2fefb0537bd3-must-gather-output\") pod \"must-gather-67hwt\" (UID: \"84f5079b-166f-4f69-812c-2fefb0537bd3\") " pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.515852 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.515702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4wx\" (UniqueName: \"kubernetes.io/projected/84f5079b-166f-4f69-812c-2fefb0537bd3-kube-api-access-hb4wx\") pod \"must-gather-67hwt\" (UID: \"84f5079b-166f-4f69-812c-2fefb0537bd3\") " pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.515960 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.515940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84f5079b-166f-4f69-812c-2fefb0537bd3-must-gather-output\") pod \"must-gather-67hwt\" (UID: \"84f5079b-166f-4f69-812c-2fefb0537bd3\") " pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.523963 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.523943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb4wx\" (UniqueName: \"kubernetes.io/projected/84f5079b-166f-4f69-812c-2fefb0537bd3-kube-api-access-hb4wx\") pod \"must-gather-67hwt\" (UID: \"84f5079b-166f-4f69-812c-2fefb0537bd3\") " pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.684974 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.684885 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khfq/must-gather-67hwt" Jul 07 00:35:15.831184 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.831157 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khfq/must-gather-67hwt"] Jul 07 00:35:15.832787 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:35:15.832761 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84f5079b_166f_4f69_812c_2fefb0537bd3.slice/crio-e2e1c4fe1dc089bbf2f478deedc42ecf1156ff56568bed46a4d6e20fae8db681 WatchSource:0}: Error finding container e2e1c4fe1dc089bbf2f478deedc42ecf1156ff56568bed46a4d6e20fae8db681: Status 404 returned error can't find the container with id e2e1c4fe1dc089bbf2f478deedc42ecf1156ff56568bed46a4d6e20fae8db681 Jul 07 00:35:15.834637 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:15.834618 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:35:16.086105 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:16.086015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khfq/must-gather-67hwt" event={"ID":"84f5079b-166f-4f69-812c-2fefb0537bd3","Type":"ContainerStarted","Data":"e2e1c4fe1dc089bbf2f478deedc42ecf1156ff56568bed46a4d6e20fae8db681"} Jul 07 00:35:17.096806 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:17.096688 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khfq/must-gather-67hwt" event={"ID":"84f5079b-166f-4f69-812c-2fefb0537bd3","Type":"ContainerStarted","Data":"04faf1c93a5d4bfa6390136b863c889270372e9e9f23c08a39080ceb578108e4"} Jul 07 00:35:17.096806 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:17.096749 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khfq/must-gather-67hwt" event={"ID":"84f5079b-166f-4f69-812c-2fefb0537bd3","Type":"ContainerStarted","Data":"f0d30e1ee4c2bd77b1c9dc770c7e8d14bb854944e4b76fffbe853a84a266c891"} Jul 07 00:35:17.117962 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:17.117903 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6khfq/must-gather-67hwt" podStartSLOduration=1.251318358 podStartE2EDuration="2.117883128s" totalImagesPullingTime="866.56477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:35:17.115447304 +0000 UTC m=+2355.976619047" watchObservedRunningTime="2026-07-07 00:35:17.117883128 +0000 UTC m=+2355.979054869" Jul 07 00:35:18.409512 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:18.409483 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kgzw2_6b63f8f2-0579-4181-bdea-f9934aa9c91c/global-pull-secret-syncer/0.log" Jul 07 00:35:18.543417 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:18.543386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r66zn_1cf029d5-38c8-4fd8-b9dc-987cac8f1ffa/konnectivity-agent/0.log" Jul 07 00:35:18.606787 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:18.606759 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-246.ec2.internal_61b063d09864a821f799a2f4e68ab1a6/haproxy/0.log" Jul 07 00:35:23.183020 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.182973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9_a5a7d892-e8a9-48cb-945b-42dd7e112c2a/extract/0.log" Jul 07 00:35:23.213236 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.213166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9_a5a7d892-e8a9-48cb-945b-42dd7e112c2a/util/0.log" Jul 07 00:35:23.237066 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.236979 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759clkt9_a5a7d892-e8a9-48cb-945b-42dd7e112c2a/pull/0.log" Jul 07 00:35:23.268771 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.268641 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr_3b88e754-fd29-4037-b841-dee29955e6a3/extract/0.log" Jul 07 00:35:23.293097 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.293065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr_3b88e754-fd29-4037-b841-dee29955e6a3/util/0.log" Jul 07 00:35:23.322975 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.322939 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hrpqr_3b88e754-fd29-4037-b841-dee29955e6a3/pull/0.log" Jul 07 00:35:23.353141 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.353103 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb_aa46c87a-b4ec-42c1-9a0f-a201db26c1f3/extract/0.log" Jul 07 00:35:23.377492 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.377456 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb_aa46c87a-b4ec-42c1-9a0f-a201db26c1f3/util/0.log" Jul 07 00:35:23.401424 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.401341 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rvzgb_aa46c87a-b4ec-42c1-9a0f-a201db26c1f3/pull/0.log" Jul 07 00:35:23.441301 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.441250 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2_0b8ee3e6-6c7c-4212-bef9-0199bade38e4/extract/0.log" Jul 07 00:35:23.479102 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.478882 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2_0b8ee3e6-6c7c-4212-bef9-0199bade38e4/util/0.log" Jul 07 00:35:23.503131 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.503085 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gx6h2_0b8ee3e6-6c7c-4212-bef9-0199bade38e4/pull/0.log" Jul 07 00:35:23.908676 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.907852 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d947bf65f-fctlx_bb3b7be7-4638-45f5-93c0-68c73f9582d3/authorino/0.log" Jul 07 00:35:23.940352 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.940323 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hxfb6_d04f11e4-d00d-4ac2-8793-925baac22247/manager/0.log" Jul 07 00:35:23.965675 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:23.965624 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7h5bg_f7b042b2-fd02-46cc-8258-823cf7004a80/manager/0.log" Jul 07 00:35:24.050397 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:24.050356 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vp88m_a338c1f8-44b5-4fe4-be5f-4807c0c585c5/registry-server/0.log" Jul 07 00:35:24.214725 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:24.213411 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w7rvf_17fae05a-a2d0-4159-9fa2-da7aaceef7f5/manager/0.log" Jul 07 00:35:24.248740 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:24.248710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jkph7_9d3cb82a-7f93-41ae-86ec-56b49a1364d4/limitador/0.log" Jul 07 00:35:24.326718 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:24.326689 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b279l_319f909d-7790-4539-ac68-b35ca813005f/manager/0.log" Jul 07 00:35:26.257141 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.257090 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-tlnbq_f02f9eb3-78b4-4e40-a9ae-2795432fb956/cluster-monitoring-operator/0.log" Jul 07 00:35:26.363269 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.363237 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-568b458b98-p72r6_e15de56c-dcf4-4cf5-aad6-739ce670784f/metrics-server/0.log" Jul 07 00:35:26.507818 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.507727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bglck_6f9c0d42-d15e-4bf8-bb18-14235ac8922d/node-exporter/0.log" Jul 07 00:35:26.528699 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.528642 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bglck_6f9c0d42-d15e-4bf8-bb18-14235ac8922d/kube-rbac-proxy/0.log" Jul 07 00:35:26.550671 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.550625 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bglck_6f9c0d42-d15e-4bf8-bb18-14235ac8922d/init-textfile/0.log" Jul 07 00:35:26.664017 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.663980 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-6mdgr_e5e7dc2d-ba91-4318-b2f1-8606b2a7083f/kube-rbac-proxy-main/0.log" Jul 07 00:35:26.685377 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.685323 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-6mdgr_e5e7dc2d-ba91-4318-b2f1-8606b2a7083f/kube-rbac-proxy-self/0.log" Jul 07 00:35:26.706446 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:26.706395 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-6mdgr_e5e7dc2d-ba91-4318-b2f1-8606b2a7083f/openshift-state-metrics/0.log" Jul 07 00:35:27.066842 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:27.066809 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8668d7-fzs29_55fec463-0cac-40e4-bcf3-8482f147466e/thanos-query/0.log" Jul 07 00:35:27.090913 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:27.090887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8668d7-fzs29_55fec463-0cac-40e4-bcf3-8482f147466e/kube-rbac-proxy-web/0.log" Jul 07 00:35:27.112629 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:27.112602 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8668d7-fzs29_55fec463-0cac-40e4-bcf3-8482f147466e/kube-rbac-proxy/0.log" Jul 07 00:35:27.134537 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:27.134508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8668d7-fzs29_55fec463-0cac-40e4-bcf3-8482f147466e/prom-label-proxy/0.log" Jul 07 00:35:27.154873 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:27.154826 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8668d7-fzs29_55fec463-0cac-40e4-bcf3-8482f147466e/kube-rbac-proxy-rules/0.log" Jul 07 00:35:27.176459 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:27.176429 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8668d7-fzs29_55fec463-0cac-40e4-bcf3-8482f147466e/kube-rbac-proxy-metrics/0.log" Jul 07 00:35:28.261212 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.261174 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr"] Jul 07 00:35:28.266033 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.265999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.275420 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.275395 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr"] Jul 07 00:35:28.352162 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.352125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhbgg\" (UniqueName: \"kubernetes.io/projected/8bfee29a-c145-47cb-8466-d88e53a6e55f-kube-api-access-vhbgg\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.352577 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.352545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-podres\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.352678 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.352611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-sys\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.352749 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.352709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-proc\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.352821 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.352803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-lib-modules\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.361753 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.361729 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-7tl6n_97dc5c42-f119-4fbc-b57d-c0167eb8c81e/networking-console-plugin/0.log" Jul 07 00:35:28.454068 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-lib-modules\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhbgg\" (UniqueName: \"kubernetes.io/projected/8bfee29a-c145-47cb-8466-d88e53a6e55f-kube-api-access-vhbgg\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-podres\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-sys\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-lib-modules\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454267 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-proc\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454535 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-podres\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454535 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-proc\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.454535 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.454386 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bfee29a-c145-47cb-8466-d88e53a6e55f-sys\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.466119 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.466089 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhbgg\" (UniqueName: \"kubernetes.io/projected/8bfee29a-c145-47cb-8466-d88e53a6e55f-kube-api-access-vhbgg\") pod \"perf-node-gather-daemonset-6x2lr\" (UID: \"8bfee29a-c145-47cb-8466-d88e53a6e55f\") " pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.580940 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.580846 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:28.780576 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:28.780548 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr"] Jul 07 00:35:28.784321 ip-10-0-131-246 kubenswrapper[2559]: W0707 00:35:28.784273 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8bfee29a_c145_47cb_8466_d88e53a6e55f.slice/crio-ca0afafca4540c55c10f4f611c3387c5e46424e2a0d05d94d5959819fc78a067 WatchSource:0}: Error finding container ca0afafca4540c55c10f4f611c3387c5e46424e2a0d05d94d5959819fc78a067: Status 404 returned error can't find the container with id ca0afafca4540c55c10f4f611c3387c5e46424e2a0d05d94d5959819fc78a067 Jul 07 00:35:29.035442 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:29.035409 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/1.log" Jul 07 00:35:29.041596 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:29.041562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hc6zr_4677e488-e259-4482-9914-786385a15b13/console-operator/2.log" Jul 07 00:35:29.216206 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:29.216154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" event={"ID":"8bfee29a-c145-47cb-8466-d88e53a6e55f","Type":"ContainerStarted","Data":"22d06f2916fb8b6c672194c8874d83b932dc4372409697093e127d1510e56522"} Jul 07 00:35:29.216412 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:29.216224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" event={"ID":"8bfee29a-c145-47cb-8466-d88e53a6e55f","Type":"ContainerStarted","Data":"ca0afafca4540c55c10f4f611c3387c5e46424e2a0d05d94d5959819fc78a067"} Jul 07 00:35:29.216412 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:29.216353 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:29.235788 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:29.235720 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" podStartSLOduration=1.235697501 podStartE2EDuration="1.235697501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:35:29.234521028 +0000 UTC m=+2368.095692769" watchObservedRunningTime="2026-07-07 00:35:29.235697501 +0000 UTC m=+2368.096869243" Jul 07 00:35:29.535493 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:29.535407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-698645b9fd-n92nr_f8ce9a63-b72c-41fb-b96b-49377b52fe4a/console/0.log" Jul 07 00:35:30.192359 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:30.192322 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-rdxs2_acccb75c-be4d-46fe-9fc9-c7fb102a627e/volume-data-source-validator/0.log" Jul 07 00:35:31.281224 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:31.281187 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87qqj_0a8cf44e-dcb9-4d8f-8085-db12e98ede5b/dns/0.log" Jul 07 00:35:31.306600 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:31.306576 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87qqj_0a8cf44e-dcb9-4d8f-8085-db12e98ede5b/kube-rbac-proxy/0.log" Jul 07 00:35:31.430768 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:31.430739 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fb8x_4e9be49f-c961-4384-895b-40317cc397f2/dns-node-resolver/0.log" Jul 07 00:35:32.032509 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:32.032477 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29723040-frcxt_094f8df9-5062-4037-82c0-dcd400e2b4bf/image-pruner/0.log" Jul 07 00:35:32.106077 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:32.106036 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m58pd_162adc1c-09fc-41a5-8405-27851cc2aa30/node-ca/0.log" Jul 07 00:35:33.133196 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:33.133161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tvxnf_f6f707f0-e4e4-48a7-9085-f1c4a2532a5c/istio-proxy/0.log" Jul 07 00:35:33.383003 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:33.382976 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7697f65cb7-p4prc_61f266e3-31c0-4a2f-bb0b-5eacaafd8f87/kube-auth-proxy/0.log" Jul 07 00:35:33.629357 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:33.629323 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-574c44f6c5-xvvzs_65f6bf8a-7c32-460e-9a92-d148d6cda2f1/router/0.log" Jul 07 00:35:34.367968 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:34.367943 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wjwvw_08100cfa-85bb-4bbb-be3f-39d2cf59c53d/serve-healthcheck-canary/0.log" Jul 07 00:35:34.845476 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:34.845383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-c8c4f_ffd1bf71-2832-4504-8157-28bce1fd2fec/insights-operator/0.log" Jul 07 00:35:34.846042 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:34.846006 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-c8c4f_ffd1bf71-2832-4504-8157-28bce1fd2fec/insights-operator/1.log" Jul 07 00:35:35.010833 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:35.010801 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vtk2x_278738d3-22b9-4d8b-bdcc-9000d4be09b1/kube-rbac-proxy/0.log" Jul 07 00:35:35.033066 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:35.033033 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vtk2x_278738d3-22b9-4d8b-bdcc-9000d4be09b1/exporter/0.log" Jul 07 00:35:35.056389 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:35.056360 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vtk2x_278738d3-22b9-4d8b-bdcc-9000d4be09b1/extractor/0.log" Jul 07 00:35:35.236573 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:35.236543 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6khfq/perf-node-gather-daemonset-6x2lr" Jul 07 00:35:37.303081 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:37.303042 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-td967_0cfcd36d-8cc3-4074-a236-698a8ea80141/manager/0.log" Jul 07 00:35:37.512775 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:37.512749 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tr67n_14fd7593-ff3d-4523-bc8a-a0c2dff2048b/manager/0.log" Jul 07 00:35:37.584000 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:37.583963 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-5vbkg_5d8b2434-df7c-4d9f-9a1b-c9985706341f/cleanup/0.log" Jul 07 00:35:37.609540 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:37.609505 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723070-984jj_3a9c17c3-b47a-4538-b7b3-b8ba1f29b74e/cleanup/0.log" Jul 07 00:35:37.801975 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:37.801891 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-85wgw_36ac489d-577a-423d-8bb3-8fba2978028b/server/0.log" Jul 07 00:35:37.887420 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:37.887389 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jm67q_67fc2324-b6fe-4b12-83a3-d29e1185c630/manager/0.log" Jul 07 00:35:38.036640 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:38.036597 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-mgvn8_aecd5f50-e817-4d11-8156-93b71bd80530/manager/0.log" Jul 07 00:35:38.059704 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:38.059599 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d7997cf4b-mgvn8_aecd5f50-e817-4d11-8156-93b71bd80530/copy-manifests/0.log" Jul 07 00:35:39.276408 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:39.276376 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tvxnf_f6f707f0-e4e4-48a7-9085-f1c4a2532a5c/istio-proxy/0.log" Jul 07 00:35:39.584728 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:39.584621 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7697f65cb7-p4prc_61f266e3-31c0-4a2f-bb0b-5eacaafd8f87/kube-auth-proxy/0.log" Jul 07 00:35:39.587426 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:39.586303 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d9prj_e41acea9-4da1-4160-9d61-01c6046b629b/openshift-lws-operator/0.log" Jul 07 00:35:39.884856 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:39.884814 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-574c44f6c5-xvvzs_65f6bf8a-7c32-460e-9a92-d148d6cda2f1/router/0.log" Jul 07 00:35:41.093224 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:41.093180 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4tvxnf_f6f707f0-e4e4-48a7-9085-f1c4a2532a5c/istio-proxy/0.log" Jul 07 00:35:41.320849 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:41.320805 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7697f65cb7-p4prc_61f266e3-31c0-4a2f-bb0b-5eacaafd8f87/kube-auth-proxy/0.log" Jul 07 00:35:41.536085 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:41.536053 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-574c44f6c5-xvvzs_65f6bf8a-7c32-460e-9a92-d148d6cda2f1/router/0.log" Jul 07 00:35:45.046592 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:45.046558 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-h5wj9_33f5d3f9-ee8d-49f8-a137-3819fe039137/kube-storage-version-migrator-operator/1.log" Jul 07 00:35:45.047462 ip-10-0-131-246 kubenswrapper[2559]: I0707 00:35:45.047440 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-h5wj9_33f5d3f9-ee8d-49f8-a137-3819fe039137/kube-storage-version-migrator-operator/0.log"